Senior Software Developer, ML Platform & Infrastructure

ML Platform Engineer · Senior · Full Time

Toronto HeadquartersCAD 152k – 189k4d ago
Apply for this role

Opens Wealthsimple Technologies's application page

Role

What you'll do.

Senior Software Developer leading the ML Platform & Infrastructure team at Wealthsimple, bridging traditional MLOps with cutting-edge LLM inference and GPU orchestration. This role requires 7+ years of ML infrastructure expertise with deep proficiency in Kubernetes, Python, and cloud platforms, with a focus on building scalable, enterprise-grade LLM serving systems that empower data scientists and engineers across the organization. You will own end-to-end technical direction for GenAI infrastructure while optimizing cost, performance, and reliability across self-hosted and managed inference solutions.

Responsibilities

  • Architect Enterprise-Grade LLM Infrastructure: Design and build scalable GPU infrastructure for serving large language models using Kubernetes, vLLM, Ray, and Triton, ensuring high availability and performance across self-hosted and managed cloud solutions
  • Build Intelligent Model Routing Platform: Develop low-latency routing frameworks using LiteLLM to dynamically direct inference requests across AWS Bedrock managed services and self-hosted open-source models, optimizing for cost and performance
  • Develop MLOps to GenAI Pipeline Transition: Transition traditional ML lifecycle patterns and serving infrastructure toward modern large language model requirements, implementing best practices for LLM orchestration and inference optimization
  • Provision and Manage GPU Infrastructure: Architect and operate high-performance GPU serving environments on Kubernetes, managing compute resources, handling GPU allocation, and scaling infrastructure based on demand patterns
  • Create Automated Evaluation & Benchmarking Systems: Build comprehensive evaluation frameworks and observability tooling that enable data scientists and engineers to validate model quality, measure latency, detect drift, and monitor production performance metrics
  • Enable Self-Serve ML Platform Capabilities: Develop framework-agnostic platform tooling and abstractions that empower product engineering and data science teams to deploy, manage, and monitor their own models without deep infrastructure expertise
  • Optimize Cost & Performance Metrics: Drive continuous improvement in infrastructure efficiency by optimizing capacity utilization, implementing smart batching strategies, optimizing model routing decisions, and tuning resource allocation to meet quality and reliability targets while reducing costs
  • Lead Technical Architecture & Roadmap: Take end-to-end ownership of the ML Platform technical direction, leading architectural decisions, mentoring engineers, guiding multi-functional projects, and ensuring long-term maintainability and scalability
  • Collaborate Across Engineering & Data Science Teams: Partner with cross-functional teams including product engineering and data science to understand requirements, provide infrastructure guidance, and build solutions that accelerate AI adoption across Wealthsimple

Qualifications

What we look for.

Technical

  • Advanced Python Proficiency

    Expert-level Python skills for building complex MLOps infrastructure, model serving systems, and backend optimization

  • Kubernetes Container Orchestration

    Deep hands-on experience deploying, scaling, and managing containerized workloads on Kubernetes clusters for production ML infrastructure

  • Infrastructure as Code (Terraform)

    Proficiency with Terraform for provisioning and managing cloud infrastructure, ensuring reproducibility and scalability

  • AWS Cloud Ecosystem

    Strong familiarity with AWS services including EC2, S3, Bedrock, SageMaker, and GPU compute instances for ML workloads

  • MLOps & Model Serving Patterns

    Proven expertise in production ML infrastructure including model registry, experiment tracking, serving frameworks (Kubeflow, MLflow, Ray, Triton)

  • Backend Microservices Architecture

    Experience designing highly available, observable microservices using frameworks like FastAPI for real-time, low-latency request handling

  • LLM Inference Optimization

    Understanding of LLM serving challenges including prompt engineering, GPU memory optimization, batch processing, and latency reduction

Education

  • Bachelor's Degree in Computer Science or Related Field

    Formal education in Computer Science, Engineering, Mathematics, or equivalent professional experience demonstrating deep technical foundation

Experience

  • 7+ Years ML Infrastructure Engineering

    Extensive professional experience in ML Infrastructure, MLOps, ML Tooling, or Data Platform engineering roles with significant scope and responsibility

  • Production MLOps Platform Development

    Track record building and operating self-serve ML platforms, model registries, experiment tracking systems, or production serving infrastructure at scale

  • High-Performance System Design

    Experience architecting and maintaining complex, highly available platform systems handling significant traffic and business-critical workloads

  • End-to-End Technical Leadership

    Proven ability to lead architectural roadmaps, guide multi-functional projects with high autonomy, and maintain ownership of complex systems long-term

  • Production AI/ML Infrastructure

    Direct experience operating AI or ML systems in production environments, managing infrastructure scaling, and optimizing cost-performance tradeoffs

Skills

Required

  • Python

    Advanced proficiency required for infrastructure automation, model serving code, and platform development

  • Kubernetes

    Deep expertise in container orchestration, cluster management, and production Kubernetes deployments

  • Terraform

    Strong infrastructure-as-code skills for AWS provisioning and infrastructure automation

  • AWS Cloud Services

    Hands-on experience with EC2, S3, Bedrock, SageMaker, and GPU infrastructure management

  • MLOps Platforms

    Production experience with tools like Kubeflow, MLflow, Ray, Triton, or SageMaker

  • Model Serving & Inference

    Experience building or operating production model serving infrastructure and inference pipelines

  • Backend Development

    Strong microservices development skills, ideally with FastAPI or similar high-performance web frameworks

Preferred

  • LLM Production Experience

    Nice to have

    Direct hands-on experience serving open-source Large Language Models in production using vLLM, SGLang, TensorRT-LLM, or similar frameworks

  • GPU Computing & CUDA

    Nice to have

    Experience with CUDA programming, GPU partitioning, GPU memory optimization, or distributed GPU inference frameworks

  • Ray Serve & Distributed Inference

    Nice to have

    Practical experience with Ray Serve or other distributed inference frameworks for scaling model serving

  • Vector Databases & RAG

    Nice to have

    Familiarity with vector search engines (Elasticsearch, Qdrant, Pinecone) and retrieval-augmented generation patterns

  • LLM Evaluation & Observability

    Nice to have

    Experience building evaluation frameworks and observability systems for monitoring model performance in production

  • Cost Optimization & Performance Tuning

    Nice to have

    Track record optimizing infrastructure costs and performance through batching strategies, model routing, and resource utilization

Tech stack

Languages

Python

Frameworks

FastAPIPyTorchvLLMRayTritonLiteLLM

Databases

PostgreSQLRedshiftSnowflake

Tools

KubernetesTerraformDockerAWS (EC2, S3, SageMaker, Bedrock)MLflowKafka

Other

CUDAVector Search Engines (Elasticsearch, Qdrant, Pinecone)LLM Evaluation Frameworks

Compensation

Pay and benefits.

Base·CAD 152,000 – 189,000

Equity·Stock options

Benefits

  • Comprehensive Health Benefits

    Top-tier health coverage including medical, dental, vision, and life insurance for employees and eligible dependents

  • Employer Matching RRSP/Savings Program

    Long-term group savings plan with employer match through Wealthsimple for Business to support retirement planning

  • Generous Paid Time Off

    20 vacation days, 4 annual wellness days, unlimited sick days, and unlimited mental health days per year

  • Global Mobility Program

    Ability to work outside Canada for up to 90 days per year, enabling remote work flexibility across North America

  • Employee Resource Groups

    Access to Rainbow (2SLGBTQ+), Women of Wealthsimple, and Black at Wealthsimple communities for professional networking and support

  • Hybrid Work Environment

    Flexible work arrangement with over 1,500 employees across North America, fostering collaboration and work-life balance

Process

Interview steps.

  1. 01

    Initial Screening & Application Review

    Wealthsimple will review your resume, cover letter, and responses focusing on relevant MLOps experience, technical depth, and demonstrated expertise with production ML infrastructure. Background in LLM serving or GenAI platforms will be particularly valued.

  2. 02

    Technical Phone Screen

    A 45-60 minute conversation with a team member covering your MLOps background, specific experience with model serving frameworks, Kubernetes architecture decisions, and approach to infrastructure challenges. Expect discussion of past systems you've built and technical tradeoffs.

  3. 03

    Technical Deep Dive Interview

    A 1-2 hour technical conversation diving deeper into your expertise in areas like GPU infrastructure management, model routing strategies, cost optimization approaches, and how you'd approach building LLM serving platforms. May include system design discussions.

  4. 04

    Infrastructure Architecture Discussion

    Collaborative session where you'll discuss your approach to scaling LLM inference, handling GPU resource constraints, implementing observability for production ML systems, and balancing managed versus self-hosted inference solutions.

  5. 05

    Cross-Functional Team Meeting

    Conversation with data scientists, product engineers, or other stakeholders to discuss collaboration style, how you'd empower teams to self-serve ML infrastructure, and your experience working across functional boundaries.

  6. 06

    Leadership & Culture Conversation

    Final conversation with senior leadership discussing your technical vision, approach to leading platform teams, experience mentoring engineers, and alignment with Wealthsimple's values around innovation, inclusion, and building products that democratize financial access.

Full posting

Original listing.

Build something people love

Wealthsimple is Canada’s leading financial innovator. The company offers a full suite of simple, sophisticated financial products across managed investing, do-it-yourself trading, cryptocurrency, tax filing, spending and saving. Wealthsimple currently serves more than 4 million Canadians and holds over $155 billion in assets under administration. The company was founded in 2014 by a team of financial experts and technology entrepreneurs, and is headquartered in Toronto, Canada.

We're proud of what we've built — and we're just getting started. Read our Culture Manual and learn more about how we work.

ML Platform & Infrastructure Team

The Machine Learning Infrastructure & Platform team builds the foundational architecture powering AI and GenAI initiatives across Wealthsimple. We sit at the intersection of production MLOps and cutting-edge GenAI enablement.

As our AI footprint expands rapidly, our priority is evolving our robust MLOps foundations into a scalable, high-performance LLM serving and routing platform. We build self-serve systems that allow Data Scientists and Engineers to host open-source LLMs reliably, optimize inference latencies, manage GPU infrastructure, and benchmark model performance safely in production.

The Role

We are looking for an experienced MLOps or ML Platform Engineer who is excited to pivot their deep background in model orchestration, serving, and platform tooling toward solving the unique challenges of LLM inference and infrastructure.

In this role, you will bridge the gap between traditional MLOps (model lifecycles, pipeline orchestration, serving infrastructure) and modern GenAI stack requirements (vLLM, GPU cluster management, intelligent model routing, and automated Evals). You will take end-to-end ownership of setting the technical direction for operating enterprise-grade LLM systems company-wide.

In this role, you will have the opportunity to:

  • Turn MLOps expertise to GenAI: Transition traditional ML lifecycle and serving patterns into state-of-the-art LLM inference engines and GPU orchestration systems.

  • Build model-routing architecture: Design low-latency routing frameworks (e.g., LiteLLM integration) to dynamically direct requests across managed cloud providers (AWS Bedrock) and self-hosted open-source models.

  • Provision & scale GPU infrastructure: Architect and manage high-performance GPU serving environments on Kubernetes using engines like vLLM, Ray, and Triton.

  • Develop evaluation & benchmarking tooling: Build automated Evals and observability frameworks to empower engineers and data scientists to validate model quality, latency, and drift against production requirements.

  • Empower self-serve ML across Wealthsimple: Partner with product engineering and data science teams to build framework-agnostic platform tooling that abstracts infrastructure complexity.

  • Drive cost & performance optimization: Improve price-performance across self-hosted and managed inference by optimizing capacity, utilization, batching, routing, and model selection while meeting quality and reliability objectives

We are looking for people who have:

  • 7+ years of software engineering experience in ML Infrastructure, MLOps, ML Tooling, or Data Platform engineering.

  • Deep experience in MLOps/ML Platform practices: Proven track record building and operating self-serve ML platforms, model registry workflows, experiment tracking, or production serving infrastructure (Kubeflow, MLflow, Ray, Triton, SageMaker).

  • Strong platform fundamentals: Advanced proficiency in Python, container orchestration via Kubernetes, infrastructure-as-code (Terraform), and cloud provider ecosystem (AWS).

  • Strong appetite to specialize in LLM serving: A genuine desire to leverage your existing MLOps skillset to tackle LLM-specific challenges (vLLM, model routing, prompt engineering tooling, vector databases, GPU memory optimization, or LLM evaluation frameworks).

  • Backend performance & observability focus: Experience designing highly available, observable microservices (e.g., FastAPI) handling real-time, low-latency requests.

  • End-to-end technical ownership: Proven capability to lead architectural roadmaps, guide multi-functional projects with high autonomy, and maintain complex platform systems for the long run.

Nice-to-haves (or areas you will learn on the job):

  • Direct experience serving open-source Large Language Models in production (vLLM, SGLang, TensorRT-LLM, Dynamo).

  • Hands-on work with CUDA, GPU partitioning, or distributed inference frameworks (Ray Serve).

  • Familiarity with vector search and retrieval engines (Elasticsearch, Qdrant, Pinecone).

Our Stack Includes:

  • Container & Infrastructure: Kubernetes, Terraform, AWS GPU Infrastructure

  • ML Serving & LLM Tooling: vLLM, Ray, Triton, LiteLLM, AWS Bedrock, MLflow, SageMaker

  • Languages & Frameworks: Python, FastAPI, PyTorch

  • Data & Streaming: Kafka, Postgres, Redshift, Snowflake

Why Wealthsimple?

🌸 Top-tier health benefits and life insurance

📈 Long-term group savings with employer match, through Wealthsimple for Business

🌴 20 vacation days, 4 wellness days, and unlimited sick and mental health days per year*

✈️ 90 days away: work outside Canada for up to 90 days per year*

👥 Employee resource groups, including Rainbow (2SLGBTQ), Women of WS, and Black at WS

🌎 We are a hybrid team with over 1,500 employees across North America. The people are one of the best parts of working here: you'll collaborate with incredibly talented, curious, and driven teammates who are deeply committed to doing great work.

*Unlimited paid sick days, Wellness Days and the 90 day away program do not apply to certain roles.

ICYMI

Technology & Innovation at Wealthsimple: We move quickly and build thoughtfully. That means we're always looking for better ways to work — whether that's new tools, AI, or rethinking how we approach a problem. We don't expect you to have all the answers, but we do expect curiosity and a willingness to evolve alongside the products we're building.

Inclusion Statement: We're building products for a diverse world, and we need a diverse team to do it well. We strongly encourage applications from everyone, regardless of race, religion, colour, national origin, gender, sexual orientation, age, marital status, or disability status.

Accessibility Statement: We're committed to an accessible hiring experience. If you need any accommodations throughout the interview process, please let us know — we'll work with you to make sure you have what you need. We also welcome any feedback on how we can better accommodate candidates with accessibility needs.

AI in Hiring: We may use artificial intelligence (AI) tools to support parts of our hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our team but don't replace human judgment – all final hiring decisions are made by people. If you have questions about how your data is used, reach out to us.

Redirects to Wealthsimple Technologies's application page.

Other roles

More at Wealthsimple Technologies.

View all 9 roles