Senior Software Developer, ML Platform & Infrastructure
ML Platform Engineer · Senior · Full Time
Opens Wealthsimple Technologies's application page
Role
What you'll do.
Senior Software Developer leading the ML Platform & Infrastructure team at Wealthsimple, bridging traditional MLOps with cutting-edge LLM inference and GPU orchestration. This role requires 7+ years of ML infrastructure expertise with deep proficiency in Kubernetes, Python, and cloud platforms, with a focus on building scalable, enterprise-grade LLM serving systems that empower data scientists and engineers across the organization. You will own end-to-end technical direction for GenAI infrastructure while optimizing cost, performance, and reliability across self-hosted and managed inference solutions.
Responsibilities
- Architect Enterprise-Grade LLM Infrastructure: Design and build scalable GPU infrastructure for serving large language models using Kubernetes, vLLM, Ray, and Triton, ensuring high availability and performance across self-hosted and managed cloud solutions
- Build Intelligent Model Routing Platform: Develop low-latency routing frameworks using LiteLLM to dynamically direct inference requests across AWS Bedrock managed services and self-hosted open-source models, optimizing for cost and performance
- Develop MLOps to GenAI Pipeline Transition: Transition traditional ML lifecycle patterns and serving infrastructure toward modern large language model requirements, implementing best practices for LLM orchestration and inference optimization
- Provision and Manage GPU Infrastructure: Architect and operate high-performance GPU serving environments on Kubernetes, managing compute resources, handling GPU allocation, and scaling infrastructure based on demand patterns
- Create Automated Evaluation & Benchmarking Systems: Build comprehensive evaluation frameworks and observability tooling that enable data scientists and engineers to validate model quality, measure latency, detect drift, and monitor production performance metrics
- Enable Self-Serve ML Platform Capabilities: Develop framework-agnostic platform tooling and abstractions that empower product engineering and data science teams to deploy, manage, and monitor their own models without deep infrastructure expertise
- Optimize Cost & Performance Metrics: Drive continuous improvement in infrastructure efficiency by optimizing capacity utilization, implementing smart batching strategies, optimizing model routing decisions, and tuning resource allocation to meet quality and reliability targets while reducing costs
- Lead Technical Architecture & Roadmap: Take end-to-end ownership of the ML Platform technical direction, leading architectural decisions, mentoring engineers, guiding multi-functional projects, and ensuring long-term maintainability and scalability
- Collaborate Across Engineering & Data Science Teams: Partner with cross-functional teams including product engineering and data science to understand requirements, provide infrastructure guidance, and build solutions that accelerate AI adoption across Wealthsimple
Qualifications
What we look for.
Technical
Advanced Python Proficiency
Expert-level Python skills for building complex MLOps infrastructure, model serving systems, and backend optimization
Kubernetes Container Orchestration
Deep hands-on experience deploying, scaling, and managing containerized workloads on Kubernetes clusters for production ML infrastructure
Infrastructure as Code (Terraform)
Proficiency with Terraform for provisioning and managing cloud infrastructure, ensuring reproducibility and scalability
AWS Cloud Ecosystem
Strong familiarity with AWS services including EC2, S3, Bedrock, SageMaker, and GPU compute instances for ML workloads
MLOps & Model Serving Patterns
Proven expertise in production ML infrastructure including model registry, experiment tracking, serving frameworks (Kubeflow, MLflow, Ray, Triton)
Backend Microservices Architecture
Experience designing highly available, observable microservices using frameworks like FastAPI for real-time, low-latency request handling
LLM Inference Optimization
Understanding of LLM serving challenges including prompt engineering, GPU memory optimization, batch processing, and latency reduction
Education
Bachelor's Degree in Computer Science or Related Field
Formal education in Computer Science, Engineering, Mathematics, or equivalent professional experience demonstrating deep technical foundation
Experience
7+ Years ML Infrastructure Engineering
Extensive professional experience in ML Infrastructure, MLOps, ML Tooling, or Data Platform engineering roles with significant scope and responsibility
Production MLOps Platform Development
Track record building and operating self-serve ML platforms, model registries, experiment tracking systems, or production serving infrastructure at scale
High-Performance System Design
Experience architecting and maintaining complex, highly available platform systems handling significant traffic and business-critical workloads
End-to-End Technical Leadership
Proven ability to lead architectural roadmaps, guide multi-functional projects with high autonomy, and maintain ownership of complex systems long-term
Production AI/ML Infrastructure
Direct experience operating AI or ML systems in production environments, managing infrastructure scaling, and optimizing cost-performance tradeoffs
Skills
Required
Python
Advanced proficiency required for infrastructure automation, model serving code, and platform development
Kubernetes
Deep expertise in container orchestration, cluster management, and production Kubernetes deployments
Terraform
Strong infrastructure-as-code skills for AWS provisioning and infrastructure automation
AWS Cloud Services
Hands-on experience with EC2, S3, Bedrock, SageMaker, and GPU infrastructure management
MLOps Platforms
Production experience with tools like Kubeflow, MLflow, Ray, Triton, or SageMaker
Model Serving & Inference
Experience building or operating production model serving infrastructure and inference pipelines
Backend Development
Strong microservices development skills, ideally with FastAPI or similar high-performance web frameworks
Preferred
LLM Production Experience
Nice to haveDirect hands-on experience serving open-source Large Language Models in production using vLLM, SGLang, TensorRT-LLM, or similar frameworks
GPU Computing & CUDA
Nice to haveExperience with CUDA programming, GPU partitioning, GPU memory optimization, or distributed GPU inference frameworks
Ray Serve & Distributed Inference
Nice to havePractical experience with Ray Serve or other distributed inference frameworks for scaling model serving
Vector Databases & RAG
Nice to haveFamiliarity with vector search engines (Elasticsearch, Qdrant, Pinecone) and retrieval-augmented generation patterns
LLM Evaluation & Observability
Nice to haveExperience building evaluation frameworks and observability systems for monitoring model performance in production
Cost Optimization & Performance Tuning
Nice to haveTrack record optimizing infrastructure costs and performance through batching strategies, model routing, and resource utilization
Tech stack
Languages
Frameworks
Databases
Tools
Other
Compensation
Pay and benefits.
Base·CAD 152,000 – 189,000
Equity·Stock options
Benefits
Comprehensive Health Benefits
Top-tier health coverage including medical, dental, vision, and life insurance for employees and eligible dependents
Employer Matching RRSP/Savings Program
Long-term group savings plan with employer match through Wealthsimple for Business to support retirement planning
Generous Paid Time Off
20 vacation days, 4 annual wellness days, unlimited sick days, and unlimited mental health days per year
Global Mobility Program
Ability to work outside Canada for up to 90 days per year, enabling remote work flexibility across North America
Employee Resource Groups
Access to Rainbow (2SLGBTQ+), Women of Wealthsimple, and Black at Wealthsimple communities for professional networking and support
Hybrid Work Environment
Flexible work arrangement with over 1,500 employees across North America, fostering collaboration and work-life balance
Process
Interview steps.
- 01
Initial Screening & Application Review
Wealthsimple will review your resume, cover letter, and responses focusing on relevant MLOps experience, technical depth, and demonstrated expertise with production ML infrastructure. Background in LLM serving or GenAI platforms will be particularly valued.
- 02
Technical Phone Screen
A 45-60 minute conversation with a team member covering your MLOps background, specific experience with model serving frameworks, Kubernetes architecture decisions, and approach to infrastructure challenges. Expect discussion of past systems you've built and technical tradeoffs.
- 03
Technical Deep Dive Interview
A 1-2 hour technical conversation diving deeper into your expertise in areas like GPU infrastructure management, model routing strategies, cost optimization approaches, and how you'd approach building LLM serving platforms. May include system design discussions.
- 04
Infrastructure Architecture Discussion
Collaborative session where you'll discuss your approach to scaling LLM inference, handling GPU resource constraints, implementing observability for production ML systems, and balancing managed versus self-hosted inference solutions.
- 05
Cross-Functional Team Meeting
Conversation with data scientists, product engineers, or other stakeholders to discuss collaboration style, how you'd empower teams to self-serve ML infrastructure, and your experience working across functional boundaries.
- 06
Leadership & Culture Conversation
Final conversation with senior leadership discussing your technical vision, approach to leading platform teams, experience mentoring engineers, and alignment with Wealthsimple's values around innovation, inclusion, and building products that democratize financial access.
Full posting
Original listing.
Build something people love
Wealthsimple is Canada’s leading financial innovator. The company offers a full suite of simple, sophisticated financial products across managed investing, do-it-yourself trading, cryptocurrency, tax filing, spending and saving. Wealthsimple currently serves more than 4 million Canadians and holds over $155 billion in assets under administration. The company was founded in 2014 by a team of financial experts and technology entrepreneurs, and is headquartered in Toronto, Canada.
We're proud of what we've built — and we're just getting started. Read our Culture Manual and learn more about how we work.
ML Platform & Infrastructure Team
The Machine Learning Infrastructure & Platform team builds the foundational architecture powering AI and GenAI initiatives across Wealthsimple. We sit at the intersection of production MLOps and cutting-edge GenAI enablement.
As our AI footprint expands rapidly, our priority is evolving our robust MLOps foundations into a scalable, high-performance LLM serving and routing platform. We build self-serve systems that allow Data Scientists and Engineers to host open-source LLMs reliably, optimize inference latencies, manage GPU infrastructure, and benchmark model performance safely in production.
The Role
We are looking for an experienced MLOps or ML Platform Engineer who is excited to pivot their deep background in model orchestration, serving, and platform tooling toward solving the unique challenges of LLM inference and infrastructure.
In this role, you will bridge the gap between traditional MLOps (model lifecycles, pipeline orchestration, serving infrastructure) and modern GenAI stack requirements (vLLM, GPU cluster management, intelligent model routing, and automated Evals). You will take end-to-end ownership of setting the technical direction for operating enterprise-grade LLM systems company-wide.
In this role, you will have the opportunity to:
Turn MLOps expertise to GenAI: Transition traditional ML lifecycle and serving patterns into state-of-the-art LLM inference engines and GPU orchestration systems.
Build model-routing architecture: Design low-latency routing frameworks (e.g., LiteLLM integration) to dynamically direct requests across managed cloud providers (AWS Bedrock) and self-hosted open-source models.
Provision & scale GPU infrastructure: Architect and manage high-performance GPU serving environments on Kubernetes using engines like vLLM, Ray, and Triton.
Develop evaluation & benchmarking tooling: Build automated Evals and observability frameworks to empower engineers and data scientists to validate model quality, latency, and drift against production requirements.
Empower self-serve ML across Wealthsimple: Partner with product engineering and data science teams to build framework-agnostic platform tooling that abstracts infrastructure complexity.
Drive cost & performance optimization: Improve price-performance across self-hosted and managed inference by optimizing capacity, utilization, batching, routing, and model selection while meeting quality and reliability objectives
We are looking for people who have:
7+ years of software engineering experience in ML Infrastructure, MLOps, ML Tooling, or Data Platform engineering.
Deep experience in MLOps/ML Platform practices: Proven track record building and operating self-serve ML platforms, model registry workflows, experiment tracking, or production serving infrastructure (Kubeflow, MLflow, Ray, Triton, SageMaker).
Strong platform fundamentals: Advanced proficiency in Python, container orchestration via Kubernetes, infrastructure-as-code (Terraform), and cloud provider ecosystem (AWS).
Strong appetite to specialize in LLM serving: A genuine desire to leverage your existing MLOps skillset to tackle LLM-specific challenges (vLLM, model routing, prompt engineering tooling, vector databases, GPU memory optimization, or LLM evaluation frameworks).
Backend performance & observability focus: Experience designing highly available, observable microservices (e.g., FastAPI) handling real-time, low-latency requests.
End-to-end technical ownership: Proven capability to lead architectural roadmaps, guide multi-functional projects with high autonomy, and maintain complex platform systems for the long run.
Nice-to-haves (or areas you will learn on the job):
Direct experience serving open-source Large Language Models in production (vLLM, SGLang, TensorRT-LLM, Dynamo).
Hands-on work with CUDA, GPU partitioning, or distributed inference frameworks (Ray Serve).
Familiarity with vector search and retrieval engines (Elasticsearch, Qdrant, Pinecone).
Our Stack Includes:
Container & Infrastructure: Kubernetes, Terraform, AWS GPU Infrastructure
ML Serving & LLM Tooling: vLLM, Ray, Triton, LiteLLM, AWS Bedrock, MLflow, SageMaker
Languages & Frameworks: Python, FastAPI, PyTorch
Data & Streaming: Kafka, Postgres, Redshift, Snowflake
Why Wealthsimple?
🌸 Top-tier health benefits and life insurance
📈 Long-term group savings with employer match, through Wealthsimple for Business
🌴 20 vacation days, 4 wellness days, and unlimited sick and mental health days per year*
✈️ 90 days away: work outside Canada for up to 90 days per year*
👥 Employee resource groups, including Rainbow (2SLGBTQ), Women of WS, and Black at WS
🌎 We are a hybrid team with over 1,500 employees across North America. The people are one of the best parts of working here: you'll collaborate with incredibly talented, curious, and driven teammates who are deeply committed to doing great work.
*Unlimited paid sick days, Wellness Days and the 90 day away program do not apply to certain roles.
ICYMI
Technology & Innovation at Wealthsimple: We move quickly and build thoughtfully. That means we're always looking for better ways to work — whether that's new tools, AI, or rethinking how we approach a problem. We don't expect you to have all the answers, but we do expect curiosity and a willingness to evolve alongside the products we're building.
Inclusion Statement: We're building products for a diverse world, and we need a diverse team to do it well. We strongly encourage applications from everyone, regardless of race, religion, colour, national origin, gender, sexual orientation, age, marital status, or disability status.
Accessibility Statement: We're committed to an accessible hiring experience. If you need any accommodations throughout the interview process, please let us know — we'll work with you to make sure you have what you need. We also welcome any feedback on how we can better accommodate candidates with accessibility needs.
AI in Hiring: We may use artificial intelligence (AI) tools to support parts of our hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our team but don't replace human judgment – all final hiring decisions are made by people. If you have questions about how your data is used, reach out to us.
Redirects to Wealthsimple Technologies's application page.
Other roles
More at Wealthsimple Technologies.
Senior Software Developer (Front End), Trading
Senior
Senior Software Developer, Build Platform
Senior
Senior Software Developer, AI Platform
Senior
Senior Software Developer, Post-Trade Management
Senior
Manager, Software Development - Financial Risk
Manager