LiteLLM

Engineering Manager

LiteLLMYesterday
Location

San Francisco

Type

Full Time

Salary

USD 200,000 – 250,000

Level

Manager

Role

Engineering Manager

Posted

Jun 12, 2026

Full TimeManager

The role

Summary

LiteLLM is seeking an experienced Engineering Manager to lead stability, engineering productivity, and open-source community growth for their AI gateway platform. The ideal candidate will drive technical excellence, manage team performance, and own critical infrastructure challenges across 100+ provider integrations and emerging AI technologies.

What you'll do

Stability Management: Implement and maintain a comprehensive system for tracking and reducing software regressions, conducting root-cause analysis for each incident
Team Performance: Hold engineers accountable to self-defined metrics, ensure team goal achievement, and drive consistent code patterns across the engineering team
Incident Response: Manage weekly enterprise war rooms, provide customer updates, handle escalations, and develop resolution strategies for critical issues
Team Scaling: Analyze team capacity, define new roles, conduct strategic hiring, and maintain the team's growth trajectory
Open-Source Community: Ensure continued open-source adoption and community engagement while scaling the product and team

What we look for

Technical

Technical LeadershipProven experience in managing engineering teams and driving technical excellence
Incident ManagementDemonstrated ability to reduce incident rates and implement effective root-cause analysis processes

Education

Computer Science DegreeCS/engineering degree or equivalent hands-on engineering background

Experience

Engineering ManagementPrevious experience as an Engineering Manager with a track record of team management and successful product delivery
Startup ExperienceBackground in startup environments, familiarity with complex codebases and technical rewrites

Skills

Required skills

Metrics-Driven ManagementAbility to establish and track engineering productivity and reliability metrics
Incident ResponseExperience in managing enterprise-level technical escalations and war rooms

Nice to have

Open-Source ExperienceBackground in managing or contributing to open-source projects
Startup ScalingExperience in scaling engineering teams at fast-growing technology companies

Compensation & benefits

Salary

USD 200,000 – 250,000 (annual)

Stock options

Available

Benefits

Health Insurance

Comprehensive health, dental, and vision coverage

High-Impact Role

Direct involvement with leading tech companies and open-source community

Career Growth

Director-level scope with direct line to Head of Engineering

Interview process

  1. 1
    Initial Screening — Review of candidate's engineering management experience and technical background
  2. 2
    Technical Interview — Deep dive into incident management, team leadership, and technical problem-solving skills
  3. 3
    Leadership Assessment — Evaluation of management approach, team scaling capabilities, and strategic thinking
  4. 4
    Final Interview — Meeting with founder/CTO to align on vision and role expectations
Apply for this position

You'll be redirected to the company's application page

LiteLLM

LiteLLM

View all jobs

LiteLLM is a platform that provides a unified interface for accessing multiple large language models (LLMs) from different providers. The company offers tools and infrastructure that enable developers and organizations to seamlessly integrate various AI models into their applications while managing costs, performance, and deployment complexity. LiteLLM operates in the artificial intelligence and developer tools market, serving businesses that need flexible access to different language models without being locked into a single provider's ecosystem.

litellm.ai

Tech Stack

Languages
PythonRust
Frameworks
AI Integrations
Tools
Incident Management
Other
Open-Source Infrastructure
Apply Now

On this page