LiteLLM

DevOps Engineer

LiteLLM2 weeks ago
Location

San Francisco

Type

Full Time

Salary

USD 150,000 – 200,000

Level

Mid

Role

DevOps Engineer

Posted

Mar 26, 2026

Full TimeMid

The role

Summary

LiteLLM seeks a skilled DevOps Engineer to lead release infrastructure and security, focusing on creating robust, secure, and consistent release processes for their AI Gateway platform. The ideal candidate will architect and manage CI/CD pipelines, improve release reliability, and support developer workflows with a strong emphasis on infrastructure automation and security.

What you'll do

Release Management: Own secure, regular releases including 2 nightly releases and 1 stable release per week, ensuring consistent and reliable delivery of LiteLLM's software.
Infrastructure Optimization: Manage and improve release infrastructure including Helm, Terraform, CI/CD systems, and developer tooling to maintain high release stability and shipping velocity.
Test Infrastructure: Investigate and resolve test failures, differentiate between true regressions and flaky tests, and improve overall test reliability and coverage.
Security Architecture: Design and implement secure release processes with robust access controls, secrets management, and safe publishing workflows.
Developer Workflow Support: Write Python code to enhance test systems, fix minor issues, and support efficient developer workflows across engineering teams.

What we look for

Technical

ProgrammingProficient in Python with ability to make code changes in test and release systems
Infrastructure ToolsExperienced with Terraform, Helm, CI/CD systems, and cloud infrastructure
Release EngineeringStrong understanding of secure release processes, build automation, and deployment strategies

Education

Degree PreferenceBachelor's degree in Computer Science, Software Engineering, or related technical field preferred

Experience

DevOps Experience2+ years in infrastructure engineering, DevSecOps, release engineering, or related systems work
Test ManagementProven ability to analyze and resolve complex test infrastructure challenges

Skills

Required skills

PythonStrong Python programming skills with ability to develop and modify infrastructure code
CI/CDHands-on experience with continuous integration and deployment pipelines
Cloud InfrastructureProficiency in managing and configuring cloud-based infrastructure

Nice to have

KubernetesExperience with Kubernetes and container orchestration
Security Best PracticesDeep understanding of infrastructure security and compliance frameworks

Compensation & benefits

Salary

USD 150,000 – 200,000 (annual)

Stock options

Available

Benefits

Early Employee Opportunity

Join as an early team member with significant impact potential in a high-growth startup

In-Office Work

Work in San Francisco office with collaborative team environment

Interview process

  1. 1
    Initial Screening — Review of resume and initial qualifications
  2. 2
    Technical Assessment — Evaluation of DevOps and infrastructure engineering skills
  3. 3
    Team Interview — Technical discussions with engineering team members
  4. 4
    Final Interview — Discussion of role fit, company culture, and potential contributions
Apply for this position

You'll be redirected to the company's application page

LiteLLM

LiteLLM

View all jobs

LiteLLM is a platform that provides a unified interface for accessing multiple large language models (LLMs) from different providers. The company offers tools and infrastructure that enable developers and organizations to seamlessly integrate various AI models into their applications while managing costs, performance, and deployment complexity. LiteLLM operates in the artificial intelligence and developer tools market, serving businesses that need flexible access to different language models without being locked into a single provider's ecosystem.

litellm.ai

Tech Stack

Languages
Python
Frameworks
TerraformHelm
Tools
CI/CD SystemsCloud Platforms
Other
Release Automation
Apply Now

On this page