LiteLLM

Forward Deployed Engineer

LiteLLM4 weeks ago
Location

San Francisco

Type

Full Time

Salary

USD 170,000 – 220,000

Level

Senior

Role

Forward Deployed Engineer

Posted

Mar 4, 2026

Full TimeSenior

The role

Summary

LiteLLM is seeking a Forward Deployed Engineer to support key customers in deploying and scaling their AI Gateway platform. The ideal candidate will work remotely with enterprise clients, troubleshooting complex technical challenges, optimizing infrastructure, and driving successful LLM integration across diverse technical environments.

What you'll do

Customer Deployment: Deploy and configure LiteLLM in complex customer environments, ensuring optimal performance and reliability across diverse technical infrastructures
Technical Troubleshooting: Diagnose and resolve full-stack technical issues, from infrastructure and backend to frontend integrations, using advanced debugging techniques
Customer Engagement: Work remotely with customers during critical implementations, migrations, and scaling initiatives, maintaining high-touch technical support
Issue Reproduction and Reporting: Create detailed technical reports by reproducing customer issues in their specific environments and providing comprehensive documentation
Custom Solutions Development: Build custom integrations, scripts, and tooling to meet unique customer requirements and enhance platform flexibility
Product Improvement: Act as the technical voice of customers by gathering feedback, identifying improvement patterns, and advocating for product enhancements

What we look for

Technical

Programming SkillsAdvanced proficiency in Python, with strong understanding of AI infrastructure and LLM integrations
System ArchitectureDeep knowledge of distributed systems, cloud infrastructure, and scalable software deployment
Debugging ExpertiseAdvanced troubleshooting skills across multiple technical environments and complex integration scenarios

Education

DegreeBachelor's or Master's degree in Computer Science, Software Engineering, or related technical field

Experience

Customer EngineeringMinimum 3-5 years of experience in customer-facing technical roles, preferably in AI, cloud, or developer tools
Production DeploymentProven track record of successfully deploying and scaling enterprise-grade software solutions

Skills

Required skills

PythonAdvanced programming skills with extensive Python development experience
API IntegrationExpertise in designing, implementing, and troubleshooting complex API integrations
Cloud PlatformsHands-on experience with major cloud providers like AWS, Azure, or Google Cloud

Nice to have

AI/ML KnowledgeUnderstanding of Large Language Models, AI infrastructure, and machine learning deployment patterns
Open Source ContributionExperience contributing to or managing open-source projects, preferably in developer tooling

Compensation & benefits

Salary

USD 170,000 – 220,000 (annual)

Stock options

Available

Benefits

High-Impact Role

Opportunity to work at the cutting edge of AI infrastructure with a rapidly growing startup

Technical Autonomy

High degree of independence and variety in working across multiple customer environments

Career Growth

Direct exposure to enterprise-level AI challenges and emerging technology trends

Interview process

  1. 1
    Intro Call — Initial 30-minute screening to discuss background, experience, and role alignment
  2. 2
    Take-Home Exercise — Hands-on technical assessment involving real customer tickets to evaluate troubleshooting skills and LiteLLM platform understanding
  3. 3
    3-Day Onsite — Collaborative in-person evaluation to assess real-time customer support capabilities and team fit
Apply for this position

You'll be redirected to the company's application page

LiteLLM

LiteLLM

View all jobs

LiteLLM is a platform that provides a unified interface for accessing multiple large language models (LLMs) from different providers. The company offers tools and infrastructure that enable developers and organizations to seamlessly integrate various AI models into their applications while managing costs, performance, and deployment complexity. LiteLLM operates in the artificial intelligence and developer tools market, serving businesses that need flexible access to different language models without being locked into a single provider's ecosystem.

litellm.ai

Tech Stack

Languages
Python
Frameworks
OpenAI Format
Tools
Cloud Platforms
Other
LLM Providers
Apply Now

On this page