Forward Deployed Engineer - ML

ML Engineer · Senior · Full Time

New YorkUSD 180k – 250k5mo ago
Apply for this role

Opens Modal's application page

Role

What you'll do.

Modal is seeking a Forward Deployed ML Engineer to work directly with cutting-edge AI companies, optimizing production AI workloads and helping customers achieve breakthrough performance on complex machine learning infrastructure challenges. The ideal candidate will combine deep technical expertise in ML engineering with exceptional customer-facing communication skills.

Responsibilities

  • Customer Engagement: Work hands-on with leading AI companies like Suno, Lovable, Cognition, and Meta to architect and optimize production AI workloads on Modal's infrastructure
  • Technical Demonstrations: Conduct technical demos, experiments, and proof-of-concepts to showcase Modal's performance advantages and technical capabilities
  • Open Source Contribution: Contribute to open-source projects and publish technical content demonstrating Modal's capabilities across the AI stack
  • Cross-Functional Collaboration: Collaborate with Modal's product and sales teams, providing engineering insights and product stakeholder perspectives
  • Technical Leadership Relationships: Build trusted relationships with technical leaders such as CTOs, VPs of Engineering, and ML leads at frontier AI companies

Qualifications

What we look for.

Technical

  • ML Engineering Experience

    Minimum 2+ years of professional ML engineering experience with hands-on work in inference optimization, model training, GPU programming, or ML infrastructure

  • ML Toolchain Expertise

    Deep familiarity with serving (e.g., vLLM, SGLang) and training (e.g., slime, verl, TRL) toolchains, with expertise in at least one domain

Education

  • Advanced Technical Degree

    Bachelor's or Master's degree in Computer Science, Machine Learning, Software Engineering, or related technical field preferred

Experience

  • AI Infrastructure

    Proven track record of working with complex ML infrastructure and deployment scenarios

  • Customer Facing Experience

    Demonstrated ability to communicate complex technical concepts to both technical and non-technical stakeholders

Skills

Required

  • Machine Learning

    Strong understanding of ML model training, inference, and optimization techniques

  • GPU Programming

    Experience with GPU-accelerated computing and optimization

  • Technical Communication

    Ability to articulate complex technical architectures and tradeoffs clearly

Preferred

  • Open Source Contributions

    Nice to have

    Active contributions to ML or systems performance open-source projects

  • Research Background

    Nice to have

    Published work or academic research in machine learning or related fields

Tech stack

Languages

Python

Frameworks

PyTorchTensorFlow

Databases

No-SQL Databases

Tools

vLLMSGLang

Other

GPU Computing

Compensation

Pay and benefits.

Base·USD 180,000 – 250,000

Benefits

  • Startup Equity

    Opportunity to receive equity in a high-growth AI infrastructure company valued at $1.1B

  • Professional Growth

    Work with world-class engineers, computational scientists, and former founders at the forefront of AI technology

  • Cutting-Edge Technology

    Exposure to advanced AI infrastructure and opportunity to work with leading AI companies

Process

Interview steps.

  1. 01

    Initial Screening

    Technical resume review and initial recruiter conversation

  2. 02

    Technical Phone Screen

    Detailed discussion of ML engineering experience and technical capabilities

  3. 03

    Technical Interview

    In-depth technical interview focusing on ML infrastructure, system design, and problem-solving skills

  4. 04

    Customer Engagement Assessment

    Scenario-based interview to evaluate customer interaction and communication skills

  5. 05

    Final Leadership Interview

    Discussion with senior technical leadership to assess cultural fit and strategic alignment

Full posting

Original listing.

About Us:

Modal provides the infrastructure foundation for AI teams. With instant GPU access, sub-second container startups, and native storage, Modal makes it simple to train models, run batch jobs, and serve low-latency inference. We have thousands of customers who rely on us for production AI workloads, including Lovable, Scale AI, Substack, and Suno.

We're a fast-growing team based out of NYC, SF, and Stockholm. We've hit 9-figure ARR and recently raised a Series B at a $1.1B valuation. Our investors include Lux Capital, Redpoint Ventures, Amplify Partners, and Elad Gil.

Working at Modal means joining one of the fastest-growing AI infrastructure organizations at an early stage, with many opportunities to grow within the company. Our team includes creators of popular open-source projects (e.g. Seaborn, Luigi), academic researchers, international olympiad medalists, and experienced engineering and product leaders with decades of experience.

The Role:

We're looking for Forward Deployed ML Engineers who want to work at the intersection of deep technical work and direct customer impact. As an ML FDE, you'll partner with leading AI companies and foundation model labs to help them achieve state-of-the-art performance on their most demanding workloads — LLM serving, model training (SFT, RLHF), audio pipelines, scientific computing, and more. You're helping teams reach outcomes most engineers can't on their own.

The FDE team today includes world-class software engineers, computational scientists, ML engineers, and former founders. We're looking for people with strong engineering fundamentals, deep curiosity across the AI stack, and energy for working directly with customers on hard problems. You will:

  • Work hands-on with companies like Suno, Lovable, Cognition, and Meta to architect and optimize production AI workloads on Modal

  • Contribute to open-source projects — members of the team are active contributors to SGLang — and publish technical content that demonstrates Modal's capabilities across the AI stack

  • Collaborate with Modal's product and sales teams, contributing to the platform as both an engineer and a product stakeholder

  • Build trusted relationships with technical leaders (CTOs, VPs of Engineering, ML leads) at companies doing frontier AI work

  • Conduct technical demos, experiments, and proof-of-concepts that make Modal's performance advantages tangible

Requirements:

  • 2+ years of professional ML engineering experience, ideally with hands-on work in inference optimization, model training, GPU programming, or ML infrastructure

  • Familiarity with the serving (e.g., vLLM, SGLang) and training (e.g., slime, verl, TRL) toolchains. You don't need all of these, but you should be able to go deep on at least one.

  • Strong communicator who can go deep on technical architecture with an engineering team and clearly articulate tradeoffs to technical leadership

  • Genuine interest in working directly with customers — you find it energizing to understand someone else's problem and help them solve it

  • Bonus: side projects, open-source contributions, or published work you're proud of in ML or systems performance

  • Willing to work in-person in New York City, San Francisco, or Stockholm

Redirects to Modal's application page.

Other roles

More at Modal.

View all 10 roles
Forward Deployed Engineer - ML @Modal | Scale Engineer