Tennr

ML Ops Engineer

Tennr1 months ago
Location

New York City Office

Type

Full Time

Salary

USD 190,000 – 230,000

Level

Senior

Role

ML Ops Engineer

Posted

Feb 12, 2026

Full TimeSenior

The role

Summary

Tennr is seeking a pioneering ML Ops Engineer to build and scale machine learning infrastructure for their AI-driven healthcare platform. The ideal candidate will architect robust ML systems, develop scalable pipelines, and drive innovative solutions that transform referral processing and medical service efficiency.

What you'll do

ML Infrastructure Architecture: Design and implement scalable machine learning software systems for model deployment and management at enterprise scale
Pipeline Development: Develop and maintain comprehensive infrastructure supporting efficient ML operations, including data pipelines, model evaluations, deployments, and large-scale training
Cross-Functional Collaboration: Work closely with ML engineers, software engineers, and cross-functional teams to ensure seamless model integration with data pipelines and product ecosystems
System Optimization: Troubleshoot production issues, continuously improve systems, and enhance overall performance and operational efficiency
Evaluation Tooling: Create sophisticated tooling for comprehensive online and offline evaluation of machine learning and large language model systems

What we look for

Technical

Programming LanguagesAdvanced proficiency in Python and TypeScript with strong software engineering fundamentals
ML InfrastructureExpertise in designing highly available ML systems for inference, evaluation, and experimental use cases
ObservabilityComprehensive knowledge of logging, metrics, tracing, model performance monitoring, and advanced alerting mechanisms

Education

Computer Science/EngineeringBachelor's or Master's degree in Computer Science, Machine Learning, Software Engineering, or related technical discipline

Experience

Production Experience5+ years of hands-on experience in ML model deployment, infrastructure scaling, and production environment management
Distributed SystemsProven experience with distributed systems, reliability engineering, and production incident response

Skills

Required skills

ML OperationsAdvanced skills in machine learning infrastructure, model deployment, and scalable system design
System ArchitectureExpertise in designing robust, high-performance machine learning systems

Nice to have

ML FrameworksExperience with PyTorch, TensorFlow, and other machine learning frameworks
Inference OptimizationKnowledge of inference frameworks like vLLM, TensorRT, and Triton
GPU ManagementExperience with GPU orchestration, workload scheduling, and optimization techniques

Compensation & benefits

Salary

USD 190,000 – 230,000 (annual)

Stock options

Available

Benefits

Health Insurance

100% paid employee health benefit options

Retirement Planning

Employer-funded 401(k) match

Paid Time Off

Unlimited PTO with flexible work arrangements

Parental Support

Competitive parental leave policy

Interview process

  1. 1
    Initial Screening — Technical resume review and initial phone/video screening with recruiting team
  2. 2
    Technical Assessment — Comprehensive technical assessment focusing on ML infrastructure design and system architecture skills
  3. 3
    Technical Interviews — Multiple rounds of in-depth technical interviews with ML Ops and engineering leadership
  4. 4
    Systems Design Challenge — Advanced systems design presentation demonstrating candidate's ML infrastructure expertise
  5. 5
    Final Interview — Culture fit and leadership interview with company executives
Apply for this position

You'll be redirected to the company's application page

Tennr

Tennr

View all jobs

Tennr is an artificial intelligence company specializing in automating document processing for businesses. They provide an AI-powered platform that extracts, validates, and routes critical data from unstructured documents such as faxes, PDFs, and emails. Their mission is to eliminate manual data entry and processing, allowing companies in sectors like healthcare, finance, and logistics to operate more efficiently. By transforming complex, manual workflows into streamlined, automated processes, Tennr helps organizations save time and reduce errors.

San Francisco, USAFounded 2022tennr.com

Tech Stack

Languages
PythonTypeScript
Frameworks
PyTorchTensorFlow
Tools
TritonCUDA
Other
vLLM
Apply Now

On this page