Engineering Manager, Evals

Cursor1 weeks ago

Location

San Francisco

Type

Full Time

Salary

USD 250,000 – 350,000

Level

Manager

Role

Engineering Manager

Posted

Jun 3, 2026

Full TimeManager

The role

Summary

Cursor is seeking an Engineering Manager for their Evals team to lead critical evaluation systems that measure and improve AI coding agent quality. The ideal candidate will drive the development of comprehensive evaluation tools, align cross-functional teams, and build robust metrics that enhance product development and model training processes.

What you'll do

Eval Strategy: Set comprehensive evaluation roadmap defining measurement criteria, strategic importance, and how evaluation signals drive product and training decisions

Team Leadership: Lead and develop a high-impact team of engineers and researchers focused on creating evaluation datasets and developer-friendly tools

CursorBench Development: Guide the evolution of CursorBench to accurately reflect real developer workflows and expand evaluation capabilities

Quality Metrics: Define precise online quality signals and transform potential regressions into robust performance guardrails

Integration Management: Integrate evaluation processes into decision-making workflows for product launches, deployments, and model training cycles

What we look for

Technical

Evaluation SystemsProven experience building and operating evaluation or measurement systems (AI evaluations, experimentation platforms, relevance metrics)

Data AnalysisStrong data acumen with ability to collaborate effectively with data scientists and researchers

AI/ML TrendsDeep understanding of emerging AI research and industry trends in model and agent behavior

Education

Advanced DegreeBachelor's or Master's degree in Computer Science, Software Engineering, or related technical field preferred

Experience

Engineering LeadershipExtensive experience leading engineering teams that ship complex production systems

Cross-Functional AlignmentProven ability to align research, product, data, and infrastructure teams around quality metrics and processes

Skills

Required skills

People LeadershipStrong people management, coaching, and team development skills

Strategic PlanningAbility to develop and execute comprehensive technical strategies

Nice to have

AI ResearchBackground or deep interest in AI/ML research and emerging technology trends

Measurement FrameworksExperience designing robust evaluation and measurement frameworks

Compensation & benefits

Salary

USD 250,000 – 350,000 (annual)

Stock options

Available

Benefits

Competitive Compensation

Highly competitive salary package for top engineering talent

Equity Options

Startup equity package to share in long-term company growth

Professional Development

Opportunities for continuous learning and cutting-edge AI research exposure

Innovative Work Environment

Flat organizational structure with emphasis on creativity and impactful work

Interview process

1
Initial Screening — HR phone screen to assess basic qualifications and cultural fit
2
Technical Leadership Interview — In-depth discussion of engineering management experience and leadership philosophy
3
AI/ML Technical Interview — Deep dive into candidate's understanding of AI evaluation methodologies and research trends
4
Team Fit Interview — Meeting with potential team members to assess collaborative potential
5
Final Executive Interview — Conversation with senior leadership to align on strategic vision and leadership approach