Applied AI Engineer, Codex Core Agent

Applied AI Engineer · Senior · Full Time

San FranciscoUSD 230k – 325k4mo ago
Apply for this role

Opens OpenAI's application page

Role

What you'll do.

OpenAI is seeking an Applied AI Engineer for the Codex Core Agent team, focusing on transforming cutting-edge AI research into practical, reliable software engineering tools. The ideal candidate will work on improving AI agent performance, developing robust systems, and bridging the gap between research capabilities and real-world usability.

Responsibilities

  • Agent Behavior Design: Design and iterate on AI agent behaviors across complex coding tasks and long-horizon workflows, focusing on improving performance and reliability.
  • Performance Evaluation: Develop and execute comprehensive evaluations to measure agent performance, identify regressions, failure modes, and edge cases using rigorous testing methodologies.
  • System Optimization: Improve AI agent performance through advanced prompting strategies, sophisticated tool-use techniques, context construction, and model-facing experimentation.
  • Robustness Analysis: Systematically analyze and improve production failures, enhancing the overall robustness and reliability of AI agents in real-world scenarios.
  • Feedback System Development: Build sophisticated feedback loops and data systems to integrate real-task data into evaluation and research processes.
  • User Experience Collaboration: Work closely with product teams to define and shape user-facing AI agent experiences and critical interface dependencies.

Qualifications

What we look for.

Technical

  • Programming Proficiency

    Advanced Python programming skills with strong understanding of modern machine learning tooling and frameworks

  • Machine Learning Expertise

    Demonstrated experience in machine learning model evaluation, fine-tuning, and prompt design

  • AI Systems Understanding

    Deep comprehension of large language models (LLMs) and AI agent architectures

Education

  • Advanced Degree

    Master's or PhD in Computer Science, Machine Learning, Artificial Intelligence, or related technical field preferred

Experience

  • Product Development

    Proven experience building or shipping machine learning or LLM-powered products

  • Production AI Systems

    Demonstrated ability to transform research capabilities into production-ready AI systems

Skills

Required

  • Python

    Advanced Python programming for AI and machine learning applications

  • Machine Learning Tooling

    Proficiency with modern machine learning development and evaluation tools

  • Model Evaluation

    Experience in comprehensive AI model performance assessment and improvement

Preferred

  • Agent Frameworks

    Nice to have

    Experience with advanced AI agent frameworks and tool-using LLM systems

  • Code Generation

    Nice to have

    Research background in code generation models or developer tooling

  • Data Management

    Nice to have

    Experience working with large, complex datasets and production logs

Tech stack

Languages

Python

Frameworks

Machine Learning Frameworks

Databases

Large-Scale Data Systems

Tools

AI Evaluation Tools

Other

LLM Infrastructure

Compensation

Pay and benefits.

Base·USD 230,000 – 325,000

Equity·Stock options

Benefits

  • Equity Compensation

    Stock options offering potential additional financial upside

  • Innovative Work Environment

    Opportunity to work at the forefront of AI technology and research

  • Mission-Driven Organization

    Work with a company dedicated to ensuring AI benefits humanity

Process

Interview steps.

  1. 01

    Initial Screening

    Technical resume review and initial phone/video screening

  2. 02

    Technical Assessment

    Comprehensive technical interview focusing on AI engineering skills and problem-solving

  3. 03

    On-Site Interviews

    Multiple in-depth interviews with AI research, engineering, and product teams

  4. 04

    Final Interview

    Discussion with senior leadership about role alignment and company vision

Full posting

Original listing.

About the Team
The Codex Core Agent team builds the kernel of Codex. We own making the agent better, accelerating research, and making those improvements real in production for our users.

That means working across the systems that make Codex actually function as an agent in the real world: the production performance envelope around tokens, latency, reliability, cost, and capacity; the core execution loop and interfaces that turn models into useful behavior; the shared infrastructure that enables other teams to build on Codex; and the feedback loops that turn real-world usage into better models and better agent behavior over time.

About the Role
We’re looking for applied AI engineers to help bring Codex agents from impressive demos to dependable tools. This role is about improving agent performance on real software engineering tasks and closing the gap between research capability and real-world usefulness.

You’ll work closely with research, infrastructure, and product to ensure agents are not just powerful, but useful, steerable, and reliable in practice. The job is not only to improve model behavior in isolation, but to turn those improvements into measurable gains in solve rate, usefulness, and economic value for users.

What You’ll Do

  • Design and iterate on agent behaviors across real-world coding tasks and long-horizon workflows.

  • Work closely with research to develop and run evals to measure agent performance, regressions, failure modes, and edge cases.

  • Improve performance through prompting, tool-use strategies, context construction, and model-facing experimentation.

  • Analyze failures in production and systematically improve robustness and reliability.

  • Build feedback loops and data systems that get better real-task data into evaluation and research.

  • Work with product teams to shape user-facing agent experiences and the interfaces the agent depends on.

  • Help define what “good” looks like for agents completing complex tasks end-to-end.

You Might Be a Good Fit If You

  • Have experience building or shipping machine learning or LLM-powered products.

  • Are strong in Python and comfortable with modern ML tooling.

  • Have worked on model evaluation, fine-tuning, or prompt design.

  • Think in terms of systems and user outcomes, not just model metrics.

  • Enjoy debugging messy, real-world failures and turning them into improvements.

  • Want to work in the layer that turns research and model potential into systems that actually work for users.

Bonus Points

  • Experience with agent frameworks or tool-using LLM systems.

  • Research experiencewith code generation models or developer tooling.

  • Experience working with large, messy datasets or production logs.

About OpenAI

OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products. AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity. 

We are an equal opportunity employer, and we do not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other applicable legally protected characteristic.

For additional information, please see OpenAI’s Affirmative Action and Equal Employment Opportunity Policy Statement.

Background checks for applicants will be administered in accordance with applicable law, and qualified applicants with arrest or conviction records will be considered for employment consistent with those laws, including the San Francisco Fair Chance Ordinance, the Los Angeles County Fair Chance Ordinance for Employers, and the California Fair Chance Act, for US-based candidates. For unincorporated Los Angeles County workers: we reasonably believe that criminal history may have a direct, adverse and negative relationship with the following job duties, potentially resulting in the withdrawal of a conditional offer of employment: protect computer hardware entrusted to you from theft, loss or damage; return all computer hardware in your possession (including the data contained therein) upon termination of employment or end of assignment; and maintain the confidentiality of proprietary, confidential, and non-public information. In addition, job duties require access to secure and protected information technology systems and related data security obligations.

To notify OpenAI that you believe this job posting is non-compliant, please submit a report through this form. No response will be provided to inquiries unrelated to job posting compliance.

We are committed to providing reasonable accommodations to applicants with disabilities, and requests can be made via this link.

OpenAI Global Applicant Privacy Policy

At OpenAI, we believe artificial intelligence has the potential to help people solve immense global challenges, and we want the upside of AI to be widely shared. Join us in shaping the future of technology.

Redirects to OpenAI's application page.

Other roles

More at OpenAI.

View all 102 roles