Software Engineer, ChatGPT Infrastructure

Software Engineer · Senior · Full Time

San FranciscoUSD 255k – 405k3mo ago
Apply for this role

Opens OpenAI's application page

Role

What you'll do.

OpenAI is seeking Senior and Staff Software Engineers to build critical infrastructure systems for ChatGPT, focusing on creating high-performance, scalable, and reliable platforms that enable rapid product iteration. The role involves designing core abstractions, developing tooling, and creating infrastructure that supports the complex and dynamic ecosystem of ChatGPT's technology stack.

Responsibilities

  • Infrastructure Platform Development: Build and evolve infrastructure platforms used by multiple engineers and services, creating standardized systems and shared components.
  • Systems Design: Translate complex real-world constraints into clean, simple abstractions with enforceable contracts and safe default behaviors.
  • Performance Optimization: Drive improvements in system reliability and performance through principled design, measurement, and iterative enhancement.
  • Cross-Team Collaboration: Partner with engineering and product teams to identify systemic challenges and develop reusable, scalable solutions.
  • End-to-End Ownership: Manage infrastructure initiatives comprehensively from design through implementation, rollout, and operational maturity.

Qualifications

What we look for.

Technical

  • Distributed Systems

    Extensive experience building and operating large-scale distributed systems with high throughput, concurrency, and robust failure handling capabilities.

  • Systems Design

    Strong fundamentals in systems design, including advanced concepts like caching, consistency, queueing, backpressure, and resilient dependency management.

  • Performance Analysis

    Ability to analyze and optimize performance metrics, including latency distributions, tail behavior, and system bottlenecks.

Education

  • Computer Science

    Bachelor's or Master's degree in Computer Science, Software Engineering, or related technical discipline, or equivalent professional experience.

Experience

  • Infrastructure Development

    Proven track record of building platforms or shared infrastructure that demonstrably improves team velocity and system correctness.

  • Production Engineering

    Hands-on experience in creating production-grade systems with a focus on scalability, reliability, and performance.

Skills

Required

  • Distributed Computing

    Advanced knowledge of distributed system design and implementation techniques

  • Systems Programming

    Expertise in developing robust, scalable infrastructure systems

  • Performance Optimization

    Proven ability to analyze and improve system performance and reliability

Preferred

  • Golden Path Design

    Nice to have

    Experience creating framework libraries and self-serve tooling that shape engineering behavior at scale

  • Reliability Engineering

    Nice to have

    Deep understanding of advanced reliability techniques like circuit breakers, load shedding, and fault isolation

Tech stack

Languages

PythonGo

Frameworks

gRPCKubernetes

Databases

RedisCassandra

Tools

PrometheusGrafana

Other

CI/CD

Compensation

Pay and benefits.

Base·USD 255,000 – 405,000

Equity·Stock options

Benefits

  • Healthcare

    Comprehensive medical, dental, and vision insurance coverage

  • Equity Compensation

    Competitive stock option package with significant upside potential

  • Professional Development

    Ongoing learning opportunities, conference attendance, and skill development programs

  • Flexible Work Arrangement

    Hybrid work model with options for remote and in-office collaboration

  • Advanced Technology Access

    Cutting-edge tools, resources, and research opportunities in AI technology

Process

Interview steps.

  1. 01

    Initial Screening

    HR recruiter call to discuss background, experience, and role alignment

  2. 02

    Technical Phone Screen

    Detailed discussion of systems design experience and technical capabilities with senior engineering team member

  3. 03

    Technical Interviews

    Multiple rounds of in-depth technical interviews covering systems design, coding skills, and infrastructure architecture

  4. 04

    System Design Challenge

    Comprehensive evaluation of candidate's ability to design complex, scalable infrastructure systems

  5. 05

    Final Leadership Interview

    Discussion with senior leadership to assess cultural fit and long-term potential

Full posting

Original listing.

About the Team

ChatGPT is a rapidly evolving system: new capabilities ship continuously, product surfaces change quickly, and usage patterns shift week-to-week. Supporting that pace requires infrastructure that can handle real production constraints—high concurrency, unpredictable traffic patterns, complex dependency graphs, and frequent change.

The ChatGPT Infrastructure team builds and operates the platforms that enable fast iteration without compromising performance or reliability. We design shared systems, data paths, rollout mechanisms, and reliability guardrails that teams rely on to ship changes to ChatGPT at scale.

We focus on high-leverage infrastructure: primitives and “golden paths” that incorporate operational lessons as defaults, so engineers don’t need to rediscover failure modes, latency pitfalls, or integration issues each time they build something new.

About the Role

We’re hiring Senior and Staff Engineers to design and build infrastructure systems that underlie ChatGPT and multiply the effectiveness of teams building user experiences.

This is not a support-only role. It’s a platform-building role: you’ll define interfaces, develop core abstractions, and create tooling to make safe, fast iteration the norm. Your work will reduce friction, prevent regressions, improve performance, and ensure systems scale gracefully as the product grows.

Where You Can Have Impact

  • You might work on one or more of the following areas (without being restricted to any single area):

    • Platform foundations & frameworks: Core libraries, service frameworks, and shared components that standardize system building, integration, and evolution.

    • Scalability & performance primitives: Patterns and infrastructure that reduce tail latency, improve throughput, and keep costs predictable as demand increases.

    • Reliability guardrails: Mechanisms that prevent outages by design—rate limiting, load shedding, dependency isolation, backpressure, safe fallbacks, and robust regression controls.

    • Developer productivity via golden paths: Paved roads for common workflows (data access patterns, service integration, request lifecycle) that are fast, safe, and easy to use.

    • Observability & debugging systems: Instrumentation, metrics models, and investigative tooling that turn vague symptoms (“it’s slow”) into precise, actionable diagnoses.

    • Safe change management: Deployment and rollout systems that support rapid iteration with confidence—progressive delivery, automated verification, and fast rollback strategies.

    • Interface and contract design across boundaries: Clean APIs and stable contracts that reduce coupling and enable independent evolution across a complex ecosystem.

    What You’ll Do

    • Build and evolve infrastructure platforms used by many engineers and services.

    • Translate real-world constraints into clean abstractions: simple APIs, enforceable contracts, safe defaults.

    • Drive improvements in reliability and performance through principled design, measurement, and iterative hardening.

    • Partner with engineering and product teams to identify systemic pain points and develop reusable solutions.

    • Own outcomes end-to-end: design → implementation → rollout → operational maturity.

    Qualifications

    Minimum Qualifications

    • Experience building and operating large-scale distributed systems in production (high throughput, concurrency, and failure handling).

    • Strong fundamentals in systems design, including caching, consistency, queueing/backpressure, and resilient dependency management.

    • Ability to reason about performance (latency distributions, tail behavior, bottlenecks) and translate analysis into concrete engineering work.

    • Track record of building platforms or shared infrastructure that improves velocity and correctness for other teams.

    • Excellent communication and collaboration skills—aligning on interfaces, navigating tradeoffs, and driving cross-team execution.

    Preferred Qualifications

    • Experience designing paved roads / golden paths (frameworks, libraries, self-serve tooling) that shape engineering behavior at scale.

    • Deep understanding of reliability techniques: graceful degradation, circuit breakers, load shedding, rate limiting, and fault isolation.

    • Experience building systems for safe iteration: progressive delivery, correctness checks, automated rollout gates, and production validation.

    • Strong instincts for API and contract design—how to create interfaces that are stable, evolvable, and hard to misuse.

    • Prior work that demonstrates “force multiplier” impact: enabling many teams via a small set of well-crafted primitives.

About OpenAI

OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products. AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity. 

We are an equal opportunity employer, and we do not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other applicable legally protected characteristic.

For additional information, please see OpenAI’s Affirmative Action and Equal Employment Opportunity Policy Statement.

Background checks for applicants will be administered in accordance with applicable law, and qualified applicants with arrest or conviction records will be considered for employment consistent with those laws, including the San Francisco Fair Chance Ordinance, the Los Angeles County Fair Chance Ordinance for Employers, and the California Fair Chance Act, for US-based candidates. For unincorporated Los Angeles County workers: we reasonably believe that criminal history may have a direct, adverse and negative relationship with the following job duties, potentially resulting in the withdrawal of a conditional offer of employment: protect computer hardware entrusted to you from theft, loss or damage; return all computer hardware in your possession (including the data contained therein) upon termination of employment or end of assignment; and maintain the confidentiality of proprietary, confidential, and non-public information. In addition, job duties require access to secure and protected information technology systems and related data security obligations.

To notify OpenAI that you believe this job posting is non-compliant, please submit a report through this form. No response will be provided to inquiries unrelated to job posting compliance.

We are committed to providing reasonable accommodations to applicants with disabilities, and requests can be made via this link.

OpenAI Global Applicant Privacy Policy

At OpenAI, we believe artificial intelligence has the potential to help people solve immense global challenges, and we want the upside of AI to be widely shared. Join us in shaping the future of technology.

Redirects to OpenAI's application page.

Other roles

More at OpenAI.

View all 126 roles