Software Engineer, Database Systems

Backend Engineer · Senior · Full Time

San FranciscoUSD 230k – 385k12mo ago
Apply for this role

Opens OpenAI's application page

Role

What you'll do.

OpenAI's Database Systems team is seeking a senior software engineer to work on Rockset, their high-performance real-time search, analytics, and vector database that powers vector search and RAG across all OpenAI products. The role involves building distributed systems, performance optimization in C++, and scaling database infrastructure for exponential growth.

Responsibilities

  • Database Engine Development: Design, build, and optimize the core Rockset database engine written in C++
  • Distributed Systems Architecture: Design and implement high-performance distributed database systems at scale
  • Performance Optimization: Identify and resolve performance bottlenecks to scale infrastructure by orders of magnitude
  • Technical Leadership: Define long-term technical direction and guide system evolution for database infrastructure
  • Cross-functional Collaboration: Partner with product, engineering, and research teams to deliver scalable and reliable infrastructure
  • Production Issue Resolution: Debug and resolve complex production issues across the entire database stack
  • System Reliability: Contribute to incident response, postmortems, and establish best practices for system reliability
  • Query Engine Enhancement: Drive improvements across ingestion, query execution, indexing, and storage components
  • Infrastructure Scaling: Scale online database reliability and throughput as usage grows exponentially
  • Vector Search Implementation: Optimize vector search and retrieval augmented generation (RAG) capabilities

Qualifications

What we look for.

Technical

  • Systems Programming

    Strong proficiency in C++ for core database engine development

  • Distributed Systems

    Extensive experience building and scaling distributed systems at enterprise scale

  • Cloud Platforms

    Fluency in AWS, GCP, or Azure cloud environments

  • Infrastructure as Code

    Experience with Terraform or similar IaC tools

  • Container Orchestration

    Production experience with Kubernetes or other orchestration systems

  • Linux Systems

    Deep understanding of Linux systems administration and optimization

  • Observability Stack

    Experience with Prometheus, Grafana, and modern monitoring systems

  • CI/CD Pipeline

    Hands-on experience with continuous integration and deployment pipelines

Education

  • Bachelor's Degree

    Bachelor's degree in Computer Science, Engineering, or related technical field preferred

  • Advanced Degree

    Master's degree in Computer Science or equivalent experience in distributed systems

Experience

  • Industry Experience

    4+ years of relevant software engineering experience in systems programming

  • Technical Leadership

    2+ years leading large-scale, complex projects or teams as engineer or tech lead

  • Distributed Systems

    Proven track record building and scaling distributed systems with focus on performance and reliability

  • Database Internals

    Experience with storage engines, indexing, query processing, or database systems preferred

  • Production Operations

    Experience operating production clusters and handling high-throughput systems

Skills

Required

  • C++ Programming

    Expert-level proficiency in C++ for systems programming and performance optimization

  • Distributed Systems

    Deep understanding of distributed system design patterns, consistency models, and scalability

  • Performance Optimization

    Experience identifying and resolving performance bottlenecks in high-throughput systems

  • System Architecture

    Ability to design scalable, reliable, and maintainable system architectures

  • Cloud Infrastructure

    Hands-on experience with AWS, GCP, or Azure cloud platforms

  • Container Orchestration

    Production experience with Kubernetes and container management

  • Linux Systems

    Strong Linux systems administration and troubleshooting skills

Preferred

  • Database Internals

    Nice to have

    Knowledge of storage engines, indexing algorithms, and query optimization

  • Vector Databases

    Nice to have

    Experience with vector search, embeddings, and similarity algorithms

  • Real-time Systems

    Nice to have

    Understanding of low-latency, real-time data processing requirements

  • Machine Learning Infrastructure

    Nice to have

    Experience supporting ML workloads and model serving infrastructure

  • Go Programming

    Nice to have

    Proficiency in Go for microservices and distributed system components

  • Rust Programming

    Nice to have

    Knowledge of Rust for memory-safe systems programming

  • Stream Processing

    Nice to have

    Experience with Apache Kafka, Apache Flink, or similar streaming platforms

Tech stack

Languages

C++PythonGoRust

Frameworks

gRPCApache KafkaProtocol Buffers

Databases

RocksetVector DatabasesDistributed Storage Systems

Tools

KubernetesTerraformDockerPrometheusGrafanaCI/CD Pipelines

Other

AWSGCPAzureLinux Systems

Compensation

Pay and benefits.

Base·USD 230,000 – 385,000

Equity·Stock options

Benefits

  • Equity Compensation

    Significant equity stake in one of the world's leading AI companies

  • Health Insurance

    Comprehensive medical, dental, and vision insurance coverage

  • Retirement Benefits

    401(k) retirement savings plan with company matching contributions

  • Flexible Time Off

    Unlimited PTO policy for work-life balance and personal well-being

  • Parental Leave

    Generous paid parental leave for new parents

  • Professional Development

    Learning and development budget for conferences, courses, and skill enhancement

  • Remote Work Support

    Home office setup stipend and remote work flexibility

  • Cutting-edge Technology

    Access to latest hardware, software, and AI research tools

  • Innovation Time

    Dedicated time for exploration and innovation projects

  • Mental Health Support

    Mental health resources and counseling services

Process

Interview steps.

  1. 01

    Application Review

    Initial screening of resume, portfolio, and technical background by recruitment team

  2. 02

    Recruiter Phone Screen

    30-minute conversation about background, interest in OpenAI, and role alignment

  3. 03

    Technical Phone Interview

    60-minute technical discussion covering systems design, C++ programming, and distributed systems concepts

  4. 04

    System Design Interview

    90-minute deep-dive into designing large-scale database systems, discussing architecture, scalability, and performance trade-offs

  5. 05

    Coding Interview

    60-minute hands-on coding session focusing on algorithms, data structures, and systems programming in C++

  6. 06

    Behavioral Interview

    45-minute discussion about leadership experience, collaboration, and cultural fit with OpenAI values

  7. 07

    Final Round - Onsite

    Half-day onsite (or virtual) interviews including technical deep-dives, team interactions, and leadership discussions

  8. 08

    Reference Check

    Verification of work history and technical capabilities with former colleagues and managers

Full posting

Original listing.

About the Team:

The Database Systems team specializes in high-performance distributed databases. Our team built Rockset, the real-time search, analytics, and vector database that powers all vector search and retrieval augmented generation (RAG) at OpenAI. In addition to retrieval, as an online database, Rockset powers core functionality across all of OpenAI's product lines and many critical internal use cases.

About the Role:

We are looking for engineers passionate about distributed systems, close-to-the-metal performance optimization (our core engine is written in C++), and building scalable database infrastructure from the ground up. As an engineer on the Database Systems team, you'll contribute to the core database engine, driving improvements across ingestion, query execution, indexing, and storage. You'll partner with teams across OpenAI to unlock new product capabilities and help scale online database reliability and throughput as usage grows by orders of magnitude.

In this role you will:

  • Design, build, and operate high-performance distributed systems

  • Identify and resolve performance bottlenecks to scale infrastructure to the next order of magnitude

  • Define long-term technical direction and guide system evolution

  • Collaborate with product, engineering, and research teams to deliver scalable and reliable infrastructure

  • Dig deep into complex production issues across the stack

  • Contribute to incident response, postmortems, and best practices for system reliability

You might thrive in this role if you:

  • Have significant experience building, scaling, and optimizing distributed systems at scale

  • Are curious about database internals, storage engines, or low-latency query systems

  • Enjoy debugging challenging performance issues in complex, high-throughput systems

  • Have experience operating production clusters at scale (e.g., Kubernetes or other orchestration systems)

  • Think rigorously about scalability, correctness, and reliability

  • Thrive in fast-paced environments with high autonomy and impact

Qualifications:

  • 4+ years of relevant industry experience, with 2+ years leading large scale, complex projects or teams as an engineer or tech lead

  • Experience with distributed systems at scale, with a strong focus on performance, reliability, and scalability

  • Strong communication skills and ability to collaborate across highly technical and cross-functional teams

  • Proficiency in a systems programming language such as C++ (our core engine is written in C++) is strongly preferred

  • Fluency in cloud environments (AWS, GCP, Azure) and IaC tools (Terraform or similar)

  • Experience with Linux systems, CI/CD pipelines, and modern observability stacks (Prometheus, Grafana, etc.)

  • Domain knowledge in areas such as databases, data systems, storage engines, indexing, and query processing is a plus but not required

About OpenAI

OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products. AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity. 

We are an equal opportunity employer, and we do not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other applicable legally protected characteristic.

For additional information, please see OpenAI’s Affirmative Action and Equal Employment Opportunity Policy Statement.

Background checks for applicants will be administered in accordance with applicable law, and qualified applicants with arrest or conviction records will be considered for employment consistent with those laws, including the San Francisco Fair Chance Ordinance, the Los Angeles County Fair Chance Ordinance for Employers, and the California Fair Chance Act, for US-based candidates. For unincorporated Los Angeles County workers: we reasonably believe that criminal history may have a direct, adverse and negative relationship with the following job duties, potentially resulting in the withdrawal of a conditional offer of employment: protect computer hardware entrusted to you from theft, loss or damage; return all computer hardware in your possession (including the data contained therein) upon termination of employment or end of assignment; and maintain the confidentiality of proprietary, confidential, and non-public information. In addition, job duties require access to secure and protected information technology systems and related data security obligations.

To notify OpenAI that you believe this job posting is non-compliant, please submit a report through this form. No response will be provided to inquiries unrelated to job posting compliance.

We are committed to providing reasonable accommodations to applicants with disabilities, and requests can be made via this link.

OpenAI Global Applicant Privacy Policy

At OpenAI, we believe artificial intelligence has the potential to help people solve immense global challenges, and we want the upside of AI to be widely shared. Join us in shaping the future of technology.

Redirects to OpenAI's application page.

Other roles

More at OpenAI.

View all 125 roles