Software Engineer, Implicit Signals

Backend Engineer · Senior · Full Time

San FranciscoUSD 347k – 445k3w ago
Apply for this role

Opens OpenAI's application page

Role

What you'll do.

Join OpenAI's Implicit Signals team to build classification and evaluation systems that power research and post-training capabilities. This role combines software engineering expertise with data engineering to develop scalable services, online/offline pipelines, and tools that help researchers assess model behavior and iterate rapidly. You'll own production systems from architecture through deployment while partnering closely with machine learning engineers and data scientists to deliver reliable, high-performance evaluation infrastructure.

Responsibilities

  • Design and Build Software Services: Architect and develop scalable software services and RESTful APIs for configuring, running, and managing classifiers and evaluations. Focus on clean API design patterns, request validation, error handling, and comprehensive API documentation to support diverse user workflows and integration requirements.
  • Build and Operate Classification Pipelines: Develop and maintain robust online and offline classification pipelines that execute reliably and efficiently at scale. Implement data processing workflows, manage batch and real-time data processing, implement fault tolerance mechanisms, and ensure systems remain operational under production workloads.
  • Optimize Model Serving Performance: Improve inference infrastructure performance across throughput, latency, concurrency, and compute utilization metrics. Implement caching strategies, optimize serialization and deserialization, profile bottlenecks, leverage GPU acceleration, and implement performance monitoring to maintain SLAs.
  • Create Developer Tools and Experimentation Platform: Build intuitive tools and interfaces that simplify experimentation, debugging, and rapid iteration for researchers and data scientists. Develop logging and visualization capabilities, create experiment tracking systems, implement debugging utilities, and reduce time-to-insight for model evaluation workflows.
  • Own Production Reliability and Observability: Take ownership of production system reliability, implement comprehensive observability solutions, and lead incident response efforts. Design monitoring and alerting systems, implement distributed tracing, establish runbooks, reduce operational burden through automation, and drive continuous improvement in system stability.
  • Collaborate with Machine Learning Engineers: Partner with ML engineers to integrate new classification capabilities and models into production systems. Assist with model packaging, containerization, versioning strategies, and deployment processes while ensuring production systems maintain performance and reliability standards.
  • Engage with Post-Training Researchers: Work closely with post-training researchers and data scientists to understand their workflows, pain points, and requirements. Identify high-impact product improvements, shape platform roadmap based on user feedback, and deliver features that accelerate research velocity and model evaluation cycles.

Qualifications

What we look for.

Technical

  • Distributed Systems Design

    Proven experience designing, building, and operating distributed systems and microservices architectures at scale. Understanding of scalability patterns, eventual consistency, data consistency models, and system design tradeoffs in production environments.

  • API Design and Development

    Strong fundamentals in RESTful API design, gRPC, versioning strategies, and request/response handling. Experience with authentication, rate limiting, pagination, error handling, and creating developer-friendly APIs that scale.

  • Concurrency and Performance Engineering

    Deep understanding of concurrent programming patterns, thread management, async/await patterns, and performance optimization. Experience with profiling tools, identifying bottlenecks, implementing caching strategies, and optimizing for throughput and latency.

  • Production Systems and Observability

    Experience operating production systems at scale with comprehensive monitoring, logging, and alerting. Ability to investigate complex production issues, implement distributed tracing, design observability strategies, and manage incident response.

  • Complex Problem Solving

    Ability to investigate complex production problems systematically, understand failure modes, make sound architectural tradeoffs between performance, reliability, and operational complexity, and communicate decisions clearly.

  • End-to-End Software Ownership

    Track record of owning software projects from initial design and architecture through implementation, testing, deployment, and ongoing operation. Experience making critical decisions at all stages of the software lifecycle.

Education

  • Computer Science or Related Field

    Bachelor's degree in Computer Science, Software Engineering, or equivalent practical experience. Strong foundation in algorithms, data structures, system design, and software engineering principles.

Experience

  • Backend and Systems Engineering

    5+ years of professional backend software engineering experience building and operating production systems. Demonstrated ability to design scalable architectures and handle high-traffic, mission-critical services.

  • Production Operations and Incident Management

    Hands-on experience operating production systems, responding to incidents, and improving system reliability. Track record of reducing operational burden through automation and proactive monitoring.

  • Data Engineering and Pipelines

    Experience building data processing pipelines, ETL workflows, or data infrastructure. Understanding of data consistency, batch vs. real-time processing, and data quality assurance.

  • Cross-functional Collaboration

    Experience working directly with technical users, researchers, or product teams to understand requirements and prioritize work. Strong communication skills and ability to translate complex technical problems into actionable solutions.

Skills

Required

  • Python or Go

    Expert-level proficiency in Python for data-heavy applications and rapid prototyping, or Go for high-performance systems and concurrency. Comfortable with performance profiling, debugging, and optimization in your primary language.

  • Distributed Systems Architecture

    Strong understanding of distributed system patterns including service orientation, eventual consistency, message queues, and asynchronous processing. Experience with design tradeoffs and failure scenarios.

  • Database Design and Optimization

    Proficiency with both SQL and NoSQL databases. Experience with query optimization, indexing strategies, schema design, and understanding of when to use different database paradigms.

  • System Design and Scalability

    Demonstrated ability to design systems that scale horizontally, handle high throughput, optimize latency, and maintain reliability under production load. Experience with load balancing, caching, and resource optimization.

  • API and Service Design

    Experience designing and implementing robust APIs with proper error handling, versioning, documentation, and consideration for developer experience at scale.

  • Monitoring and Observability

    Hands-on experience implementing comprehensive monitoring, logging, alerting, and distributed tracing. Ability to design observability solutions that enable rapid incident investigation and resolution.

Preferred

  • Model Serving and ML Systems

    Nice to have

    Experience with model serving platforms, ML inference optimization, or ML platform engineering. Understanding of containerization, model versioning, and deployment strategies for machine learning systems.

  • Data Engineering and Pipelines

    Nice to have

    Experience building robust data pipelines, ETL systems, batch processing workflows, or stream processing systems. Familiarity with Apache Spark, Kafka, Airflow, or similar distributed data tools.

  • Kubernetes and Container Orchestration

    Nice to have

    Experience deploying and managing containerized services on Kubernetes or similar orchestration platforms. Understanding of resource management, service mesh, and cloud-native deployment patterns.

  • AI and Machine Learning Concepts

    Nice to have

    Working knowledge of machine learning concepts, statistical methods, and model evaluation. Familiarity with LLMs, transformers, and modern deep learning approaches. Understanding of how ML systems work end-to-end.

  • Performance Optimization

    Nice to have

    Track record of optimizing complex systems for throughput, latency, and resource efficiency. Experience with profiling tools, identifying bottlenecks, and implementing performance improvements in production systems.

  • Product Thinking

    Nice to have

    Strong product judgment and ability to partner with technical users to understand needs, prioritize features, and shape product direction. Experience with user-focused product development.

Tech stack

Languages

PythonGoTypeScript or JavaScriptSQL

Frameworks

FastAPIDjango or FlaskgRPCTensorFlow Serving or Ray Serve

Databases

PostgreSQLRedisDynamoDB or MongoDBBigQuery or Data Warehouses

Tools

DockerKubernetesGit and Version ControlCI/CD PlatformsPrometheus and GrafanaELK Stack or DataDogJira and Confluence

Other

Message QueuesCloud PlatformsDistributed TracingLoad Testing and Performance AnalysisAI Agents and LLM Tools

Compensation

Pay and benefits.

Base·USD 347,000 – 445,000

Process

Interview steps.

  1. 01

    Initial Screening Call

    Introductory conversation with a recruiter to discuss your background, career goals, and alignment with the role. Share specific examples of complex systems you've built or operated at scale.

  2. 02

    Technical Phone Screen

    Conversation with a senior engineer covering system design principles, your approach to complex architectural problems, and experience with distributed systems. Be prepared to discuss tradeoffs, scalability considerations, and failure recovery strategies.

  3. 03

    System Design Interview

    Deep-dive system design session where you'll architect solutions for large-scale infrastructure challenges similar to the role. Demonstrate your ability to design scalable APIs, optimize performance, and consider reliability at the design stage.

  4. 04

    Coding and Implementation Interview

    Technical assessment of your coding ability, typically involving building a service component, optimizing code for performance, or solving problems requiring strong systems thinking and implementation quality.

  5. 05

    Product and Collaboration Interview

    Conversation with team members who use the platform to discuss your approach to product thinking, user collaboration, and understanding technical requirements. Share examples of how you've partnered with non-engineer users to drive impact.

  6. 06

    ML Systems and Production Operations Interview

    Discussion of your experience with machine learning infrastructure, model serving, and operating complex production systems. Share examples of incident response, reliability improvements, and scaling challenges you've overcome.

  7. 07

    Leadership and Culture Fit Discussion

    Final conversation with engineering leadership about your working style, how you approach ambiguous problems, ownership mentality, and fit with OpenAI's mission-driven culture and AI-forward engineering practices.

Full posting

Original listing.

About the Team

Our team builds classification and evaluation systems that give post-training and research teams fast, reliable feedback on model behavior. We combine machine learning and production engineering to make these capabilities accurate, efficient, and useful at scale, helping researchers assess changes and improve models and products.

We work closely with researchers and data scientists and have broad ownership of the software that makes these capabilities available. Our work spans real-time systems, data engineering, model serving, and tools for experimentation, with careful attention to performance, reliability, and privacy.

About the Role

We’re looking for a software engineer to build and evolve our classification and evaluation platform. You’ll develop services, online and offline pipelines, and tools that help researchers and data scientists turn an idea into a working measurement and iterate on it quickly.

This role combines software and data engineering with hands-on production ownership. You’ll shape the architecture, deliver new capabilities, improve inference efficiency, and keep the system dependable as workloads and requirements evolve. Strong candidates will bring deep software engineering expertise and an interest in building a technical product in close partnership with its users.

In this role, you will:

  • Design and build software services and APIs for configuring, running, and managing classifiers and evaluations.

  • Build and operate online and offline classification pipelines that support reliable, efficient execution at scale.

  • Improve model-serving performance, including throughput, latency, concurrency, and compute utilization.

  • Build tools that make experimentation, debugging, and iteration straightforward for researchers and data scientists.

  • Own production reliability, observability, and incident response, and reduce the operational burden of running the platform.

  • Partner with machine learning engineers to bring new classification capabilities into production.

  • Work closely with post-training researchers and data scientists to understand their workflows, identify high-impact improvements, and shape the product.

You might thrive in this role if you have:

  • Experience designing, building, and operating software services or distributed systems at scale.

  • Strong fundamentals in API design, concurrency, caching, performance, and failure recovery.

  • Ability to investigate complex production problems and make sound architectural tradeoffs.

  • A track record of owning software from initial design through deployment and ongoing operation.

  • Strong product judgment and an interest in working directly with technical users.

  • Comfort with ambiguous problems and broad ownership across multiple parts of a system.

  • Fluency in using AI agents to move quickly across multiple workstreams in a fast-paced environment.

  • Interest in machine learning, data science, and statistics; experience with model serving, ML platforms, or inference optimization is a plus.

About OpenAI

OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products. AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity. 

We are an equal opportunity employer, and we do not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other applicable legally protected characteristic.

For additional information, please see OpenAI’s Affirmative Action and Equal Employment Opportunity Policy Statement.

Background checks for applicants will be administered in accordance with applicable law, and qualified applicants with arrest or conviction records will be considered for employment consistent with those laws, including the San Francisco Fair Chance Ordinance, the Los Angeles County Fair Chance Ordinance for Employers, and the California Fair Chance Act, for US-based candidates. For unincorporated Los Angeles County workers: we reasonably believe that criminal history may have a direct, adverse and negative relationship with the following job duties, potentially resulting in the withdrawal of a conditional offer of employment: protect computer hardware entrusted to you from theft, loss or damage; return all computer hardware in your possession (including the data contained therein) upon termination of employment or end of assignment; and maintain the confidentiality of proprietary, confidential, and non-public information. In addition, job duties require access to secure and protected information technology systems and related data security obligations.

To notify OpenAI that you believe this job posting is non-compliant, please submit a report through this form. No response will be provided to inquiries unrelated to job posting compliance.

We are committed to providing reasonable accommodations to applicants with disabilities, and requests can be made via this link.

OpenAI Global Applicant Privacy Policy

At OpenAI, we believe artificial intelligence has the potential to help people solve immense global challenges, and we want the upside of AI to be widely shared. Join us in shaping the future of technology.

Redirects to OpenAI's application page.

Other roles

More at OpenAI.

View all 127 roles