Staff Software Engineer, AI Developer Tools

Staff Engineer · Staff · Full Time · Remote

San Francisco, CA · RemoteUSD 170k – 276k1w ago
Apply for this role

Opens Docker's application page

Role

What you'll do.

Staff Software Engineer role at Docker focused on AI Developer Tools, responsible for setting technical direction for AI-powered developer tools and building a self-service platform for teams to prototype, deploy, and scale their own AI tools. This position requires 8+ years of software engineering experience with demonstrated expertise in production LLM systems, distributed platform architecture, and technical leadership at scale. You will work at the intersection of AI, developer experience, and platform engineering, mentoring senior engineers while driving innovation in how developers build, share, and run containerized applications with AI-native workflows.

Responsibilities

  • Technical Direction and Architecture Leadership: Set technical direction and own the architecture for AI-powered developer tools and self-service platform within the team's roadmap. Turn ambiguous problems into clear requirements and staged decisions by asking about scale, users, and constraints before designing. Establish patterns, standards, and best practices for LLM integration, agent development, and production AI systems that the team and partner teams adopt across Docker's organization.
  • Platform Capability Development: Shape platform capabilities including deployment frameworks (ArgoCD/GitOps), observability integration (Grafana), security controls, and operational tooling for AI developer tools. Design reliable, scalable infrastructure for hosting AI agents and developer tools while recommending AI technology choices, LLM provider strategies, and agent orchestration approaches with explicit trade-off analysis.
  • Production AI Systems Design and Implementation: Design, build, and operate production AI agents for developer productivity including code review assistants, test generators, deployment diagnostics, and incident response automation. Build self-service platform capabilities that reduce time-to-production for new AI tools from weeks to days while accelerating adoption of AI-native development tools across Docker's engineering organization.
  • Reliability and Systems Operations: Set and meet reliability, security, and performance standards for AI systems including SLOs, monitoring, incident response, and cost management. Design integrations between AI developer tools and existing developer infrastructure such as CI/CD pipelines, observability platforms, and deployment systems. Participate in the team's on-call rotation and use operational insights to improve alerts, runbooks, and tooling.
  • Strategic Innovation and Technology Evaluation: Evaluate emerging AI/LLM technologies, developer tooling trends, and agent frameworks to recommend what Docker should adopt and what it should build internally. Define how the team measures AI tool effectiveness including adoption metrics, productivity gains, and developer satisfaction. Improve AI tool performance, cost efficiency, and developer experience through architectural improvements and lead cross-team technical delivery.
  • Mentorship and Engineering Culture: Mentor senior engineers on AI/LLM integration patterns, agent development, and platform engineering practices. Lead design reviews and raise the quality of design and code reviews across the team. Create reusable patterns, documentation, and architectural decision records (ADRs) that other engineers build upon, helping turn good individual AI-assisted engineering practice into shared workflows and controls.
  • Cross-functional Leadership: Lead complex initiatives that cross team boundaries by influencing without direct authority. Work closely with the Senior Manager, Principal engineers, engineering leadership, product engineering teams, and platform teams across Docker. Align technical decisions with business goals while surfacing risks early and working with Infrastructure, Security, and Data teams on shared standards.

Qualifications

What we look for.

Technical

  • Production LLM and AI Agent Development

    Hands-on production experience building LLM-powered applications, AI agents, or AI-assisted developer tools with demonstrated impact. Strong understanding of LLM APIs (OpenAI, Anthropic, others), prompt engineering, agent orchestration frameworks, and practical applications of AI in software development workflows.

  • Distributed Systems and Platform Architecture

    Track record of designing and building scalable distributed systems and developer-facing platforms. Production experience with cloud-native infrastructure including Kubernetes, GitOps deployment patterns, observability systems, and CI/CD pipelines.

  • Programming Language Proficiency

    Proficiency in Go (preferred), Rust, Java, or Python with strong software engineering fundamentals. Ability to architect systems and lead technical decisions across multiple programming paradigms.

  • Developer Tools and Platform Systems

    Experience designing developer tools, platform systems, or internal tools that other teams rely on. Understanding of what makes developer tools excellent including productivity impact, user experience, and adoption patterns.

  • Infrastructure and Operations

    Production experience with cloud-native infrastructure, container orchestration, CI/CD pipeline design, GitOps patterns, and observability systems. Familiarity with deployment frameworks and operational best practices for production systems at scale.

Education

  • Bachelor's Degree in Computer Science or Engineering

    Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent practical experience demonstrating deep software engineering expertise and system design capability.

Experience

  • Technical Leadership at Scale

    8+ years of software engineering experience with demonstrated technical leadership on production systems at scale. Track record of leading complex initiatives that crossed team boundaries and influencing without direct authority.

  • Requirements and Constraint Analysis

    Track record of clarifying requirements and constraints with stakeholders before committing to a design. Ability to ask probing questions about scale, users, and constraints rather than making assumptions.

  • Mentoring Senior Engineers

    Track record of mentoring other experienced engineers and helping them grow. Ability to improve the engineers around you through influence, knowledge sharing, and design leadership.

  • Iterative Delivery in Ambiguous Environments

    Ownership mentality with a bias for action and iterative delivery in ambiguous, fast-moving environments. Ability to balance technical quality with shipping iteratively and making progress in uncertain contexts.

Skills

Required

  • LLM APIs and Agent Orchestration

    Expertise with LLM APIs from OpenAI, Anthropic, and other providers. Knowledge of agent orchestration frameworks, prompt engineering techniques, and practical integration patterns for production systems.

  • Kubernetes and Cloud-Native Architecture

    Production experience designing and operating systems on Kubernetes with understanding of containerization, service mesh considerations, and distributed system patterns.

  • Systems Design and Technical Architecture

    Ability to design scalable, reliable systems with clear trade-off analysis. Skill in documenting architecture decisions, identifying failure modes, and building for operational excellence.

  • Platform Engineering and Developer Experience

    Understanding of platform abstraction patterns, self-service infrastructure design, and how to measure and improve developer productivity and experience metrics.

  • Go, Rust, Java, or Python

    Deep proficiency in at least one of these languages with strong fundamentals in software design, testing, and production systems engineering.

  • Remote and Async Communication

    Clear written and spoken communication suited to a remote, async-first company. Ability to articulate complex technical concepts and influence across distributed teams.

Preferred

  • Model Context Protocol (MCP) or AI Agent Standards

    Nice to have

    Experience with MCP or similar AI agent integration standards and emerging protocols for AI tool interoperability.

  • Developer Productivity and DevOps Background

    Nice to have

    Background in developer productivity, DevOps, SRE, or platform engineering with deep understanding of how to accelerate engineering velocity.

  • Open Source Contributions

    Nice to have

    Contributions to open source AI tools, developer tooling, or platform engineering projects demonstrating thought leadership and community engagement.

  • Internal Platform Evolution

    Nice to have

    Experience evolving an internal platform or tool into a widely adopted, production-grade service used across multiple teams or the broader engineering organization.

  • AI Security and Compliance

    Nice to have

    Knowledge of security, compliance, and operational practices for production AI systems including model governance, cost controls, and audit requirements.

  • Infrastructure-as-Code and Cloud Platforms

    Nice to have

    Experience with infrastructure-as-code tools like Terraform or Pulumi and major cloud platforms including AWS, GCP, or Azure.

Tech stack

Languages

GoPythonRustJava

Frameworks

Agent Orchestration FrameworksLLM Libraries and SDKsKubernetes and Container OrchestrationArgoCD and GitOps

Databases

PostgreSQLRedisCloud Data Services

Tools

GrafanaTerraformCI/CD PlatformsDockerGit and Version Control

Other

Model Context Protocol (MCP)OpenAI APIAnthropic Claude APICloud Platforms (AWS, GCP, Azure)Observability and MonitoringOn-Call Operations and Incident Response

Compensation

Pay and benefits.

Base·USD 170,350 – 275,550

Equity·Stock options

Benefits

  • Remote-First Work Environment

    Work from your home or desired location globally with offices in Seattle and Paris available for optional in-person collaboration and connection. Full flexibility to manage your schedule while maintaining delivery excellence in a distributed, async-first culture.

  • Generous Time Off and Recharge Programs

    Comprehensive paid time off policy with designated quarterly Whaleness Days for rest and recharge, plus a designated end-of-year Whaleness break to disconnect and return refreshed.

  • Home Office and Technology Support

    Home office setup support to create a comfortable, productive workspace plus a technology stipend of USD $100 net per month to support your work environment and equipment needs.

  • Learning and Professional Development

    Annual stipend for conferences, courses, certifications, and continued learning. Access to professional development resources to grow your expertise in AI systems, platform engineering, and software architecture.

  • Equity Ownership

    Equity for all full-time employees allowing you to share in Docker's long-term success and growth as a leader in developer tooling and containerization technology.

  • Comprehensive Benefits Package

    Medical, dental, vision, and retirement benefits with specifics varying by country. Competitive benefits supporting your health and financial security.

  • Parental Leave

    16 weeks of paid parental leave after six months of employment to support work-life balance during major life events.

  • Company Culture and Community

    Access to Docker swag and inclusive community events. Opportunity to work with 20 million monthly users and be part of shaping how developers build and deploy applications globally.

Full posting

Original listing.

About Docker

Docker has been one of the most loved brands in developer tooling, trusted by more than 20 million monthly users and over 20 billion container image pulls. From solo founders to the world's largest companies, developers rely on Docker to build, share, and run their applications across our suite of products including Docker Desktop, Docker Hub, and Docker Scout.

We are a globally distributed, remote-first team building the tools that define how software gets built and delivered. As AI agents redefine software development, Docker is at the center of that shift, providing the sandboxed environments, verified images, and secure infrastructure that make autonomous workflows trustworthy by default.

_______________________________________________________________________

Docker is looking for a Staff Software Engineer to set the technical direction for key parts of our AI Developer Tools team. You will work at the intersection of AI, developer experience, and platform engineering, building the AI-powered tools and the platform that let teams across Docker prototype, deploy, and scale their own AI developer tools.

As a Staff Engineer you will own the technical design and delivery for two areas:

AI-Powered Developer Tools. Design and build AI agents and tools that accelerate developer productivity, surface observability insights, and automate operational reviews. You will help teams adopt an AI-native way of working and speed up adoption of tools such as Claude Code and Codex. Examples include AI-powered code review and refactoring assistants, automated test generators and local environment setup tools, deployment pipeline diagnostic agents, and agents that simplify on-call work during incidents.

Self-Service AI Developer Tools Platform. Design and build the platform infrastructure that lets product and platform teams across Docker unblock themselves by prototyping, building, and deploying their own AI developer tools. You will set the patterns and standards that let teams experiment, iterate quickly, and graduate successful prototypes into production-ready services.

You will report to the Senior Manager, AI Developer Tools, and work closely with the team's Principal engineers, engineering leadership, product engineering teams, and platform teams across Docker.

What Would Make Someone Successful in This Role

You are a hands-on technical leader who works well at the intersection of AI, developer experience, and platform engineering. You have shipped production systems built on LLMs and AI agents, and you can explain what worked and what did not. You think in platforms: you design something once so that several teams can move faster. You have clear opinions about what makes a developer tool good, and sound judgment about when to build, when to integrate, and when not to do either. You are comfortable in a fast-moving AI landscape and balance technical quality with shipping iteratively. Before you design, you ask about scale, users, and constraints rather than assuming them. You lead through influence and mentorship, and the engineers around you get better because you are on the team.

Responsibilities

Technical Leadership and Architecture

  • Set technical direction and own the architecture for AI-powered developer tools and the self-service platform within the team's roadmap

  • Turn ambiguous problems into clear requirements, plans, and staged decisions. Ask about scale, users, and constraints before designing, and write down your assumptions

  • Establish patterns, standards, and best practices for LLM integration, agent development, and production AI systems that the team and partner teams adopt

  • Shape platform capabilities including deployment frameworks (ArgoCD/GitOps), observability integration (Grafana), security controls, and operational tooling for AI developer tools

  • Design reliable, scalable infrastructure for hosting AI agents and developer tools

  • Recommend AI technology choices, LLM provider strategies, and agent orchestration approaches, and make the trade-offs explicit

  • Work with the Senior Manager and the team's Principal engineers to align technical decisions with business goals

Systems Design and Implementation

  • Design, build, and operate production AI agents for developer productivity, including code review assistants, test generators, deployment diagnostics, and incident response automation

  • Build self-service platform capabilities that reduce time-to-production for new AI tools from weeks to days

  • Build systems that speed up adoption of AI-native development tools (Claude Code, Codex) across Docker's engineering organization

  • Set and meet reliability, security, and performance standards for AI systems, including SLOs, monitoring, incident response, and cost management

  • Design integrations between AI developer tools and existing developer infrastructure such as CI/CD pipelines, observability platforms, and deployment systems

  • Take part in the team's on-call rotation and use what you learn to improve alerts, runbooks, and tooling

Strategic Impact and Innovation

  • Evaluate emerging AI/LLM technologies, developer tooling trends, and agent frameworks, and recommend what Docker should adopt and what it should not build

  • Define how we measure AI tool effectiveness, including adoption, productivity gains, and developer satisfaction

  • Improve AI tool performance, cost efficiency, and developer experience through architectural improvements

  • Contribute to the technical approach for hardening proven internal tools so other teams across Docker can adopt them

  • Lead cross-team technical delivery, surface risks early, and work with Infrastructure, Security, and Data on shared standards

Leadership and Mentorship

  • Mentor senior engineers on AI/LLM integration patterns, agent development, and platform engineering practices

  • Lead design reviews and raise the quality of design and code reviews across the team

  • Create reusable patterns, documentation, and architectural decision records (ADRs) that other engineers build on

  • Help the team turn good individual AI-assisted engineering practice into shared workflows and controls

  • This role may require participation in an on-call rotation to provide support outside of standard business hours, including evenings, weekends, and holidays, as needed.

Qualifications

Required

  • 8+ years of software engineering experience, with demonstrated technical leadership on production systems at scale

  • Hands-on production experience building LLM-powered applications, AI agents, or AI-assisted developer tools

  • Strong understanding of LLM APIs (OpenAI, Anthropic, and others), prompt engineering, agent orchestration frameworks, and practical uses of AI in software development workflows

  • Track record of designing and building scalable distributed systems and developer-facing platforms

  • Production experience with cloud-native infrastructure, including Kubernetes, GitOps deployment patterns, observability systems, and CI/CD pipelines

  • Proficiency in Go (preferred), Rust, Java, or Python, with strong software engineering fundamentals

  • Experience designing developer tools, platform systems, or internal tools that other teams rely on

  • Track record of clarifying requirements and constraints with stakeholders before committing to a design

  • Track record of leading complex initiatives that crossed team boundaries, and of influencing without direct authority

  • Strong product and platform judgment: you weigh business outcomes, developer experience, and technical trade-offs

  • Clear written and spoken communication suited to a remote, async-first company

  • Track record of mentoring other experienced engineers

  • Ownership mentality with a bias for action and iterative delivery in ambiguous, fast-moving environments

  • Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent practical experience

Preferred

  • Experience with MCP (Model Context Protocol) or similar AI agent integration standards

  • Background in developer productivity, DevOps, SRE, or platform engineering

  • Contributions to open source AI tools, developer tooling, or platform engineering projects

  • Experience evolving an internal platform or tool into a widely adopted, production-grade service

  • Knowledge of security, compliance, and operational practices for production AI systems

  • Experience with infrastructure-as-code (Terraform, Pulumi) and major cloud platforms (AWS, GCP, Azure)

What to Expect

First 30 Days

  • Build context on Docker's current AI and developer tooling landscape, including existing AI experiments, LLM provider relationships, and architecture decisions to date

  • Meet the Senior Manager, the team's Principal engineers, engineering leadership, and key stakeholders in product engineering to understand needs, pain points, and constraints

  • Review existing AI tool prototypes and internal experiments to learn what is working and what is not

  • Get hands-on with the team's services and ship a useful production change

  • Shadow on-call and learn the operational profile of the team's services

  • Work with the Senior Manager to agree on initial technical priorities

First 90 Days

  • Lead the technical framing and delivery plan for one significant problem, from requirements through to production

  • Document the architecture, technology choices, and integration patterns for that work, including ADRs

  • Ship a production AI developer tool that sets patterns the team can reuse (for example an AI-powered code review agent, a deployment diagnostic agent, or an on-call assistant)

  • Contribute to the technical foundations of the self-service platform: deployment pipeline, observability integration, security controls, and cost management

  • Lead design reviews for your area of the roadmap and begin mentoring other engineers

  • Take part in the on-call rotation

First Year Outlook

  • Be the trusted technical lead for your area of AI Developer Tools, and a sought-after partner for teams across Docker

  • Deliver at least one material outcome that spans multiple teams or systems

  • Have multiple production AI tools demonstrating value across Docker's engineering organization

  • Help build a self-service platform that lets multiple teams build, deploy, and operate their own AI tools with little friction

  • Define and instrument how the team measures AI tool adoption, effectiveness, and developer productivity impact

  • Grow other senior engineers into broader ownership, and reduce the number of decisions that depend on a small set of people

Docker considers sponsorship on a case-by-case basis based on business needs.

 

Compensation & Equity

United States: $170,350 – $275,550 + equity

______________________________________________________________________

Posting Information

  • Open vacancy: This posting is for an existing open role.

  • AI in hiring: Docker may use AI-assisted tools during our recruiting process.

  • Interview recordings: Candidates will be invited to opt in to interview recordings to support interviewer calibration and consistent evaluations. Recordings are optional and require explicit consent.

______________________________________________________________________

Perks & Benefits

  • Remote-first by design – Work from your home, with offices in Seattle and Paris for connection and collaboration.

  • Flexibility that fits your life – We trust you to manage your schedule while delivering great work.

  • Time to recharge – Generous PTO, designated quarterly Whaleness Days, and a designated end-of-year Whaleness break.

  • Home office support – Set up your workspace for comfort and success.

  • Technology stipend – Equivalent to US$100 net per month to help support your work.

  • Learning & development – Annual stipend for conferences, courses, certifications, and continued learning.

  • Parental leave – 16 weeks of paid parental leave after six months of employment.

  • Equity for all full-time employees – Share in Docker's long-term success as we continue to grow.

  • Comprehensive benefits – Medical, retirement, and paid holidays vary by country.

  • Docker swag – Because representing the whale never gets old.

Docker is proud to be an equal opportunity employer. We are committed to building a team that reflects a broad range of backgrounds, experiences, and perspectives. We believe diverse teams build better products, make better decisions, and better serve our global community.

#LI-REMOTE

Redirects to Docker's application page.

Other roles

More at Docker.

View all 22 roles