Software Engineer, Data Infrastructure

Data Infrastructure Engineer · Senior · Full Time · Remote

New York · RemoteUSD 150k – 220k3mo ago
Apply for this role

Opens Cohere's application page

Role

What you'll do.

Cohere is seeking a talented Software Engineer for its Data Infrastructure team, focusing on building and maintaining high-performance data storage solutions for cutting-edge AI training workloads. The ideal candidate will work on petabyte-scale infrastructure, collaborating with world-class researchers and engineers to develop innovative data processing and storage solutions.

Responsibilities

  • Infrastructure Development: Design and maintain petabyte-scale storage infrastructure for AI training workloads
  • Data Processing: Transform unstructured data into performant datasets across diverse storage backends
  • Collaboration: Work closely with researchers and engineers to support AI model training and evaluation processes
  • Performance Optimization: Address networking and performance challenges in large-scale data infrastructure

Qualifications

What we look for.

Technical

  • Experience Requirement

    4+ years of experience working on data storage infrastructure

  • Technical Skills

    Proficiency in Python, Kubernetes, and distributed data processing frameworks

Education

  • Degree

    Bachelor's or Master's degree in Computer Science, Software Engineering, or related technical field preferred

Experience

  • Infrastructure Experience

    Proven track record of working with large-scale data storage and processing systems

Skills

Required

  • Python

    Strong command of Python programming for data infrastructure development

  • Kubernetes

    Expertise in Kubernetes storage infrastructure, including Persistent Volumes and CSI drivers

  • Data Storage

    Extensive experience with petabyte-scale storage infrastructure and data transformation

  • Distributed Data Processing

    Proficiency with distributed data processing frameworks like Apache Beam, Spark, or Flink

Preferred

  • Cloud Storage

    Nice to have

    Experience with S3, GCS, and POSIX storage backends

  • Analytics Tools

    Nice to have

    Familiarity with modern analytics tooling such as BigQuery, Airflow, or dbt

Tech stack

Languages

Python

Frameworks

Apache BeamApache Spark

Databases

S3Google Cloud Storage

Tools

KubernetesBigQueryAirflow

Other

CSI Drivers

Compensation

Pay and benefits.

Base·USD 150,000 – 220,000

Equity·Stock options

Benefits

  • Health Benefits

    Comprehensive health and dental coverage with additional mental health budget

  • Parental Leave

    100% parental leave top-up for up to 6 months

  • Vacation

    6 weeks of annual vacation (30 working days)

  • Work Flexibility

    Remote-flexible work arrangement with co-working stipend

  • Personal Enrichment

    Benefits for arts, culture, fitness, well-being, and workspace improvement

  • Lunch Benefits

    Weekly lunch stipend, in-office lunches and snacks

Process

Interview steps.

  1. 01

    Initial Screening

    Phone or video call with recruiting team to discuss background and initial fit

  2. 02

    Technical Assessment

    Comprehensive technical interview focusing on data infrastructure, Kubernetes, and distributed systems expertise

  3. 03

    Onsite/Virtual Interviews

    Multiple interviews with team members, including technical deep dives and system design challenges

  4. 04

    Final Interview

    Discussion with team leadership about role alignment and cultural fit

Full posting

Original listing.

Who are we?

Our mission is to scale intelligence to serve humanity. We’re training and deploying frontier models for developers and enterprises who are building AI systems to power magical experiences like content generation, semantic search, RAG, and agents. We believe that our work is instrumental to the widespread adoption of AI.

We obsess over what we build. Each one of us is responsible for contributing to increasing the capabilities of our models and the value they drive for our customers. We like to work hard and move fast to do what’s best for our customers.

Cohere is a team of researchers, engineers, designers, and more, who are passionate about their craft. Each person is one of the best in the world at what they do. We believe that a diverse range of perspectives is a requirement for building great products.

Join us on our mission and shape the future!

Why this role?

We're building the data infrastructure behind some of the most demanding AI training workloads in the world, and we want sharp, curious people to help us do it. In this role, you'll build and maintain the high-performance data layer our Modeling teams rely on for training and evaluation jobs.

As a Software Engineer, Data Infrastructure, you will:

  • Work directly on petabyte-scale storage infrastructure, and the networking and performance challenges that come with it.

  • Collaborate daily with researchers and engineers who are some of the best in the world at what they do.

You may be a good fit if you have:

  • 4+ years of experience working on data storage infrastructure

  • Strong command of Python

  • Kubernetes experience, especially on the storage side (Persistent Volumes, CSI drivers, etc.)

  • The ability to transform unstructured data into performant datasets across diverse storage backends including S3, GCS, and POSIX

  • Experience with distributed data processing frameworks such as Apache Beam, Spark, or Flink

  • [Nice-to-have] Familiarity with modern analytics tooling such as BigQuery, Airflow, or dbt

  • Genuine excitement about AI. You follow the research, have opinions, and enjoy being in the weeds

  • Comfort operating at the edge of what's known, with a desire to build something genuinely new rather than optimize what already exists

If some of the above doesn’t line up perfectly with your experience, we still encourage you to apply!

We value and celebrate diversity and strive to create an inclusive work environment for all. We welcome applicants from all backgrounds and are committed to providing equal opportunities. Should you require any accommodations during the recruitment process, please submit an Accommodations Request Form, and we will work together to meet your needs.

Full-Time Employees at Cohere enjoy these Perks:

🤝 An open and inclusive culture and work environment 

🧑‍💻 Work closely with a team on the cutting edge of AI research 

🍽 Weekly lunch stipend, in-office lunches & snacks

🦷 Full health and dental benefits, including a separate budget to take care of your mental health 

🐣 100% Parental Leave top-up for up to 6 months

🎨 Personal enrichment benefits towards arts and culture, fitness and well-being, quality time, and workspace improvement

🏙 Remote-flexible, offices in Toronto, New York, San Francisco, London and Paris, as well as a co-working stipend

✈️ 6 weeks of vacation (30 working days!)

Redirects to Cohere's application page.

Other roles

More at Cohere.

View all 26 roles