Cohere

Senior Software Engineer, Agent Infrastructure

Cohere2 weeks ago
Location

Toronto

Workplace

Remote

Type

Full Time

Salary

USD 150,000 – 250,000

Level

Senior

Role

Senior Software Engineer

Posted

Mar 12, 2026

Full TimeRemoteSenior

The role

Summary

Cohere is seeking a Senior Software Engineer to work on cutting-edge agentic AI infrastructure, developing innovative platforms for autonomous AI agents. The ideal candidate will combine deep systems expertise with machine learning insights to build scalable, secure, and robust infrastructure for next-generation AI agent technologies.

What you'll do

AI Infrastructure Development: Turn emerging ML research ideas into production-ready infrastructure for autonomous AI agents
Platform Capabilities: Build core platform capabilities for execution, storage, and state management of AI agents
Technology Evaluation: Prototype and evaluate new technologies, making strategic decisions about production readiness
Cross-Team Collaboration: Partner with research teams to shape infrastructure based on future agent system requirements

What we look for

Technical

ML InfrastructureProven experience building production machine learning infrastructure with strong systems fundamentals
Distributed SystemsExpertise in scalable, fault-tolerant distributed systems and Kubernetes
Agent SystemsHands-on experience with agentic systems, multi-agent workflows, or agent development frameworks

Education

Advanced DegreeBachelor's or Master's in Computer Science, Software Engineering, or related technical field preferred

Experience

Systems EngineeringDemonstrated track record of developing complex infrastructure solutions
Prototype DevelopmentProven ability to move quickly on prototypes and make sound productionization decisions

Skills

Required skills

Distributed ComputingAdvanced knowledge of distributed systems architecture and implementation
Machine Learning InfrastructureDeep understanding of ML systems design and implementation
KubernetesProficiency in container orchestration and cloud-native technologies

Nice to have

Multi-Cloud ExperienceFamiliarity with on-prem, private cloud, and public cloud environments
Security ExpertiseUnderstanding of identity, workload authentication, and capability-based security systems

Compensation & benefits

Salary

USD 150,000 – 250,000 (annual)

Benefits

Health Benefits

Comprehensive health and dental coverage with additional mental health budget

Parental Leave

100% salary top-up for up to 6 months of parental leave

Personal Enrichment

Benefits for arts, culture, fitness, and workspace improvement

Vacation

6 weeks (30 working days) of annual vacation

Work Flexibility

Remote-flexible with global office locations and co-working stipend

Interview process

  1. 1
    Initial Screening — Initial resume and background review
  2. 2
    Technical Phone Screen — Detailed discussion of technical skills and experience with AI infrastructure
  3. 3
    Technical Interview — In-depth technical assessment of systems design and ML infrastructure capabilities
  4. 4
    Onsite/Virtual Interviews — Multiple rounds with team members, focusing on technical expertise and cultural fit
  5. 5
    Final Review — Comprehensive evaluation and potential job offer
Apply for this position

You'll be redirected to the company's application page

Cohere

Cohere

View all jobs

Cohere is a leading enterprise AI company focused on building powerful large language models (LLMs) and tools for businesses. The company's mission is to empower enterprises to integrate cutting-edge AI capabilities into their products and operations, making AI accessible and practical for real-world applications. Cohere offers a range of APIs that allow developers and organizations to harness generative AI for tasks such as text generation, summarization, intelligent search, and conversation. They operate within the rapidly expanding artificial intelligence software market, serving a diverse global clientele.

Toronto, CanadaFounded 2019cohere.com

Tech Stack

Languages
PythonGo
Frameworks
KubernetesDocker
Databases
Embedded Databases
Tools
Secure Execution Environments
Other
AI Platforms
Apply Now

On this page