Principal Engineer I, Governance

Principal Engineer · Principal · Full Time · Remote

Remote, United States · RemoteUSD 285k – 342k6mo ago
Apply for this role

Opens Confluent's application page

Role

What you'll do.

Principal Engineer I, Governance at Confluent is a strategic technical leadership role focused on architecting and evolving the company's schema and metadata governance systems that power the data streaming platform. This position requires deep expertise in distributed systems, streaming architectures, and governance infrastructure to design highly available, multi-tenant systems that ensure data reliability, compliance, and performance at scale. The ideal candidate will have a proven track record leading large-scale infrastructure projects, strong executive influence, and the ability to balance technical excellence with business impact across complex organizational boundaries.

Responsibilities

  • Technical Strategy & Platform Architecture: Define and drive company-level technical strategy for critical governance systems including schema management, metadata infrastructure, and data policy enforcement. Design long-term architectural roadmaps for streaming data governance that anticipate industry trends and support next-generation use cases including AI-driven decisioning and real-time processing.
  • Metadata Lifecycle & Consistency Management: Architect and evolve high-performance metadata management systems supporting low-latency lookups, strong consistency guarantees, and coherent behavior across streaming and processing engines. Ensure metadata remains reliable, discoverable, and consistent from initial data production through all downstream consumer interactions at scale.
  • Data Governance & Security Systems Design: Design and evolve comprehensive data protection and governance capabilities including encryption at rest and in transit, fine-grained access control policies, schema validation, and compliance enforcement mechanisms. Ensure consistent policy application across the entire Confluent Cloud and Platform ecosystem.
  • Multi-Tenant Cloud Infrastructure: Build and maintain highly available, resilient, multi-tenant infrastructure for governance services optimized for scalability, fault tolerance, and cloud-native patterns. Establish resource isolation, performance guarantees, and operational excellence practices that support enterprise-scale deployments across AWS, Azure, and GCP.
  • Engineering Excellence & Standards: Establish, evangelize, and maintain company-wide engineering standards, architectural patterns, and technical frameworks adopted across the organization. Drive adoption of best practices in distributed systems design, code quality, testing, and operational reliability through technical leadership and mentorship.
  • Cross-Functional Strategic Alignment: Partner with executive leadership, product management, and engineering leaders across multiple platform teams to align technical vision with business objectives. Build consensus on shared architectural decisions across organizational boundaries without direct authority, balancing technical depth with business impact.
  • Technical Leadership & Mentorship: Mentor senior and staff-level engineers to grow future technical leaders and shape organizational culture around engineering excellence, open-source contribution, and innovation. Provide guidance on complex technical challenges and help develop career paths for high-potential engineers.
  • Industry Thought Leadership: Contribute to relevant open-source projects, particularly those related to data governance and streaming infrastructure. Represent Confluent externally through technical conference talks, published research, and thought leadership that establish the company as a governance and streaming platform innovator.

Qualifications

What we look for.

Technical

  • Distributed Systems Architecture

    Deep expertise architecting and leading delivery of large-scale distributed systems with proven company-level impact. Comprehensive knowledge of fault tolerance mechanisms, consistency models (eventual, strong, causal), scalability patterns, and cloud-native architectural principles.

  • Streaming & Event-Driven Architectures

    Working depth with streaming platforms and event-driven system design. Strong familiarity with adjacent domains including schema management, data catalogs, metadata systems, and governance frameworks that operate on streaming data at scale.

  • Cloud Infrastructure & Multi-Tenancy

    Deep hands-on experience with public cloud platforms (AWS, Azure, or GCP) including networking, storage, compute optimization, and resource management. Demonstrated expertise designing and operating multi-tenant systems with strong isolation, performance guarantees, and operational efficiency.

  • Metadata & Governance Systems

    Experience designing data governance ecosystems, metadata management systems, or data catalog platforms supporting mission-critical workloads. Understanding of schema evolution, policy enforcement, access control, and data lineage tracking in large-scale environments.

  • High-Availability & Resilience Engineering

    Proven ability to design systems for high availability, disaster recovery, and fault tolerance. Experience with replication strategies, consensus protocols, monitoring/observability, and operational practices that maintain SLAs in production systems serving thousands of users.

Education

  • Computer Science or Related Technical Field

    Bachelor's degree in Computer Science, Computer Engineering, Mathematics, or equivalent professional experience demonstrating advanced technical proficiency in systems design and software architecture.

Experience

  • Principal or Staff Engineer Experience

    Minimum 12+ years of software engineering experience with at least 5+ years in principal or staff-level roles with company-level technical authority and architectural influence across multiple teams.

  • Large-Scale Systems Leadership

    Proven track record successfully architecting, building, and shipping large-scale distributed systems that handle petabyte-scale data or millions of concurrent operations. Demonstrated ability to move from high-level vision to detailed implementation with strong bias toward shipped, adopted outcomes.

  • Strategic Technical Influence

    Strong ability to navigate ambiguity, influence executives and stakeholders, and build cross-functional consensus on technical decisions without direct authority. Experience reducing systemic complexity and anticipating industry trends to design systems for 3-5 year horizons.

  • Open-Source or Industry Leadership

    Recognized industry thought leader through open-source contributions, community leadership, or driving initiatives from ground up. Track record of external representation through speaking engagements, technical publications, or recognized expertise in data infrastructure domains.

Skills

Required

  • Distributed Systems Design

    Expert-level understanding of CAP theorem, consistency models, replication, consensus algorithms, and distributed transaction handling with practical implementation experience.

  • Streaming Architecture

    Deep knowledge of event streaming platforms, message brokers, stream processing patterns, and integration with batch and real-time processing paradigms.

  • Cloud-Native Architecture

    Expertise in containerization, microservices design, orchestration platforms, and cloud-native operational patterns across major cloud providers.

  • Systems Design & Scalability

    Ability to design systems supporting horizontal scalability, multi-tenancy, resource optimization, and performance at petabyte or massive concurrent operation scales.

  • Technical Leadership

    Strong executive presence, cross-functional collaboration skills, and ability to influence without authority. Experience mentoring senior engineers and shaping technical culture.

Preferred

  • Data Governance & Metadata Systems

    Nice to have

    Experience designing data governance platforms, metadata repositories, data catalog systems, or schema registries. Understanding of compliance frameworks, data lineage, and policy enforcement.

  • Apache Kafka & Related Ecosystem

    Nice to have

    Deep experience with Apache Kafka, Kafka Connect, Confluent Platform, or similar event streaming technologies. Familiarity with the broader ecosystem of data infrastructure tooling.

  • AI/ML Infrastructure

    Nice to have

    Experience building infrastructure serving AI or agentic workloads, particularly systems handling metadata quality, context management, or governance for intelligent applications.

  • Database & Storage Systems

    Nice to have

    Advanced knowledge of database internals, storage engine design, indexing strategies, and consistency mechanisms. Experience with both SQL and NoSQL systems at scale.

  • Open-Source Contributions

    Nice to have

    Active contributions to major open-source projects in data infrastructure, distributed systems, or streaming domains. Experience as a maintainer or recognized contributor to widely-adopted projects.

Tech stack

Languages

JavaScalaPythonGo

Frameworks

Apache KafkaApache FlinkSpring FrameworkKubernetes

Databases

PostgreSQLElasticsearchMongoDBApache Cassandra

Tools

DockerTerraformPrometheusGrafanaVault

Other

gRPCProtocol BuffersOpenTelemetryOAuth 2.0 / SAML

Compensation

Pay and benefits.

Base·USD 285,000 – 342,000

Equity·Stock options

Benefits

  • Equity & Stock Options

    Competitive equity packages providing ownership stake in Confluent (IBM subsidiary), with vesting schedules aligned to long-term value creation and career growth.

  • Comprehensive Health & Wellness

    Medical, dental, and vision coverage options; mental health support programs; fitness reimbursement; and wellness initiatives designed for high-performing engineering teams.

  • Flexible Work Arrangements

    Remote-first work culture with flexibility to work from home, office, or hybrid arrangements. Asynchronous collaboration practices supporting globally distributed teams across time zones.

  • Professional Development & Training

    Annual learning budgets, conference attendance support, certification programs, and internal technical training opportunities to maintain cutting-edge skills in distributed systems and cloud technologies.

  • Parental & Family Leave

    Generous paid parental leave for all parents, adoption support, and family-friendly policies recognizing life outside engineering.

  • Retirement Planning

    401(k) retirement plans with company matching contributions and financial planning resources to support long-term wealth building.

  • Open-Source Contribution Support

    Company-sponsored time and resources for open-source contributions, conference speaking opportunities, and thought leadership development for industry recognition.

  • Unlimited PTO & Sabbaticals

    Flexible vacation policy with emphasis on work-life balance. Sabbatical programs for long-tenure employees to recharge and pursue strategic projects.

Process

Interview steps.

  1. 01

    Initial Screening

    Recruiter phone screen to assess career trajectory, technical depth, and alignment with Confluent's mission. Discussion of governance experience and strategic architectural thinking.

  2. 02

    Technical Leadership Interview

    Meeting with engineering director or fellow principal engineer to discuss complex distributed systems challenges, design philosophy, and approach to architectural trade-offs in governance systems.

  3. 03

    Deep Technical Dive

    Technical round with senior engineers focused on specific domains: streaming architecture deep-dive, metadata systems design, or multi-tenancy patterns. May include whiteboarding or system design discussion.

  4. 04

    Cross-Functional Stakeholder Panel

    Conversation with product leadership, infrastructure teams, and other platform leaders to assess collaboration style, ability to influence across boundaries, and alignment with product vision.

  5. 05

    Principal Engineer Panel

    Discussion with current and senior principal engineers about company strategy, mentorship philosophy, and role in shaping technical culture and long-term vision for governance systems.

  6. 06

    Executive Leadership Round

    Meeting with VP of Engineering or CTO to discuss strategic direction, company vision, and how this role contributes to Confluent's data streaming platform leadership. Opportunity to assess executive perspective and culture fit.

Full posting

Original listing.

We’re not just building better tech. We’re rewriting how data moves and what the world can do with it. With Confluent, data doesn’t sit still. Our platform puts information in motion, streaming in near real-time so companies can react faster, build smarter, and deliver experiences as dynamic as the world around them.

It takes a certain kind of person to join this team. Those who ask hard questions, give honest feedback, and show up for each other. No egos, no solo acts. Just smart, curious humans pushing toward something bigger, together.

One Confluent. One Team. One Data Streaming Platform.

About the Role

Confluent's Data Streaming Platform is only as trustworthy as the schemas, metadata, and policies that govern it. As more of the platform's value shifts toward real-time processing and AI-driven decisioning, the systems that keep data well-formed, reliable, discoverable, and compliant, from the moment it's produced through every downstream consumer, become as critical to correctness as the storage and compute layers themselves. The governance layer and the stream catalog integrates the Data Streaming Platform into a unified, intuitive and intelligent product to serve the critical real-time use cases for our customers.

As a Principal Engineer, you will be a key technical leader shaping the long-term architecture, scalability, and reliability of Confluent's schema and metadata governance systems, and their integration across the broader Confluent Streaming Platform. You will focus on advancing the core layers of Stream Governance, including highly available, multi-tenant infrastructure and the systems responsible for schema management, data policy enforcement, and metadata consistency at scale.

You will own company-level technical domains, set direction for critical initiatives, and influence both engineering practices and product strategy. This role requires operating with autonomy in highly ambiguous spaces, making decisions that balance technical depth with business impact to ensure reliability and scalability for governance services across all of Confluent Cloud and Confluent Platform.

What You Will Do

- Technical Strategy & Leadership: Define and drive company-level technical strategy for critical governance systems, ensuring long-term innovation for schema and metadata infrastructure.

- Metadata Architecture & Lifecycle Management: Architect and evolve high-performance metadata management systems that support low-latency lookups, strong consistency guarantees, and coherent behavior across streaming and processing engines.

- Data Policy & Governance Systems: Design and evolve data protection capabilities — including encryption, access control, and schema validation — enforced consistently across the platform.

- Platform Engineering: Build and maintain highly available, multi-tenant infrastructure for governance services, ensuring the platform is optimized for scalability, reliability, and resilience.

- Architectural Excellence: Establish and evangelize engineering standards, architectural patterns, and technical frameworks adopted across the organization.

- Cross-Functional Collaboration: Partner with executives, product management, and engineering leaders across the platform to align technical vision with business objectives — working across team boundaries to build consensus on shared architecture decisions you don't have direct authority over.

- Mentorship & Culture: Mentor senior and staff-level engineers, growing future technical leaders and shaping a culture of engineering excellence and open-source contribution.

- Open-Source & External Representation: Contribute to relevant open-source projects and represent Confluent externally through technical talks and thought leadership.

What You Will Bring

- Deep Expertise: A proven track record of leading the architecture and delivery of large-scale distributed systems with company-level impact.

- Distributed Systems Mastery: Comprehensive knowledge of fault tolerance, consistency, scalability, and cloud-native platforms.

- Streaming Architecture Fluency: Working depth with streaming or event-driven architectures, and familiarity with adjacent domains such as schema management, data catalogs, or metadata/governance systems.

- Strategic Influence: Ability to navigate ambiguity, reduce systemic complexity, and anticipate industry trends to design systems for the next 3–5 years.

- Leadership Presence: Strong ability to influence executives and stakeholders while fostering a collaborative environment across multiple teams.

- Execution: Demonstrated ability to move from high-level vision to detailed technical implementation and delivery, with a strong bias toward shipped, adopted outcomes over theoretical design.

What Gives You an Edge

- Industry Leadership: Recognized industry thought leader through open-source contributions or driving initiatives from ground up.

- Advanced Domain Knowledge: Experience with data catalog, metadata, or governance ecosystems, or large-scale data infrastructure supporting mission-critical workloads.

- Cloud Infrastructure: Deep experience with public clouds (AWS, Azure, or GCP) and expertise in resource management and multi-tenancy in complex cloud environments.

- AI-Adjacent Systems: Experience building infrastructure that serves AI or agentic workloads, particularly around metadata, context quality, or governance.


Ready to build what's next? Let’s get in motion.

Come As You Are

Belonging isn’t a perk here. It’s the baseline. We work across time zones and backgrounds, knowing the best ideas come from different perspectives. And we make space for everyone to lead, grow, and challenge what’s possible.

We’re proud to be an equal opportunity workplace. Employment decisions are based on job-related criteria, without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, veteran status, or any other classification protected by law.

Privacy Statement

Confluent is an IBM subsidiary which has been acquired by IBM and will be integrated into the IBM organization. By proceeding with this application, you understand that Confluent will share your personal information with other IBM affiliates involved in your recruitment process, wherever these are located. More Information on how IBM protects your personal information, including the safeguards in case of cross-border data transfer, are available here.

Redirects to Confluent's application page.

Other roles

More at Confluent.

View all 21 roles