Notion

Model Behavior Engineer

Notion3 weeks ago
Location

New York, New York

Type

Full Time

Salary

USD 98,000 – 140,000

Level

Senior

Role

Model Behavior Engineer

Posted

Feb 20, 2026

Full TimeSenior

The role

Summary

Notion is seeking a Model Behavior Engineer to shape the quality and behavior of their AI products. This unique role focuses on context engineering, AI model evaluation, and driving quality improvements for Notion's AI experiences, requiring a blend of analytical thinking, curiosity, and strategic problem-solving in the rapidly evolving AI landscape.

What you'll do

Context Engineering: Design, test, and refine system and tool prompts to shape Notion AI's product behavior
Production Data Analysis: Investigate production logs, transcripts, and user feedback to identify and resolve AI performance issues
Evaluation Strategies: Create comprehensive evaluation datasets and frameworks to measure AI product quality over time
Model Benchmarking: Evaluate and launch new AI models from leading research labs, assessing quality, latency, and cost
Quality Prioritization: Work with engineering and product teams to surface and address critical AI product quality issues
Tooling Development: Build and manage AI observability and evaluation platforms to support Notion's AI product development

What we look for

Technical

Data Analysis ToolsProficiency with SQL, data analysis platforms, and insights extraction tools
AI Model UnderstandingDeep knowledge of Large Language Model capabilities and limitations

Education

Advanced DegreeBachelor's or Master's in Computer Science, Data Science, or related technical field preferred

Experience

AI Product ExperienceDemonstrated experience working with AI technologies, preferably in product development
Analytical RoleBackground in roles requiring complex problem-solving and data-driven decision making

Skills

Required skills

Context EngineeringAbility to design, test, and iterate on system prompts and context strategies for AI models
Data AnalysisProficiency in finding signal in complex datasets, using SQL or coding agents
AI Model EvaluationExperience in benchmarking and assessing AI model performance across multiple dimensions
Problem-SolvingStrong analytical instinct and ability to debug and reproduce complex AI behavior issues
CommunicationSkill in explaining complex technical concepts clearly and concisely

Nice to have

LLM ExperiencePrior work with Large Language Models, prompting techniques, or AI product development
Side ProjectsPersonal projects demonstrating innovation and problem-solving skills
Interdisciplinary BackgroundExperience in engineering, product, data science, research, or consulting

Compensation & benefits

Salary

USD 98,000 – 140,000 (annual)

Benefits

Competitive Compensation

Highly competitive base salary with potential equity

Innovative Work Environment

Opportunity to shape cutting-edge AI product development

Professional Growth

Work with frontier AI labs and emerging technologies

Diversity and Inclusion

Commitment to a diverse and inclusive workplace

Interview process

  1. 1
    Initial Screening — Review of application and background
  2. 2
    Technical Assessment — Evaluation of AI and data analysis skills
  3. 3
    Problem-Solving Interview — Case study or scenario-based technical interview
  4. 4
    Team Fit Interviews — Discussions with potential team members and leadership
  5. 5
    Final Interview — Comprehensive evaluation of technical skills and cultural alignment
Apply for this position

You'll be redirected to the company's application page

Notion

Notion

View all jobs

Notion is an American productivity software providing an all-in-one workspace for notes, tasks, and databases. Popular for its flexibility, it serves individuals and teams for project management and collaboration, evolving from a no-code tool to a versatile platform.

San Francisco, California, United StatesFounded 2013notion.so

Tech Stack

Languages
SQLPython
Frameworks
AI Evaluation Frameworks
Databases
Production Logs
Tools
BraintrustData Analysis Tools
Other
LLM Platforms

Interview Guides

11 guides available for Notion

Apply Now

On this page