All interviews
OpenAI logo

OpenAI

Mid

Close the capability overhang between power users and average consumers — build evals, training data, and reward signals that make ChatGPT more capable for everyone.

OpenAI's Personal AGI North Stars team is hiring a Research Engineer/Scientist to improve model capability and behavior across tool-use, feature discovery, connectors, and instruction following, deployed to millions of ChatGPT/API users. You'll own a research agenda, build evals to track capability improvements, and work across a large ML codebase to translate behavioral bottlenecks into training data and reward signal changes. This interview probes ML research judgment, eval design rigor, and hands-on ability to debug and iterate in a complex research stack.

Step into this interview

Free · a live voice mock calibrated to this exact role

Practice this interview

What this interview tests

  • Identifying and closing model capability bottlenecks (tool-use, instruction following, feature discovery)
  • Building robust evals that track real capability/behavior improvements
  • Translating eval findings into training data and reward signal changes
  • Debugging and iterating within a large, complex ML research codebase
  • Balancing independent research ownership with cross-team collaboration

Common question themes

Walk through how you'd design an eval for a specific model capability gap

Describe translating an eval result into a concrete training data or reward signal change

Tell me about debugging a subtle behavior issue in a large ML codebase you didn't build

How do you avoid an eval being gamed or failing to generalize

How would you prioritize a research agenda that touches tool-use, connectors, and instruction following simultaneously

View the original posting

Related interviews