全部面试
OpenAI logo

OpenAI

Mid

Build the RL environments and evals that steer OpenAI's frontier agent training runs

OpenAI's Agent Post-Training team is hiring a research scientist to build north-star model environments and evaluations for agent capabilities like coding, tool use, computer use, and multi-agent coordination. This is a research-taste-plus-engineering-execution role: you define what 'good' looks like for a frontier agent, build the environment/grader/data pipeline to measure it, and steer real training runs. Prior team output includes GDPval, SWE-bench Verified, MLE-bench, PaperBench, and SWE-Lancer.

走进这场面试

免费 · 一场按这个岗位校准的真语音模拟

练这场面试

这场面试考什么

  • Designing RL environments / evals for agent capabilities (coding, tool use, computer use, multi-agent)
  • Grader design and validating measurement reliability/scalability/variance
  • Post-training methods: RLHF/RLAIF, synthetic data, model training pipelines
  • Cross-functional execution across research, product, infra, and safety
  • Turning ambiguous behavioral problems into concrete experiments

常见提问方向

Describe an eval or environment you built and how you validated the grader wasn't gameable

How do you reason about scalability and variance in an evaluation methodology

Tell me about hands-on RLHF/RLAIF or post-training work you've shipped

How do you balance benchmark movement against real product/model-behavior impact

Describe aligning research, product, infra, and safety teams on a contentious decision

How would you design an environment to stress-test a coding agent's long-horizon reliability

查看原始招聘页

相关面试