The opportunity
Codex is OpenAI’s first-party developer product focused on agentic software engineering. We’re building tools that help engineers design, write, test, and ship code faster—safely and at scale.
What you'll do
Embed with the Codex product team to discover opportunities that improve developer outcomes and growth
Design and interpret A/B tests and staged rollouts of new coding models and product features
Define and operationalize metrics such as suggestion acceptance, edit: distance, compile/test pass rates, task completion, latency, and session productivity
Build dashboards and analyses that help the team self-serve answers to: product questions (by language, framework, repo size, task type)
Diagnose failure modes and partner with Research on targeted improvements: (model quality signals, user feedback, evals)
+ years in a quantitative role at a developer-facing or high-growth product
What they're looking for
- Fluency in SQL and Python; comfort with experiment design and causal inference
- Experience defining product metrics tied to user value
- Ability to communicate clearly with PM, Eng, and Design—and to influence product direction
- Strong programming background; ability to prototype, run simulations, and reason about code quality
