The opportunity
The Agent Safety team works to ensure that increasingly capable AI agents act safely, exercise sound judgment, and remain aligned with user intent. Our mission is to reduce the probability of severe unintended outcomes from increasingly capable AI agents while preserving their…
What you'll do
Training: Create training methods, environments and data that teach agents to: make better decisions in consequential situations. We turn real-world failures into training signals that prevent similar incidents, and identify precursor behaviors and mitigations to address emerging risks.
Measurements: Build evaluations and production metrics that identify emerging risks and measure whether our interventions work.
Oversight: Develop oversight and system mitigation mechanisms that reduce: harmful actions while preserving useful autonomy (for example future versions of auto-review ).
Train and evaluate frontier models to reduce harmful or misaligned agent: actions, forming clear hypotheses and executing independently through ambiguity.
Mine incidents and build scalable measurement, data-processing, and: evaluation systems that turn real failures into repeatable safety signals.
Collaborate closely with post-training, capabilities, oversight, and: pre-training partners to ship research-backed mitigations into large-scale training and agent systems.
What they're looking for
- Have demonstrated strength in research engineering, ML engineering,: quantitative research, or applied model research, with the ability to own ambiguous projects end to end.
- Bring excellent technical execution across experimentation, data, evaluation,: and/or infrastructure, plus strong intuition for modern frontier-model research.
- Are motivated by agent safety and eager to work on urgent, practical problems: even if your prior work was outside safety or alignment.
