The opportunity
The Alignment team at OpenAI is dedicated to ensuring that our AI systems are safe, trustworthy, and consistently aligned with human values, even as they scale in complexity and capability. Our work is at the cutting edge of AI research, focusing on developing methodologies that…
What you'll do
Develop and evaluate alignment capabilities that are subjective, context-dependent, and hard to measure.
Design evaluations to reliably measure risks and alignment with human intent and values.
Build tools and evaluations to study and test model robustness in different situations.
Design experiments to understand laws for how alignment scales as a function: of compute, data, lengths of context and action, as well as resources of adversaries.
Design and evaluate new Human-AI-interaction paradigms and scalable oversight: methods that redefine how humans interact with, understand, and supervise our models.
Train model to be calibrated on correctness and risk.
What they're looking for
- Designing novel approaches for using AI in alignment research
- Are a team player: willing to do a variety of tasks that move the team forward.
- Have a PhD or equivalent experience in research in computer science,: computational science, data science, cognitive science, or similar fields.
- Have strong engineering skills, particularly in designing and optimizing: large-scale machine learning systems(e.g., PyTorch).
