The opportunity
OpenAI's Training team is responsible for producing the large language models that power our research, our products, and ultimately bring us closer to AGI. Achieving this goal requires combining deep research into improving our current architecture and optimization techniques,…
What you'll do
Design, prototype and scale up new architectures to improve model intelligence
Execute and analyze experiments autonomously and collaboratively
Study, debug, and optimize both model performance and computational performance
Contribute to training and inference infrastructure
Have experience landing contributions to major LLM training runs
Can thoroughly evaluate and improve deep learning architectures in a self-directed fashion
What they're looking for
- Are motivated by safely deploying LLMs in the real world
- Are well-versed in the state of the art transformer modifications for efficiency
