Software Engineer, Fleet InfrastructureActive$230K–$490K

The opportunity

This role will support the fleet infrastructure team at OpenAI. The fleet team focuses on running the world’s largest, most reliable, and frictionless GPU fleet to support OpenAI’s general purpose model training and deployment.

What you'll do

  • Maximizing GPUs doing useful work by building user-friendly scheduling and quota systems

  • Running a reliable and low maintenance platform by building push-button: automation for kubernetes cluster provisioning and upgrades

  • Supporting research workflows with service frameworks and deployment systems

  • Ensuring fast model startup times though high performance snapshot delivery: across blob storage down to hardware caching

  • Design, implement and operate components of our compute fleet including job: scheduling, cluster management, snapshot delivery, and CI/CD systems.

  • Interface with researchers and product teams to understand workload requirements

What they're looking for

  • Collaborate with hardware, infrastructure, and business teams to provide a: high utilization and high reliability service
  • Have experience with hyperscale compute systems
  • Possess strong programming skills
  • Have experience working in public clouds (especially Azure)