Engineering Manager, Agent OversightNew$46K–$183K

The opportunity

Scale's mission is to develop reliable AI systems for the world's most important decisions. As the leading AI data foundry, we provide the high-quality data and full-stack technologies that power the world's most advanced models — fueling breakthroughs in generative AI, defense, and autonomous vehicles.

What you'll do

  • Lead a multi-disciplinary team of software and ML engineers to drive: technical delivery across the Scale Generative AI Platform (SGP)

  • Own the platform's roadmap across deployment, monitoring, evaluation, and: ML-driven improvement of agentic applications

  • Work cross-functionally with customers, forward deployed teams, product, and: internal engineering teams to translate enterprise and government requirements into platform capabilities

  • Build and ship features end-to-end, from system design through debugging and testing

  • Drive high-velocity experimentation to validate and improve platform capabilities based on real customer usage

  • Establish the technical direction, culture, and processes for a fast-growing team

What they're looking for

  • Mentor and develop both engineers and ML engineers/scientists, and influence: how the team scales technically and organizationally
  • + years of engineering experience, including 2+ years directly managing: engineers or ML engineers responsible for a production ML/LLM-powered system — not just consuming a third-party ML API within a feature
  • Hands-on familiarity with agent architectures: tool use, planning, multi-agent orchestration — and the technical depth to make informed tradeoffs with your team
  • You can review ML experiment design or evaluation methodology well enough to: ask sharp questions and earn credibility with ML engineers and scientists, even if you're not running the experiments yourself
Engineering Manager, Agent Oversight at Scale AI | Role Match