The opportunity
Scale has been the leading AI data foundry, helping fuel the most exciting advancements in AI, including frontier model training, enterprise adoption, defense applications, and autonomous vehicles. Our mission is to develop reliable AI systems for the world's most important decisions.
What you'll do
Own the roadmap and strategy for Scale’s SEAL Leaderboard portfolio, defining: priorities across benchmark development, leaderboard launches, infrastructure investments, and product expansion.
Facilitate the Leaderboard Steering Committee and drive alignment across: AI-PM, ML, Engineering, Operations, and GTM stakeholders.
Evaluate, prioritize, and operationalize new leaderboard proposals, ensuring: alignment with customer demand, market opportunities, and company strategy.
Define and manage the end-to-end leaderboard product lifecycle, from ideation: and benchmark design to launch, growth, maintenance, and sunset decisions.
Partner with ML researchers and domain experts to develop trustworthy: evaluation methodologies, benchmark specifications, and leaderboard scoring frameworks.
Drive the roadmap for leaderboard infrastructure, automation, and operational: tooling to improve scalability, reduce manual effort, and accelerate benchmark releases.
What they're looking for
- Establish governance processes for benchmark quality, evaluation integrity,: release management, auditability, and update cadence.
- Work directly with frontier AI labs and enterprise customers to understand: evaluation needs, gather feedback, and influence future leaderboard investments.
- Track adoption, usage, customer impact, and business outcomes, using: data-driven insights to guide roadmap decisions and resource allocation.
- Identify new evaluation categories, benchmark opportunities, and leaderboard: products that strengthen Scale’s industry leadership and create new revenue opportunities.
