The opportunity
Minimum education: Bachelor’s degree or an equivalent combination of education, training, and/or experience
What you'll do
Own the technical roadmap for how the inference fleet is coordinated: where traffic goes, where capacity lives, how caches are placed, how fast the system reacts to demand, and the protocols that keep the control plane and the inference engines in sync
Partner with the product, inference engine, performance, and capacity teams: to identify throughput, latency, utilization, and cost wins, then turn those into shipped improvements with measurable results
Build the group's habit of quantitative modeling: claim a win only when you can measure it, and know before you ship what the expected effect is
Set technical strategy for how the control plane evolves across heterogeneous: hardware, across multiple cloud providers, and across all our serving surfaces
Run the group's operational backbone: on-call rotations, incident response, postmortem review, deploy safety — so the teams can ship aggressively without the system becoming fragile
Create clarity at a seam: this group sits between the API surface, the inference engines, capacity planning, and the cloud deployment teams
What they're looking for
- Develop and retain strong existing teams, and hire against a high technical bar
- Coach engineers through a roadmap where priorities shift
- Shape team structure as the scope grows: decide where the boundaries between problem areas should sit, and grow leads who can own each
- Pick up slack when it matters. These are small teams on a critical path;: sometimes the EM is the one unblocking a stuck initiative or synthesizing a design debate
