Senior Principal Software Engineer, Machine LearningNew

The opportunity

Toast creates technology to help restaurants and local businesses succeed in a digital world, helping business owners operate, increase sales, engage customers, and keep employees happy.

What you'll do

  • Own technical direction of the ML Platform: feature store, model hosting and serving, experimentation, training infrastructure — driving architectural decisions around scalability, reliability, latency, and cost

  • Lead design and delivery of large-scope platform initiatives from conception: through production, coordinating across ML, data, and infrastructure teams

  • Identify and resolve systemic technical challenges: online/offline feature parity, model deployment friction, experimentation velocity, GPU utilization, cross-team dependencies

  • Set and maintain a high engineering quality bar through hands-on code: contributions, design reviews, and mentorship of platform and ML-adjacent engineers

  • Partner with ML engineering, data science, product, and platform leadership: to translate ML strategy into technical roadmaps

  • Define the paved paths ML teams use to ship models safely: from feature registration through canary rollout, monitoring, and rollback

What they're looking for

  • Leverage AI-augmented development tools to increase development velocity and code quality
  • + years delivering complex backend or infrastructure systems at scale
  • Direct experience building or operating core ML infrastructure: feature stores, model serving, experimentation platforms, training orchestration, or equivalent
  • Mastery of a modern backend language, ideally Java or Kotlin