Staff Software Engineer, AI RuntimeActive$190K
The opportunity
At Databricks, we run the world's largest AI platform. We believe the next breakthroughs will come from models trained on domain-specific enterprise data, not from bigger general-purpose models alone.
What you'll do
Drive major parts of AI Runtime's architecture and help shape Databricks': long-term technical direction in AI training infrastructure.
Design the reliability and observability systems for a fleet that keeps growing in scale and complexity.
Lead improvements to AI Runtime's developer experience for people and agents,: so even the largest training jobs feel as simple as a first experiment.
Help choose the technical bets that prepare AI Runtime for new GPU generations and workload types.
Take on the hardest multi-node training problems yourself, from orchestration: and GPU scheduling to data loading and checkpointing.
Make training faster and cheaper by raising efficiency across model architectures and GPU accelerators.
What they're looking for
- Work with research, product, and customers to shape what we build next and lead projects across teams.
- Champion engineering excellence, raise the bar, and mentor the engineers around you.
- + years in large-scale distributed systems, with significant depth in GPU: training, high-performance computing, or ML systems.
- Hands-on experience training large models with FSDP, DeepSpeed, or Megatron,: and fluency in parallelism strategies.