Senior Software Engineer, Compute InfrastructureActive$164K
The opportunity
Multi-cloud is core to Databricks product strategy. Compute serves as the layer that abstracts the cloud from the rest of the company.
What you'll do
Design and build the next generation of our Serverless platform, focusing on: high availability, low latency, and scale-to-zero efficiency.
Build a single compute stack that supports heterogeneous workloads, including: GPU instance qualification for AI training and stateful execution for Lakebase.
Solve Multi-Cloud Complexity: Develop platform-level abstractions that allow Databricks to run seamlessly across all major cloud providers.
Optimize everything from the API gateway down to the host-level networking and container orchestration.
Work alongside industry experts who have built world-class systems like Borg,: Kubernetes, and Uber’s infrastructure.
What they're looking for
- + years of production-level experience in one of: Python, Java, Scala, C++, or a similar language
- + years of experience developing large-scale distributed systems from scratch
- Experience with Kubernetes, Docker, or MicroVM technologies (e.g.,: Firecracker) and a strong grasp of cloud provider internals (AWS/Azure/GCP).
- You aren't just a user of tools; you understand how to build them from the: ground up when existing solutions fail at our scale.
