Staff Software Engineer, Lakeflow Pipelines DRNew$192K
The opportunity
Our mission at Databricks is to radically simplify the data lifecycle with a unified Lakehouse platform for data engineering, analytics, and AI. The Lakehouse addresses major challenges in enterprise data platforms, including reliability, data staleness, operational complexity,…
What you'll do
Cross-region replication and recovery for Lakeflow pipelines, streaming tables, and materialized views
Distributed consistency across pipeline dependencies, table versions, and transaction logs
Failover and failback workflows with conservative correctness guardrails
Deep clone, metadata reconciliation, observability, and failure-injection testing
High-fidelity recovery simulations, game-day testing, and formal reasoning about failure modes
A passion for distributed systems, databases, storage systems, streaming systems, or reliability engineering
What they're looking for
- Strong software engineering skills in Java, Scala, C++, Go, Python, or a similar production language
- Understanding of consistency, transactions, idempotency, replication, checkpointing, and data lineage
- Ability to define and work toward a multi-year technical vision with: incremental, production-quality deliverables
- + years of experience working on related systems preferred
