Senior Staff Software Engineer - Lakeflow Pipelines DatasetsActive$229K
The opportunity
Databricks builds the world's leading data and AI platform, used by tens of thousands of organizations to turn raw data into decisions that matter.
What you'll do
Declarative Dataflow Processing
Resource management
Efficient storage structures
Stream Processing and Complex Event Processing
Autonomic Computing and Self-Managing Systems
Architect and deliver a highly scalable, fault-tolerant platform for: declarative pipelines and materialized views serving thousands of production customers.
What they're looking for
- Turn ambiguous, large-scale technical challenges into clear execution plans: that ship incrementally and hold up at exabyte scale.
- Bridge the gap between research and production by bringing ideas from the: academic literature or internal R&D into systems that solve real customer problems.
- Lead deep systems work: performance diagnosis on large production clusters, low-level debugging, and optimization that moves the needle on cost and latency.
- Shape product direction alongside engineering and product leadership, owning: technical strategy from design through delivery.