Senior Staff Software Engineer - Lakeflow Pipelines DatasetsActive$229K

The opportunity

Databricks builds the world's leading data and AI platform, used by tens of thousands of organizations to turn raw data into decisions that matter.

What you'll do

  • Declarative Dataflow Processing

  • Resource management

  • Efficient storage structures

  • Stream Processing and Complex Event Processing

  • Autonomic Computing and Self-Managing Systems

  • Architect and deliver a highly scalable, fault-tolerant platform for: declarative pipelines and materialized views serving thousands of production customers.

What they're looking for

  • Turn ambiguous, large-scale technical challenges into clear execution plans: that ship incrementally and hold up at exabyte scale.
  • Bridge the gap between research and production by bringing ideas from the: academic literature or internal R&D into systems that solve real customer problems.
  • Lead deep systems work: performance diagnosis on large production clusters, low-level debugging, and optimization that moves the needle on cost and latency.
  • Shape product direction alongside engineering and product leadership, owning: technical strategy from design through delivery.