Staff Software Engineer - Database Engine InternalsActive

The opportunity

Our mission at Databricks is to radically simplify the whole data lifecycle from ingestion to ETL, BI, and all the way up to ML/AI with a unified platform. To achieve this goal, we believe the data warehouse architecture as we know it today will be replaced by a new…

What you'll do

  • Query compilation and optimization

  • Distributed query execution and scheduling

  • Vectorized execution engine

  • Data security

  • Resource management

  • Transaction coordination

What they're looking for

  • Efficient storage structures (encodings, indexes)
  • Automatic physical data optimization
  • Drive requirements clarity and design decisions for ambiguous problems
  • Produce technical design documents and project plans