Lead Data EngineerActive$46K–$183K

The opportunity

Elastic, the Search AI Company, enables everyone to find the answers they need in real time, using all their data, at scale — unleashing the potential of businesses and people. The Elastic Search AI Platform, used by more than 50% of the Fortune 500, brings together the…

What you'll do

  • Monitor and refine pipeline performance and refine processes to keep things running smoothly.

  • Use Terraform to provision and manage resources on Google Cloud Platform (GCP).

  • Help steward the platform by reviewing code and ensuring good practices and standard processes are followed.

  • Process access requests and support compliance with platform policies.

  • + years of experience in data engineering or related roles

  • Experience with Apache Airflow for orchestrating data workflows

What they're looking for

  • Experience with Spark, Flink, Kafka, and dbt Labs for data processing and transformation
  • Understanding of Apache Iceberg for data table formats and data warehouse and lakehouse strategies
  • Skilled in using Terraform for infrastructure-as-code deployments
  • Proficient in programming languages, particularly Bash, Python, and SQL