Senior Software Engineer - SearchNew

The opportunity

The Applied AI team at Databricks sits at the forefront of advancing AI/ML-powered products. Databricks’ customers are continuously creating new assets (tables, notebooks, dashboards, datarooms, pipelines, sql queries, ml models etc.

What you'll do

  • Drive the development and deployment of ML based search and discovery: relevance models and systems integrated with Databricks' products and services.

  • Design and implement automated ML and NLP pipelines for data preprocessing,: query understanding and rewrite, ranking and retrieval, and model evaluation, enabling rapid experimentation and iteration.

  • Collaborate with product managers and cross-functional teams to drive: technology-first initiatives that enable novel business strategies and product roadmaps for the search and discovery experience.

  • Contribute to building a robust framework for evaluating search ranking: improvements - both offline and online.

  • BS+ (M.S. or PhD preferred) in Computer Science, or a related field.

  • + years experience developing search relevance systems at scale in production: or in high-impact research environments.

What they're looking for

  • Experience applying LLM to search relevance
  • Experience in one or more of the following:
  • Query understanding
  • Recommendations