Senior Software Engineer - SearchNew
The opportunity
The Applied AI team at Databricks sits at the forefront of advancing AI/ML-powered products. Databricks’ customers are continuously creating new assets (tables, notebooks, dashboards, datarooms, pipelines, sql queries, ml models etc.
What you'll do
Drive the development and deployment of ML based search and discovery: relevance models and systems integrated with Databricks' products and services.
Design and implement automated ML and NLP pipelines for data preprocessing,: query understanding and rewrite, ranking and retrieval, and model evaluation, enabling rapid experimentation and iteration.
Collaborate with product managers and cross-functional teams to drive: technology-first initiatives that enable novel business strategies and product roadmaps for the search and discovery experience.
Contribute to building a robust framework for evaluating search ranking: improvements - both offline and online.
BS+ (M.S. or PhD preferred) in Computer Science, or a related field.
+ years experience developing search relevance systems at scale in production: or in high-impact research environments.
What they're looking for
- Experience applying LLM to search relevance
- Experience in one or more of the following:
- Query understanding
- Recommendations