About this role
Job title: Staff Software Engineer - Machine Learning (Search)
About the Role The Applied AI team at Databricks sits at the forefront of advancing AI/ML-powered products. We are seeking a Staff Engineer to lead enhancements to our Search Quality, with a focus on scalable ranking, improved query understanding, and robust evaluation to enable seamless search at scale across the Databricks platform.
What You'll Do
- Drive the development and deployment of ML based search and discovery relevance models and systems integrated with Databricks' products and services.
- Design and implement automated ML and NLP pipelines for data preprocessing, query understanding and rewrite, ranking and retrieval, and model evaluation, enabling rapid experimentation and iteration.
- Collaborate with product managers and cross-functional teams to drive technology-first initiatives that enable novel business strategies and product roadmaps for the search and discovery experience.
- Contribute to building a robust framework for evaluating search ranking improvements - both offline and online.
What We're Looking For
- BS+ (M.S. or PhD preferred) in Computer Science, or a related field.
- 10+ years experience developing search relevance systems at scale in production or in high-impact research environments.
- Experience applying LLM to search relevance
- Experience in one or more of the following: Query understanding, NLP, Text mining, Recommendations, Personalization, Discovery, Conversational AI
- Strong understanding of computer science fundamentals.
- Contributions to well-used open-source projects.
Compensation & Benefits
- Comprehensive benefits and perks that meet the needs of Databricks employees; region-specific details are available.