About this role
About the Role As a Search Quality Engineer, you sit at the heart of this transformation. You aren't just building a search engine; you are building the contextual backbone of the entire company.
What You'll Do
- Own the quality of search results for two connected users: AI Agents and Human Users, optimizing both retrieval and relevance.
- Tackle Hybrid Retrieval by balancing traditional keyword search with semantic vector search.
- Develop and fine-tune ranking models to satisfy both human readability and LLM-ready context.
- Build guardrails and relevance scoring to keep AI grounded in reality, especially in high-stakes scenarios.
- Address data heterogeneity by connecting structured SQL data, unstructured docs, and real-time metrics.
- Collaborate with teams across Databricks to deploy robust IR/RAG solutions.
What We're Looking For
- The IR Specialist: strong knowledge of Lucene/Elasticsearch, embeddings, and ranking algorithms.
- The Quality and Metrics Obsessive: experience designing evaluation frameworks (human-in-the-loop and LLM-based) and measuring relevance using metrics like nDCG, MRR, and Precision@K.
- The Bridge Builder: excitement for applying traditional IR wisdom to Retrieval-Augmented Generation (RAG).
Compensation & Benefits
- Benefits: Databricks provides comprehensive benefits and perks; region-specific details can be found on our benefits page.
- Diversity & Inclusion: We are committed to fostering a diverse and inclusive culture where everyone can excel, and our hiring practices meet equal employment opportunity standards.