Found.dev
Role Highlights
Languages used
SQL
Key skills
Information Retrieval
LLMs
Data
AI
Search
Transformation
Interfaces
Embeddings
RAG
Tools, Libraries and Frameworks
DOTS
Elasticsearch
DataBricks
MLFlow
Apache Spark
Ruby On Rails
Description
The individual in this role manages the quality of search results for both human users and AI agents. The position involves optimizing retrieval layers to provide accurate context for large language models and improving search interfaces for employees. Responsibilities include balancing keyword-based search with semantic vector search and fine-tuning ranking models. The role requires building guardrails and relevance scoring systems to ensure AI outputs remain grounded in reality. Additionally, the work involves connecting data across structured tables, unstructured documents, and real-time business metrics.
Required Qualifications and Skills
The role requires expertise in Information Retrieval, specifically regarding Lucene, Elasticsearch, embeddings, and ranking algorithms. Candidates must possess a strong focus on quality and metrics, with the ability to build human-in-the-loop and LLM-based evaluation frameworks. Proficiency in relevance metrics such as nDCG, MRR, and Precision@K is necessary. The position also requires the ability to apply traditional Information Retrieval wisdom to Retrieval-Augmented Generation. No specific degree or professional qualifications are mentioned in the text.
Disclaimer
Disclaimer: Job and company description information and some of the data fields may have been generated via GPT-4 summarisation and could contain inaccuracies. The full external job listing link should always be relied on for authoritative information.
About the company
Databricks
Size
8632
HQ
San Francisco, US
Public/Private
Privately HeldDescription
Databricks is the data and AI company. More than 10,000 organizations worldwide including Comcast, Condé Nast, Grammarly, and over 50% of the Fortune 500 rely on the Databricks Data Intelligence Platform to unify and democratize data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark, Delta Lake and MLflow. --- Attention: Databricks applicants Due to reports of phishing, were requesting that all Databricks applicants apply through our official Careers page at databricks.com/company/careers (good news you are here). All official communication from Databricks will come from email addresses ending with @databricks.com or @goodtime.io (our meeting tool).
Related jobs
Sr. Solutions Engineer
Databricks
Apache Spark
Big Data
Data Science
Solution Architect
Zurich, Switzerland
Full Time
Named Enterprise Account Executive
Databricks
Apache Spark
Customer Success
GCP
Data
Stockholm, Sweden
Full Time
Apache Spark
Open Source
GCP
Data
London, UK
Full Time