Want to professionalize your AI skills, pivot to an AI role and increase your salary?
Master AI Engineering with the most practical and comprehensive LLM Development certifications at Towards AI Academy.

Databricks

Staff Software Engineer, Model Serving

Databricks

Published 11 May 2026
San Francisco, CA, USA
192K - 260K USD Annual
Full Time

Share this job

Role Highlights

Languages used

Key skills

API
Distributed Systems
Data Structures
System Design
Staff Engineer
LLMs
AI
Infrastructure
Machine Learning
Fine Tuning
Inference
CPU
Research
Reliability
Architecture
Deployment
Routing
Operations
Testing

Tools, Libraries and Frameworks

DataBricks
GPUs
MLFlow
Apache Spark

Description

The role involves designing and building core systems and APIs to support a model serving platform. The individual will focus on creating infrastructure that enables high-throughput and low-latency inference for both CPU and GPU workloads. Responsibilities include defining technical roadmaps, driving architectural decisions, and optimizing performance for scalability and reliability. The position requires collaborating with cross-functional teams to translate customer needs into performant systems. Additionally, the role entails establishing best practices for code quality and mentoring other engineers.

Required Qualifications and Skills

Candidates must possess at least 10 years of experience in building and operating large-scale distributed systems. Deep expertise in model serving, inference systems, and related infrastructure components such as routing and observability is required. Applicants should demonstrate a strong foundation in algorithms, data structures, and system design. Furthermore, the role requires a proven ability to lead architecture for performance-sensitive CPU and GPU inference systems.

Disclaimer

Disclaimer: Job and company description information and some of the data fields may have been generated via GPT-4 summarisation and could contain inaccuracies. The full external job listing link should always be relied on for authoritative information.

About the company

Databricks

Size

8632

HQ

San Francisco, US

Public/Private

Privately Held

Description

Databricks is the data and AI company. More than 10,000 organizations worldwide including Comcast, Condé Nast, Grammarly, and over 50% of the Fortune 500 rely on the Databricks Data Intelligence Platform to unify and democratize data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark, Delta Lake and MLflow. --- Attention: Databricks applicants Due to reports of phishing, were requesting that all Databricks applicants apply through our official Careers page at databricks.com/company/careers (good news you are here). All official communication from Databricks will come from email addresses ending with @databricks.com or @goodtime.io (our meeting tool).

Share

Share this job

Related jobs

Apache Spark
Big Data
Data Science
Solution Architect
Zurich, Switzerland
Full Time
Apache Spark
Customer Success
GCP
Data
Stockholm, Sweden
Full Time
Apache Spark
Open Source
GCP
Data
London, UK
Full Time