Want to professionalize your AI skills, pivot to an AI role and increase your salary?
Master AI Engineering with the most practical and comprehensive LLM Development certifications at Towards AI Academy.

Anthropic

Staff + Sr. Software Engineer, Inference Deployment

Anthropic

Published 11 May 2026
San Francisco, CA, USA
320K - 485K USD Annual
Full Time

Share this job

Role Highlights

Languages used

Python
Rust

Key skills

Computer Science
Continuous Deployment
AI
Inference
Infrastructure
Optimization
Startup
Automation
Routing
Backend
Machine Learning
Testing
Research
Physics
Biology
Interpretability
Multimodal

Tools, Libraries and Frameworks

GPUs
TPU
CLI
HTTP

Description

The role involves designing and building deployment infrastructure to move inference code from merge to production. The engineer will focus on orchestrating validation and scheduling deployments while navigating resource constraints related to accelerator chips. The work includes improving capacity-aware scheduling and extending observability tools to track code and validation status. Additionally, the position requires driving down cycle times through pipeline architectures that minimize dependencies. The engineer will also optimize fleet rollout strategies and evolve self-service model onboarding processes.

Required Qualifications and Skills

Candidates must possess at least five years of experience in building deployment or delivery infrastructure at scale. Proficiency in Kubernetes, container orchestration, and managing complex state machines is required. The role necessitates a bachelor’s degree or an equivalent combination of education and professional experience. Strong communication skills are essential for collaborating with cross-functional teams.

Disclaimer

Disclaimer: Job and company description information and some of the data fields may have been generated via GPT-4 summarisation and could contain inaccuracies. The full external job listing link should always be relied on for authoritative information.

About the company

Anthropic

Size

265

Public/Private

Privately Held

Description

Anthropic is an AI safety and research company focused on crafting AI systems that are reliable, interpretable, and steerable, ensuring they remain safe and beneficial for users and society. With an interdisciplinary team experienced in machine learning, physics, policy, business, and product development, Anthropic is dedicated to the mission of beneficial AI. The company emphasizes collaborative big science research, leveraging a unified team approach to focus on large-scale research efforts aimed at advancing long-term goals of creating trustworthy AI systems.

Share

Share this job

Related jobs

Computer Science
Program Management
AI
Data
San Francisco, CA, USA
Full Time
Computer Science
SME
AI
Senior
Sydney, Australia
Full Time
Computer Science
Trust & Safety
LLMs
AI
New York City, NY
Full Time