Want to professionalize your AI skills, pivot to an AI role and increase your salary?
Master AI Engineering with the most practical and comprehensive LLM Development certifications at Towards AI Academy.

OpenAI

Software Engineer, Productivity - Inference Runtime

OpenAI

Published 12 May 2026
San Francisco, CA, USA
$230K - $385K
Full Time

Share this job

Role Highlights

Languages used

C++

Key skills

AI
Integrations
CICD
Distributed Systems
Information Technology
Data Security
Inference
API
Research
Reliability
Infrastructure
Cloud
Automation
Debugging
Deployment
Asynchronous
Testing

Tools, Libraries and Frameworks

GPUs
OpenAI

Description

The role involves supporting inference runtime teams by scaling engineering systems, safeguards, and developer workflows. The engineer will focus on improving tooling and infrastructure for deploy gates to ensure inference engine images are correct, performant, and free of regressions. Responsibilities include hardening testing infrastructure, reducing noise from flaky failures, and building automation for failure triage and debugging. The position requires working on observability, release automation, and developer self-service tools across a large-scale inference stack. The work directly impacts the ability to launch new models and ship inference optimizations safely.

Required Qualifications and Skills

Candidates must have strong experience with CI/CD systems, testing infrastructure, release tooling, developer productivity, or large-scale build and validation systems. Proficiency in Python is required as the current infrastructure is Python-based. The role requires an autonomous engineer capable of operating in ambiguous environments and collaborating across teams. No specific degree or professional qualification is mentioned as a requirement.

Disclaimer

Disclaimer: Job and company description information and some of the data fields may have been generated via GPT-4 summarisation and could contain inaccuracies. The full external job listing link should always be relied on for authoritative information.

About the company

OpenAI

Size

1136

Founded

HQ

San Francisco, US

Public/Private

Partnership

Description

OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. AI is an extremely powerful tool that must be created with safety and human needs at its core. OpenAI is dedicated to putting that alignment of interests first — ahead of profit. To achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity. Our investment in diversity, equity, and inclusion is ongoing, executed through a wide range of initiatives, and championed and supported by leadership. At OpenAI, we believe artificial intelligence has the potential to help people solve immense global challenges, and we want the upside of AI to be widely shared. Join us in shaping the future of technology.

Share

Share this job

Related jobs

AI
Integrations
CICD
Distributed Systems
San Francisco, CA, USA
Full Time
AI
Reinforcement Learning
Prompt Engineering
Information Technology
Sydney, Australia
Full Time
AI
Data Engineer
Machine Learning
Data Science
San Francisco, CA, USA
Remote
Full Time