Want to professionalize your AI skills, pivot to an AI role and increase your salary?
Master AI Engineering with the most practical and comprehensive LLM Development certifications at Towards AI Academy.

OpenAI

Software Engineer, Inference - Performance Optimization

OpenAI

Published 07 May 2026
San Francisco, CA, USA
$295K - $555K
Full Time

Share this job

Role Highlights

Languages used

Key skills

AI
Distributed Systems
Information Technology
Data Security
Inference
Infrastructure
Optimization
Research
Deployment

Tools, Libraries and Frameworks

OpenAI

Description

The role involves analyzing inference stack performance across application, model, and fleet layers to identify bottlenecks and improve efficiency. Responsibilities include building performance models, creating cost-to-serve estimates, and developing tools to assist cross-functional teams in evaluating latency and capacity tradeoffs.

Required Qualifications and Skills

The role requires deep expertise in performance profiling, benchmarking, analysis, and optimization. Candidates should be comfortable reasoning from first principles regarding distributed systems, model inference, and hardware efficiency. Proficiency is needed in working across various abstraction layers, ranging from application behavior to kernels, accelerators, networking, and fleet scheduling. No specific degree or professional qualifications are mentioned in the posting.

Disclaimer

Disclaimer: Job and company description information and some of the data fields may have been generated via GPT-4 summarisation and could contain inaccuracies. The full external job listing link should always be relied on for authoritative information.

About the company

OpenAI

Size

1136

Founded

HQ

San Francisco, US

Public/Private

Partnership

Description

OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. AI is an extremely powerful tool that must be created with safety and human needs at its core. OpenAI is dedicated to putting that alignment of interests first — ahead of profit. To achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity. Our investment in diversity, equity, and inclusion is ongoing, executed through a wide range of initiatives, and championed and supported by leadership. At OpenAI, we believe artificial intelligence has the potential to help people solve immense global challenges, and we want the upside of AI to be widely shared. Join us in shaping the future of technology.

Share

Share this job

Related jobs

AI
Data Engineer
Data Architect
Data Infrastructure
Seattle, WA, USA
Remote
Full Time
AI
API
Information Technology
Data Security
Singapore
Remote
Full Time
AI
Integrations
Product Management
Information Technology
San Francisco, CA, USA
Remote
Full Time