Want to professionalize your AI skills, pivot to an AI role and increase your salary?
Master AI Engineering with the most practical and comprehensive LLM Development certifications at Towards AI Academy.

OpenAI

Tokens-as-a-Service (Taas) Software Engineer

OpenAI

Published 07 May 2026
San Francisco, CA, USA
$293K - $455K
Remote
Full Time

Share this job

Role Highlights

Languages used

Key skills

AI
Integrations
Distributed Systems
Information Technology
Data Security
Infrastructure
Reliability
Operations
Automation
Debugging
Optimization
Inference
Economics
Research
Deployment

Tools, Libraries and Frameworks

OpenAI
GPUs

Description

The role involves building systems that convert large-scale infrastructure capacity into measurable and reliable token throughput for workloads. Responsibilities include developing tooling to measure and monitor performance across compute environments while integrating external infrastructure into internal stacks.

Required Qualifications and Skills

The role requires a strong software engineering background with experience in building systems, tooling, automation, or infrastructure platforms. Candidates must possess experience working across compute infrastructure, distributed systems, performance engineering, or production operations. The position necessitates the ability to reason about token throughput, utilization, benchmarking, and infrastructure efficiency. Furthermore, the individual must be comfortable integrating external systems into internal infrastructure stacks and demonstrate strong analytical and debugging skills across hardware, networking, software, and operational domains.

Disclaimer

Disclaimer: Job and company description information and some of the data fields may have been generated via GPT-4 summarisation and could contain inaccuracies. The full external job listing link should always be relied on for authoritative information.

About the company

OpenAI

Size

1136

Founded

HQ

San Francisco, US

Public/Private

Partnership

Description

OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. AI is an extremely powerful tool that must be created with safety and human needs at its core. OpenAI is dedicated to putting that alignment of interests first — ahead of profit. To achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity. Our investment in diversity, equity, and inclusion is ongoing, executed through a wide range of initiatives, and championed and supported by leadership. At OpenAI, we believe artificial intelligence has the potential to help people solve immense global challenges, and we want the upside of AI to be widely shared. Join us in shaping the future of technology.

Share

Share this job

Related jobs

AI
Reinforcement Learning
ML Research
Information Technology
San Francisco, CA, USA
Full Time
AI
Integrations
Customer Success
SME
Seoul, Korea
Remote
Full Time
AI
Customer Success
Information Technology
Data Security
Bangalore, India
Remote
Full Time