The role involves designing, building, and operating critical API infrastructure to support generative AI initiatives. The individual will manage the API lifecycle for canonical large language model endpoints across cloud and on-premise environments. Responsibilities include optimizing enterprise AI gateway operations, such as token streaming, rate limiting, and capacity planning. The position requires building and orchestrating intelligent agent workflows. Additionally, the role entails establishing observability frameworks to monitor latency, token usage, and overall API health.

The role requires advanced proficiency in Python backend development and deep experience in API design and lifecycle management specifically for large language model use cases. Candidates must have hands-on experience managing AI gateways and working with agent orchestration frameworks. Furthermore, the position necessitates a strong background in implementing enterprise-grade security protocols including OAuth2 and mTLS. The ability to build asynchronous and batch-processing architectures is also required.