The role involves establishing and leading enterprise capabilities for AI evaluation, observability, guardrails, and governance. The position focuses on defining and implementing frameworks that ensure AI and agent-based systems remain reliable, safe, explainable, and compliant with financial services regulations. Responsibilities include designing evaluation methodologies for models, building end-to-end observability frameworks, and developing safety standards to protect against prompt injection and data privacy risks. The role also entails defining governance models for autonomous agents and collaborating with cross-functional teams to align AI capabilities with strategic business priorities. Additionally, the position requires providing strategic leadership to enable responsible and scalable AI adoption across the organization.

The role requires a minimum of 15 years of overall technology experience, with at least 5 years of hands-on experience in designing and deploying AI solutions at scale within large enterprise environments. Candidates must demonstrate proficiency in implementing Generative AI, AI agent systems, and machine learning solutions in production. Necessary qualifications include experience building AI evaluation frameworks, observability platforms, and AI guardrails. A strong understanding of AI governance, model risk management, and regulatory compliance is also required.