Want to professionalize your AI skills, pivot to an AI role and increase your salary?
Master AI Engineering with the most practical and comprehensive LLM Development certifications at Towards AI Academy.

SAP

AI Governance Architect (f/m/d)

SAP

Published 10 Mar 2026
Garching bei Munchen, Germany
Part Time
Full Time

Share this job

Role Highlights

Languages used

Python

Key skills

ML Ops
Computer Science
Integrations
API
CICD
ERP
AI
Infrastructure
Architecture
Machine Learning
Cloud
Containers
Automation
Database
Operations
Software Design

Tools, Libraries and Frameworks

SAP
NIST
AWS
Azure
GCP
Ruby On Rails

Description

\\\\We help the world run better\\\\ At SAP, we keep it simple: you bring your best to us, and we'll bring out the best in you. We're builders touching over 20 industries and 80% of global commerce, and we need your unique talents to help shape what's next. The work is challenging but it matters. You'll find a place where you can be yourself, prioritize your wellbeing, and truly belong. What's in it for you? Constant learning, skill growth, great benefits, and a team that wants you to grow and succeed. \\\\What you\\\`ll do\\\\ Summary: We are seeking an AI Governance Architect with strong hands-on AI & software development experience to build and implement SAP's internal AI governance infrastructure. This is a unique opportunity to combine your software engineering expertise with AI governance architecture, creating technical solutions that embed compliance, transparency, and trust directly into SAP's AI development lifecycle. The Role: As an AI Governance Architect, you will design and develop the technical infrastructure that powers SAP's internal AI Governance Platform, ensuring seamless integration across the full AI lifecycle. You will build automated governance workflows, develop monitoring and compliance tracking systems, and implement technical controls that align with the EU AI Act, ISO 42001, and NIST RMF. Working hands-on with code, you will architect APIs and integrations that connect governance capabilities with AI/ML pipelines, develop automated risk assessment tools, and create dashboards for real-time monitoring. Collaborating closely with AI Engineers, MLOps teams, and Compliance specialists, you will translate governance requirements into robust technical implementations. Your work will include building evidence collection mechanisms, implementing model registry integrations, developing audit trails, and creating tools that make governance invisible yet effective for development teams. You will also contribute to platform onboarding, technical documentation, and knowledge transfer, ensuring SAP maintains its leadership position in responsible Enterprise AI through superior technical execution. \\\\What you bring\\\\ You are a hands-on technologist passionate about AI governance, with experience building AI/ML solutions and governance tooling in enterprise environments. You hold a masters in computer science or a related field and have 3 years of experience deploying AI/ML models in production. You bring strong Python and cloud skills (AWS/Azure/GCP), along with expertise in APIs, MLOps, monitoring, and observability. You understand the full ML lifecycle and key regulatory frameworks (EU AI Act, ISO 42001, NIST RMF). You work confidently with cloud-native architectures, containers, CI/CD, and orchestration. You communicate clearly (English / German), translate governance needs into technical solutions, and balance compliance with developer efficiency through automation. \\\\Meet your team\\\\ Join SAP's Enterprise AI CoEwhere innovators shape, govern, and scale AI. We drive the latest AI solutions, empower colleagues worldwide, and set the standard for responsible, enterprise-ready AI. \\#LI-SGSAP \\\\Bring out your best\\\\ SAP innovations help more than four hundred thousand customers worldwide work together more efficiently and use business insight more effectively. Originally known for leadership in enterprise resource planning (ERP) software, SAP has evolved to become a market leader in end-to-end business application software and related services for database, analytics, intelligent technologies, and experience management. As a cloud company with two hundred million users and more than one hundred thousand employees worldwide, we are purpose-driven and future-focused, with a highly collaborative team ethic and commitment to personal development. Whether connecting global industries, people, or platforms, we help ensure every challenge gets the solution it deserves. At SAP, you can bring out your best. \\\\We win with inclusion\\\\ SAPs culture of inclusion, focus on health and well-being, and flexible working models help ensure that everyone regardless of background feels included and can run at their best. At SAP, we believe we are made stronger by the unique capabilities and qualities that each person brings to our company, and we invest in our employees to inspire confidence and help everyone realize their full potential. We ultimately believe in unleashing all talent and creating a better world. SAP is committed to the values of Equal Employment Opportunity and provides accessibility accommodations to applicants with physical and/or mental disabilities. If you are interested in applying for employment with SAP and are in need of accommodation or special assistance to navigate our website or to complete your application, please send an e-mail with your request to Recruiting Operations Team: . For SAP employees: Only permanent roles are eligible for the SAP Employee Referral Program () , according to the eligibility rules set in the SAP Referral Policy. Specific conditions may apply for roles in Vocational Training. \\\\AI Usage in the Recruitment Process\\\\ For information on the responsible use of AI in our recruitment process, please refer to our Guidelines for Ethical Usage of AI in the Recruiting Process () . Please note that any violation of these guidelines may result in disqualification from the hiring process. Requisition ID: 447838 \\\| Work Area: Software-Design and Development \\\| Expected Travel: 0 - 10% \\\| Career Status: Professional \\\| Employment Type: Part Time or Regular Full Time \\\| #LI-Hybrid

Required Qualifications and Skills

The role requires a hands-on technologist with experience in building AI/ML solutions and governance tooling in enterprise environments. A Master's degree in computer science or a related field is necessary, along with three years of experience deploying AI/ML models in production. Strong Python and cloud skills (AWS/Azure/GCP) are essential, as is expertise in APIs, MLOps, monitoring, and observability. Understanding of the full ML lifecycle and key regulatory frameworks like the EU AI Act, ISO 42001, and NIST RMF is required. Proficiency with cloud-native architectures, containers, CI/CD, and orchestration is also expected.

Disclaimer

Disclaimer: Job and company description information and some of the data fields may have been generated via GPT-4 summarisation and could contain inaccuracies. The full external job listing link should always be relied on for authoritative information.

About the company

SAP

Size

111344

HQ

Walldorf, DE

Public/Private

Public Company

Description

SAP is a global leader in business application software with a commitment to innovation, helping over 400,000 customers worldwide improve efficiency and business insight. As a cloud company with 200 million users and more than 100,000 employees, SAP focuses on end-to-end solutions in database, analytics, intelligent technologies, and experience management. With a culture of collaboration and personal development, SAP aims to inspire confidence and realize the full potential of its employees. The commitment to inclusion, health, well-being, and flexible working models ensures every team member can perform at their best, supporting SAP's vision of creating a more equitable world through technology.

Share

Share this job

Related jobs

Computer Science
UI
ERP
SAP
Brno, Czech Republic
Full Time
AI
Data Architect
Prompt Engineering
Computer Science
Garching bei Munchen, Germany
Full Time
Computer Science
Product Management
CICD
IAC
Berlin, Germany
Part Time
Full Time