Want to professionalize your AI skills, pivot to an AI role and increase your salary?
Master AI Engineering with the most practical and comprehensive LLM Development certifications at Towards AI Academy.

AECOM

Software QA Lead – AI & GenAI Platforms

AECOM

Published 28 Apr 2026
Chicago, IL, USA
150K - 190K USD Annual
Full Time

Share this job

Role Highlights

Languages used

Key skills

Generative AI
Prompt Engineering
Conversational AI
Integrations
UX
CICD
Full Stack
QA
Distributed Systems
Test Automation
Automated Testing
Cloud Environments
API Testing
Infrastructure
LLMs
RAG
Frontend
Backend
Reliability
UI
NLP
Chatbot
Data
Software QA

Tools, Libraries and Frameworks

IOS
Appium
JMeter
AWS
Azure
GCP
Selenium

Description

The role involves leading the strategy and execution of quality assurance for enterprise-grade Generative AI assistant applications. The individual will own the testing, validation, and scaling of full-stack applications that utilize Large Language Models and Retrieval-Augmented Generation workflows. Responsibilities include ensuring the reliability of AI outputs, maintaining strong user experiences, and upholding ethical AI standards in production environments. The position requires designing user-centric test scenarios, conducting performance and latency testing, and building automated testing frameworks within CI/CD pipelines. Additionally, the role involves tracking quality metrics and partnering cross-functionally to embed quality assurance practices throughout the development lifecycle.

Required Qualifications and Skills

Candidates must possess a Bachelor's degree along with at least 10 years of software development experience, or a demonstrated equivalency of education and experience. Required qualifications include proven experience leading quality assurance for complex full-stack applications and expertise in testing Generative AI systems, specifically LLMs and RAG workflows. Proficiency in test automation tools such as Selenium and Appium, as well as experience with API testing and CI/CD pipelines, is necessary. Additionally, candidates should have familiarity with performance testing tools like JMeter or LoadRunner and demonstrate strong analytical and communication skills.

Disclaimer

Disclaimer: Job and company description information and some of the data fields may have been generated via GPT-4 summarisation and could contain inaccuracies. The full external job listing link should always be relied on for authoritative information.

About the company

AECOM

Size

67719

HQ

Dallas, US

Public/Private

Public Company

Description

AECOM is the world’s trusted infrastructure consulting firm, delivering professional services throughout the project lifecycle – from advisory, planning, design and engineering to program and construction management. On projects spanning transportation, buildings, water, new energy and the environment, our public- and private-sector clients trust us to solve their most complex challenges. Our teams are driven by a common purpose to deliver a better world through our unrivaled technical and digital expertise, a culture of equity, diversity and inclusion, and a commitment to environmental, social and governance priorities. AECOM is a Fortune 500 firm and its Professional Services business had revenue of $14.4 billion in fiscal year 2023. See how we are delivering sustainable legacies for generations to come at aecom.com and @AECOM.

Share

Share this job

Related jobs

Tech Lead
Integrations
QA
Technical Leadership
Bucharest, Romania
Full Time
Data Engineer
Data Analysis
Big Data
Data Processing
Bucharest, Romania
Freelancer
Infrastructure
Data
Mexico
Full Time