Want to professionalize your AI skills, pivot to an AI role and increase your salary?
Master AI Engineering with the most practical and comprehensive LLM Development certifications at Towards AI Academy.

Palo Alto Networks

Principal Tools, Automation & Testing Engineer

Palo Alto Networks

Published 09 May 2026
Santa Clara, CA, USA
147K - 238K USD Annual
Full Time

Share this job

Role Highlights

Languages used

Python

Key skills

Prompt Engineering
Machine Learning
Computer Science
API
CICD
Distributed Systems
Software Design
Data Structures
QA Automation
LLMs
AI
Testing
Regression
DataSets
Cloud

Tools, Libraries and Frameworks

IOS
PyTest
OpenAI
AWS
GCP
Azure
Langchain

Description

The role involves designing and developing testing frameworks specifically for AI/ML models and LLM applications. The individual will build automated pipelines to facilitate model validation, regression testing, and benchmarking. Responsibilities include creating evaluation datasets, synthetic data, and test scenarios to address edge cases. The position requires implementing metrics to assess model accuracy, robustness, latency, and safety. Additionally, the role entails developing tools for prompt testing, output validation, and hallucination detection while monitoring model performance in production.

Required Qualifications and Skills

Candidates must possess a Bachelor’s or Master’s degree in Computer Science, AI, Machine Learning, or a related field. A minimum of 8 years of experience in software engineering, QA automation, or ML engineering is required. Applicants need strong programming skills, specifically in Python, and familiarity with testing frameworks and machine learning evaluation techniques. Proficiency in working with APIs, distributed systems, and CI/CD pipelines is also necessary.

Disclaimer

Disclaimer: Job and company description information and some of the data fields may have been generated via GPT-4 summarisation and could contain inaccuracies. The full external job listing link should always be relied on for authoritative information.

About the company

Palo Alto Networks

Size

14705

Founded

HQ

SANTA CLARA, US

Public/Private

Public Company

Description

Palo Alto Networks, the global cybersecurity leader, is shaping the cloud-centric future with technology that is transforming the way people and organizations operate. Our mission is to be the cybersecurity partner of choice, protecting our digital way of life. We help address the world's greatest security challenges with continuous innovation that seizes the latest breakthroughs in artificial intelligence, analytics, automation, and orchestration. By delivering an integrated platform and empowering a growing ecosystem of partners, we are at the forefront of protecting tens of thousands of organizations across clouds, networks, and mobile devices. Our vision is a world where each day is safer and more secure than the one before. For more information, visit www.paloaltonetworks.com.

Share

Share this job

Related jobs

Data Engineer
Data Architect
Data Lakes
Prompt Engineering
Israel
Full Time
Prompt Engineering
Machine Learning
Computer Science
API
Santa Clara, CA, USA
Full Time
Palo Alto Networks

Principal Software Engineer

Palo Alto Networks

Computer Science
API
CICD
Distributed Systems
Santa Clara, CA, USA
Full Time