Want to professionalize your AI skills, pivot to an AI role and increase your salary?
Master AI Engineering with the most practical and comprehensive LLM Development certifications at Towards AI Academy.

Palo Alto Networks

:Principal AI Test Engineer - Prisma Access

Palo Alto Networks

Published 19 Mar 2026
Santa Clara, CA, USA
147K - 238K USD Annual
Remote
Full Time
Freelancer

Share this job

Role Highlights

Languages used

Python
GO

Key skills

Prompt Engineering
Vector Database
Knowledge Graphs
Computer Science
Integrations
Product Management
UX
CICD
Distributed Systems
Electrical Engineering
System Design
Technical Leadership
Test Automation
Test Engineer
Software Testing
API Testing
Penetration Testing
Security Testing
AI
QA
Browser
LLMs
Reliability
Regression
Infrastructure
Deployment
RAG
Cloud
Machine Learning
SRE
Multimodal
UI
Microservices
Architecture
Devops

Tools, Libraries and Frameworks

Rest
IOS
Prometheus
Grafana
Splunk
AWS
Azure
GCP
Terraform
Jira
LLamaindex
Langchain
Selenium
Puppeteer

Description

\\\\Our Mission\\\\ At Palo Alto Networks®, were united by a shared missionto protect our digital way of life. We thrive at the intersection of innovation and impact, solving real-world problems with cutting-edge technology and bold thinking. Here, everyone has a voice, and every idea counts. If youre ready to do the most meaningful work of your career alongside people who are just as passionate as you are, youre in the right place. \\\\Who We Are\\\\ In order to be the cybersecurity partner of choice, we must trailblaze the path and shape the future of our industry. This is something our employees work at each day and is defined by our values: Disruption, Collaboration, Execution, Integrity, and Inclusion. We weave AI into the fabric of everything we do and use it to augment the impact every individual can have. If you are passionate about solving real-world problems and ideating beside the best and the brightest, we invite you to join us! We believe collaboration thrives in person. Thats why most of our teams work from the office full time, with flexibility when its needed. This model supports real-time problem-solving, stronger relationships, and the kind of precision that drives great outcomes. \\\\Job Summary\\\\ \\\\Your Career\\\\ We are seeking an AI-savvy Principal QA Test Engineer to transform how we test and validate Prisma Access Add-on Services (Remote Browser Isolation, Application Acceleration, Application Security, and Privileged Remote Access). As a technical leader, you will design and implement autonomous QA workflows that leverage AI to achieve unprecedented test coverage, efficiency, and defect detection. You will take ownership of quality outcomes, mentor teams, and drive innovation in how we approach testing at scale. YOUR IMPACT \\\\AI-Driven Testing & Autonomous Workflows\\\\ \\\ Design and implement autonomous QA workflows using AI agents and LLM-based testing frameworks to achieve continuous, intelligent test execution \\\ Build AI-powered test generation systems that automatically create comprehensive test suites from requirements, specifications, and production telemetry \\\ Develop intelligent test oracles using LLMs to validate complex system behaviors, API responses, and user experiences beyond traditional assertions \\\ Create AI-assisted defect prediction and prevention systems that proactively identify reliability and security risks before they reach production \\\ Implement agentic testing workflows that autonomously explore application state spaces, identify edge cases, and generate regression tests \\\\Quality Engineering & Measurable Outcomes\\\\ \\\ Own and drive key quality metrics: Defect Containment Effectiveness (DCE >95%), Customer Found Regression (CFR <5%), and Automation Defect Detection Ratio (ADDR >30%) \\\ Lead root cause analysis (RCA) for production incidents and customer-found defects, implementing durable fixes that reduce MTTR and defect escape rates \\\ Drive systematic quality improvements through data-driven insights, reducing vulnerability remediation time and production incident frequency \\\ Participate in system design to ensure quality, observability, and testability are built-in throughout the Prisma Access feature development lifecycle \\\\Test Infrastructure & Platform Development\\\\ \\\ Develop and enhance AI-augmented test infrastructure that enables scalable, flexible, and context-aware testing reflecting real-world deployment scenarios \\\ Build RAG (Retrieval-Augmented Generation) pipelines for test knowledge bases, enabling intelligent test selection and prioritization \\\ Design shared testing platforms and patterns for multi-dimensional testing: functional, scale, performance, resiliency, security, and chaos engineering \\\ Integrate AI models and prompts into CI/CD pipelines for continuous quality assessment and intelligent test orchestration \\\\Technical Leadership & Collaboration\\\\ \\\ Provide technical leadership in browser security, cloud orchestration, distributed systems, and AI-assisted quality engineering \\\ Mentor and upskill team members on AI/ML testing techniques, prompt engineering for test automation, and modern quality practices \\\ Collaborate with Development, SRE, Product Management, and Technical Marketing to align quality strategy with business outcomes \\\ Lead design discussions and articulate technical trade-offs clearly to cross-functional stakeholders \\\\Continuous Learning & Innovation\\\\ \\\ Stay current with AI/ML advancements and translate them into practical testing innovations (e.g., agentic workflows, multimodal testing, AI-powered observability) \\\ Experiment with emerging AI testing tools and frameworks; share findings and drive team adoption of proven practices \\\ Leverage customer deployment data and telemetry to enhance test strategies and improve CFD efficacy \\\\Qualifications\\\\ \\\\Your Experience\\\\ 10+ years of experience in QA/Test Automation Engineering with demonstrated impact on product quality and team practices \\\ 3+ years of hands-on experience with AI/ML technologies, including LLMs, prompt engineering, and AI-assisted development workflows \\\ Proven track record of building autonomous testing systems or AI-powered quality engineering tools \\\ Deep expertise in cybersecurity, cloud networking, or distributed systems testing \\\ Strong proficiency in Python and/or Go for test automation and AI workflow development \\\ Experience with LLM frameworks (LangChain, LlamaIndex, AutoGen) and AI model integration \\\ Expertise in REST API testing, web UI automation (Selenium, Playwright, Puppeteer), and cloud-native application testing \\\\Technical Skills\\\\ \\\ Hands-on experience with AI-powered test generation, intelligent test selection, and autonomous test execution \\\ Experience building RAG pipelines, vector databases, and knowledge graphs for test intelligence \\\ Strong understanding of prompt engineering, few-shot learning, and fine-tuning for testing use cases \\\ Proficiency with observability platforms (Prometheus, Grafana, Splunk) and log analysis using AI \\\ Experience with cloud providers (AWS, Azure, GCP) and infrastructure-as-code (Terraform, CloudFormation) \\\ Knowledge of microservices architecture, distributed systems testing, and performance optimization \\\ Experience with test management systems (TestRail) and defect tracking (JIRA) \\\\Preferred Experience\\\\ \\\ Experience with browser security solutions: enterprise browsers, remote browser isolation, browser extensions \\\ Background in building AI agents for software testing or autonomous DevOps workflows \\\ Experience with multi-agent systems and orchestration frameworks \\\ Knowledge of security testing, penetration testing, or vulnerability assessment automation \\\ Contributions to open-source testing frameworks or AI/ML testing tools \\\ Experience measuring and improving quality metrics (DCE, CFR, ADDR, MTTR, defect escape rate) Education \\\ M.S./B.S. degree in Computer Science, Electrical Engineering, or equivalent military experience required EXPECTATIONS AT PRINCIPAL LEVEL Scope & Complexity \\\ Given ambiguous goals (reduce customer-found defects, improve test coverage), you independently define the problem, build comprehensive plans, and deliver measurable outcomes \\\ Own service-level quality outcomes across multiple Prisma Access add-on services \\\ Lead multi-team quality initiatives and manage dependencies across Engineering, Product, and SRE Technical Depth \\\ Anticipate subtle failures in complex, AI-assisted systems; proactively audit for security gaps and reliability risks \\\ Design test architectures that span multiple services and define API testing contracts \\\ Integrate AI context pipelines into testing workflows; tune models and prompts for accuracy and latency Leadership & Influence \\\ Mentor junior and mid-level engineers on AI testing practices and quality engineering \\\ Lead adoption of new testing practices (e.g., agentic workflows, AI-assisted RCA) and measure impact \\\ Collaborate effectively across teams and influence peers without authority to align on quality standards Time Horizon & Impact \\\ Focus extends beyond immediate execution to the operational roadmap and lifecycle of testing services \\\ Drive improvements that compound over multiple release cycles, measurably improving quality metrics quarter over quarter \\\\Compensation Disclosure\\\\ The compensation offered for this position will depend on qualifications, experience, and work location. For candidates who receive an offer at the posted level, the starting base salary (for non-sales roles) or base salary + commission target (for sales/com-missioned roles) is expected to be the annual range listed below. The offered compensation may also include restricted stock units and a bonus. A description of our employee benefits may be found here () . $147,000.00 - $237,500.00/yr \\\\Our Commitment\\\\* Were trailblazers that dream big, take risks, and challenge cybersecuritys status quo. Its simple: we cant accomplish our mission without diverse teams innovating, together. We are committed to providing reasonable accommodations for all qualified individuals with a disability. If you require assistance or accommodation due to a disability or special need, please contact us at . Palo Alto Networks is an equal opportunity employer. We celebrate diversity in our workplace, and all qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or other legally protected characteristics. All your information will be kept confidential according to EEO guidelines. Is role eligible for Immigration Sponsorship?: Yes

Required Qualifications and Skills

The role requires over 10 years of experience in QA/Test Automation Engineering with a proven impact on product quality and team practices. A minimum of 3 years of hands-on experience with AI/ML technologies, including LLMs and prompt engineering, is necessary. Candidates must demonstrate a track record of building autonomous testing systems or AI-powered quality engineering tools. Deep expertise in cybersecurity, cloud networking, or distributed systems testing is essential. Proficiency in Python and/or Go for test automation and AI workflow development is required, along with experience in LLM frameworks and AI model integration. Expertise in REST API testing, web UI automation, and cloud-native application testing is also a requirement. A Bachelor's or Master's degree in Computer Science, Electrical Engineering, or equivalent military experience is required.

Disclaimer

Disclaimer: Job and company description information and some of the data fields may have been generated via GPT-4 summarisation and could contain inaccuracies. The full external job listing link should always be relied on for authoritative information.

About the company

Palo Alto Networks

Size

14705

Founded

HQ

SANTA CLARA, US

Public/Private

Public Company

Description

Palo Alto Networks, the global cybersecurity leader, is shaping the cloud-centric future with technology that is transforming the way people and organizations operate. Our mission is to be the cybersecurity partner of choice, protecting our digital way of life. We help address the world's greatest security challenges with continuous innovation that seizes the latest breakthroughs in artificial intelligence, analytics, automation, and orchestration. By delivering an integrated platform and empowering a growing ecosystem of partners, we are at the forefront of protecting tens of thousands of organizations across clouds, networks, and mobile devices. Our vision is a world where each day is safer and more secure than the one before. For more information, visit www.paloaltonetworks.com.

Share

Share this job

Related jobs

Prompt Engineering
Machine Learning
Computer Science
API
Santa Clara, CA, USA
Full Time
Palo Alto Networks

Principal Software Engineer

Palo Alto Networks

Computer Science
API
CICD
Distributed Systems
Santa Clara, CA, USA
Full Time
AI
Prompt Engineering
Machine Learning
Problem Solving
USA
Remote