Want to professionalize your AI skills, pivot to an AI role and increase your salary?
Master AI Engineering with the most practical and comprehensive LLM Development certifications at Towards AI Academy.

Capco

Principal Azure Data Engineer (Databricks)

Capco

Published 11 May 2026
London, UK
Full Time

Share this job

Role Highlights

Languages used

Python
SCALA

Key skills

Data Engineer
Data Governance
Data Modelling
CICD
Data Processing
Financial Services
GitHub Actions
Architecture
Streaming
Batch
Security
Devops
Transformation
Backup

Tools, Libraries and Frameworks

Azure DevOps
DataBricks
Unity
Jenkins
PySpark

Description

The role involves architecting and leading the delivery of enterprise-grade data solutions within the Azure ecosystem. The individual will design and implement streaming and batch data pipelines to modernize client data capabilities. Responsibilities include guiding clients on technical strategy and best practices while ensuring quality and security standards are met. The position requires collaborating with cross-functional teams to define data governance frameworks. Additionally, the role entails mentoring engineering teams and contributing to internal capability development initiatives.

Required Qualifications and Skills

The role requires proven experience with the Databricks platform, specifically regarding Unity Catalog, DeltaLake, and orchestration. Candidates must possess expertise in Python, PySpark, and distributed data processing frameworks, alongside an extensive background in CI/CD pipeline development. A deep understanding of data lakehouse principles, data modelling, and GDPR-compliant design is necessary. The position also requires experience in building production-grade data pipelines from ingestion to serving.

Disclaimer

Disclaimer: Job and company description information and some of the data fields may have been generated via GPT-4 summarisation and could contain inaccuracies. The full external job listing link should always be relied on for authoritative information.

About the company

Capco

Size

6474

Founded

HQ

London, GB

Public/Private

Privately Held

Description

Capco is a leading management consulting firm that focuses on transforming the competitive landscape in financial services through strategy, digital transformation, business consulting, data, and analytics, alongside cyber, cloud, technology architecture, and engineering solutions. They serve a wide range of clients from global banks to emerging FinTechs, offering a broad spectrum of services from business design to technology implementation. As a firm, Capco is characterized by its entrepreneurial spirit, growth mindset, minimal bureaucracy, and its commitment to creating an innovative, collaborative, diverse, and inclusive work environment. The firm takes pride in reshaping financial services to create lasting value for its clients and employees, indicating a strong reliance on technological advancements including Artificial Intelligence to drive transformation.

Share

Share this job

Related jobs

Data Engineer
Data Architect
Integrations
Gaming
Frankfurt am Main, Germany
Full Time
Apache Spark
Data Engineer
Data Governance
Data Lakes
Pune, India
Full Time
Data Management
Financial Services
Product Owner
Change Management
London, UK
Full Time