Want to professionalize your AI skills, pivot to an AI role and increase your salary?
Master AI Engineering with the most practical and comprehensive LLM Development certifications at Towards AI Academy.

Capco

Senior Azure Data Engineer (Databricks)

Capco

Published 11 May 2026
London, UK
Full Time

Share this job

Role Highlights

Languages used

Python
SQL
SCALA

Key skills

Data Engineer
CICD
Financial Services
GitHub Actions
Clean Code
Transformation
Streaming
Devops
Architecture
GDPR
Backup

Tools, Libraries and Frameworks

Azure DevOps
DataBricks
Unity
Kafka
Jenkins
Hive
PySpark
Hadoop

Description

The role involves designing, building, and deploying scalable and secure data engineering pipelines using the Databricks platform on Azure. Professionals in this position partner with clients to identify data requirements and develop technical solutions that support business transformation. The work includes creating real-time event-driven solutions and implementing data lifecycle optimization. Additionally, the role requires contributing to best practice implementation within cross-functional engineering teams. The position focuses on applying software engineering principles to maintain clean code and robust data architectures.

Required Qualifications and Skills

The role requires proven hands-on experience with the Databricks platform and orchestration. Candidates must possess strong skills in Python, PySpark, and SQL, alongside knowledge of distributed data systems. Expertise in developing full lifecycle data pipelines and familiarity with data lakehouse architecture and schema design are necessary. Furthermore, the position requires a working knowledge of DevOps tools and CI/CD processes, as well as experience with GDPR-compliant solutions.

Disclaimer

Disclaimer: Job and company description information and some of the data fields may have been generated via GPT-4 summarisation and could contain inaccuracies. The full external job listing link should always be relied on for authoritative information.

About the company

Capco

Size

6474

Founded

HQ

London, GB

Public/Private

Privately Held

Description

Capco is a leading management consulting firm that focuses on transforming the competitive landscape in financial services through strategy, digital transformation, business consulting, data, and analytics, alongside cyber, cloud, technology architecture, and engineering solutions. They serve a wide range of clients from global banks to emerging FinTechs, offering a broad spectrum of services from business design to technology implementation. As a firm, Capco is characterized by its entrepreneurial spirit, growth mindset, minimal bureaucracy, and its commitment to creating an innovative, collaborative, diverse, and inclusive work environment. The firm takes pride in reshaping financial services to create lasting value for its clients and employees, indicating a strong reliance on technological advancements including Artificial Intelligence to drive transformation.

Share

Share this job

Related jobs

Data Engineer
Data Architect
Integrations
Gaming
Frankfurt am Main, Germany
Full Time
Apache Spark
Data Engineer
Data Governance
Data Lakes
Pune, India
Full Time
Data Management
Financial Services
Product Owner
Change Management
London, UK
Full Time