Want to professionalize your AI skills, pivot to an AI role and increase your salary?
Master AI Engineering with the most practical and comprehensive LLM Development certifications at Towards AI Academy.

Endava

Senior Data Engineer

Endava

Published 27 Nov 2025
Kuala Lumpur, Malaysia
Full Time

Share this job

Role Highlights

Languages used

Python
SQL

Key skills

Machine Learning
Data Engineer
Big Data
Data Architect
Data Processing
Technical Leadership
Data Quality
Cloud
Deployment
Reliability
Security
DataFlow
Storage
Architecture
Modelling
ETL
ELT
AI
Scripting
Optimization
Streaming
Batch
Serverless

Tools, Libraries and Frameworks

GCP
AWS
Azure
BigQuery
SnowFlake
RedShift
Kafka
Kinesis
Apache Spark
Hadoop

Description

Endava Senior Data Engineer \\\| SmartRecruiters Google Chrome Microsoft Edge Apple Safari Mozilla Firefox . Senior Data Engineer Full-time Company Description Technology is our how. And people are our why. For over two decades, we have been harnessing technology to drive meaningful change. By combining world-class engineering, industry expertise, and a people-centric mindset, we consult and partner with leading brands from various industries to create dynamic platforms and intelligent digital experiences that drive innovation and transform businesses. From prototype to real-world impact, be part of a global shift by doing work that matters. Job Description About the Role Were looking for experienced data engineers with strong expertise in cloud-based data solutions. In this role, youll be responsible for building, optimizing, and maintaining scalable data pipelines and architectures that support analytics, machine learning, and data-driven decision-making across the organization. Joining our Google Cloud team, this role is ideal for a Senior Data Engineer with experience across any of the major cloud providers who is looking to build their knowledge within the GCP stack. Key Responsibilities Collaborate with data analysts and data scientists to design efficient data flows, pipelines, and reporting solutions. Work closely with business stakeholders to understand data usage and identify areas for improvement. Design and implement cloud-based architectures and deployment processes on GCP. Build and maintain data pipelines, transformations, and metadata to support business needs. Develop, test, and optimize big data solutions for scalability, performance, and reliability. Create and manage relational and dimensional data models aligned with platform capabilities. Monitor and maintain the production environment, ensuring data quality, integrity, and governance. Lead or contribute to initiatives improving data quality, governance, security, and compliance. Requirements Proven experience as a Data Engineer across AWS, Azure, or GCP services (e.g., BigQuery, Dataflow, Pub/Sub, Dataproc, Cloud Storage). Strong understanding of data architecture, modeling, and ETL/ELT processes. Hands-on experience with big data frameworks and modern data tools. Excellent communication and collaboration skills across technical and business teams. Familiarity with machine learning, AI, or advanced analytics is a plus. Qualifications 5+ years of experience in data engineering. Strong proficiency in Python and Apache Spark. Hands-on experience designing and implementing ETL/ELT processes and data pipelines. Solid expertise in SQL scripting and query optimization. Background in cloud data technologies and tools, with exposure to: - Data processing frameworks (Spark, Hadoop, Apache Beam, Dataproc, or similar) - Cloud-based data warehouses (Snowflake, Redshift, BigQuery, or similar) - Real-time streaming pipelines (Kafka, Kinesis, Pub/Sub, or similar) - Batch and serverless data processing Strong analytical skills with the ability to work with both structured and unstructured data. Experience in leading IT projects and managing stakeholder expectations. Additional Information Discover some of the global benefits that empower our people to become the best version of themselves: Finance: Competitive salary package, share plan, company performance bonuses, value-based recognition awards, referral bonus; Career Development: Career coaching, global career opportunities, non-linear career paths, internal development programmes for management and technical leadership; Learning Opportunities: Complex projects, rotations, internal tech communities, training, certifications, coaching, online learning platforms subscriptions, pass-it-on sessions, workshops, conferences; Work-Life Balance: Hybrid work and flexible working hours, employee assistance programme; Health: Global internal wellbeing programme, access to wellbeing apps; Community: Global internal tech communities, hobby clubs and interest groups, inclusion and diversity programmes, events and celebrations. At Endava, were committed to creating an open, inclusive, and respectful environment where everyone feels safe, valued, and empowered to be their best. We welcome applications from people of all backgrounds, experiences, and perspectivesbecause we know that inclusive teams help us deliver smarter, more innovative solutions for our customers. Hiring decisions are based on merit, skills, qualifications, and potential. If you need adjustments or support during the recruitment process, please let us know. I'm interested I'm interestedCookies Settings I'm interested Refer a friend share this job Share on LinkedIn Share on Facebook Share on Twitter Share via email Share on Xing Share on WeChat Share to WeChat × Copy the link and open WeChat to share. Copy to clipboard Open WeChat Share to WeChat × Use Scan QR Code in WeChat and click ··· to share. Senior Data Engineer Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia Full-time I'm interested I'm interested

Required Qualifications and Skills

The role requires 5+ years of experience in data engineering. Candidates must have strong proficiency in Python and Apache Spark, along with hands-on experience in designing and implementing ETL/ELT processes and data pipelines. Solid expertise in SQL scripting and query optimization is necessary. A background in cloud data technologies and tools is essential, including experience with data processing frameworks like Spark, Hadoop, Apache Beam, or Dataproc. Familiarity with cloud-based data warehouses such as Snowflake, Redshift, or BigQuery, and real-time streaming pipelines like Kafka, Kinesis, or Pub/Sub is also required. Strong analytical skills for working with structured and unstructured data, and experience leading IT projects are expected.

Disclaimer

Disclaimer: Job and company description information and some of the data fields may have been generated via GPT-4 summarisation and could contain inaccuracies. The full external job listing link should always be relied on for authoritative information.

About the company

Endava

Size

10278

HQ

London, GB

Public/Private

Public Company

Description

Endava is reimagining the relationship between people and technology. We have helped some of the worlds leading Payments, Financial Services, Telecommunications, Media, Technology, Consumer Products, Retail, Mobility, and Healthcare companies accelerate their ability to take advantage of new business models and market opportunities. By ideating and delivering dynamic platforms and intelligent digital experiences, we help our clients fuel the rapid, ongoing transformation of their business. By leveraging next-generation technologies, our agile, multi-disciplinary teams provide a combination of Product & Technology Strategies, Intelligent Experiences, and World Class Engineering to help our clients become more engaging, responsive, and efficient. Endava has 11,761 people as of September 30, 2023, located in the European Union: Austria, Bulgaria, Croatia, Denmark, Germany, Ireland, Netherlands, Poland, Romania, Slovenia and Sweden; Non-European Union: Bosnia & Herzegovina, Moldova, North Macedonia, Serbia, Switzerland and the United Kingdom; North America: Canada and the United States; Latin America: Argentina, Colombia, Mexico and Uruguay; Asia Pacific: Australia, Malaysia, Singapore

Share

Share this job

Related jobs

Data Engineer
Data Governance
CICD
Data Processing
Bucharest
Full Time
Scikit-learn
Data Science
Computer Vision
ML Ops
Bogota, Colombia
Full Time
Scikit-learn
Data Science
Computer Vision
ML Ops
Colombia
Full Time