Found.dev
Role Highlights
Languages used
Python
Key skills
Data Engineer
Integrations
Data Processing
Web Services
Data Quality
Infrastructure
AI
Modelling
Transformation
Reliability
ETL
ELT
Database
Architecture
Machine Learning
IAM
Glue
Logging
Tools, Libraries and Frameworks
Data Factory
AWS
AWS S3
Azure SQL
CloudWatch
Description
The role involves designing and building scalable, production-grade data ingestion pipelines. The individual will manage data integration across cloud environments to support the expansion of a platform's knowledge base. Responsibilities include owning data modeling and transformation to facilitate analytics and downstream capabilities. The position requires ensuring the reliability, quality, and observability of data pipelines. Furthermore, the role involves collaborating with platform and AI teams to address evolving data requirements while driving performance and scalability standards.
Required Qualifications and Skills
Candidates must possess a Bachelor's degree and at least 8 years of data engineering experience, or an equivalent combination of education and experience. Required technical proficiencies include Python, SQL, and hands-on experience with Azure and AWS data services, specifically regarding ETL/ELT pipelines. Applicants must demonstrate the ability to build production-grade data pipelines and manage API-based or event-driven integration patterns. Familiarity with Data Lake architecture is also necessary for this role.
Disclaimer
Disclaimer: Job and company description information and some of the data fields may have been generated via GPT-4 summarisation and could contain inaccuracies. The full external job listing link should always be relied on for authoritative information.
About the company
AECOM
Description
AECOM is the world’s trusted infrastructure consulting firm, delivering professional services throughout the project lifecycle – from advisory, planning, design and engineering to program and construction management. On projects spanning transportation, buildings, water, new energy and the environment, our public- and private-sector clients trust us to solve their most complex challenges. Our teams are driven by a common purpose to deliver a better world through our unrivaled technical and digital expertise, a culture of equity, diversity and inclusion, and a commitment to environmental, social and governance priorities. AECOM is a Fortune 500 firm and its Professional Services business had revenue of $14.4 billion in fiscal year 2023. See how we are delivering sustainable legacies for generations to come at aecom.com and @AECOM.
Related jobs
Electrical Engineering
System Design
Data
Senior
Centurion, South Africa
Full Time
Team Lead
Infrastructure
Data
Pivotal
Dublin, Ireland
Full Time
Integrations
Electrical Engineering
Mechanical Engineering
MS Office
Arlington, TX, USA
Full Time