Found.dev
Role Highlights
Languages used
Python
Key skills
Data Engineer
Integrations
Data Processing
Web Services
Data Quality
Infrastructure
AI
Modelling
Transformation
Reliability
ETL
ELT
Database
Architecture
Machine Learning
IAM
Glue
Logging
Tools, Libraries and Frameworks
Data Factory
AWS
AWS S3
Azure SQL
CloudWatch
Description
The role involves designing and building scalable, production-grade data ingestion pipelines to support a platform. The individual will manage data modeling and transformation processes to facilitate analytics and downstream capabilities. Responsibilities include enabling and optimizing data integration across multiple cloud environments. The position requires ensuring the reliability, quality, and observability of data pipelines. Additionally, the role involves collaborating with platform and AI teams to address evolving data requirements and drive performance standards.
Required Qualifications and Skills
Candidates must possess a Bachelor's degree and a minimum of 8 years of data engineering experience, or an equivalent combination of education and experience. Required technical proficiencies include Python, SQL, and experience with ETL/ELT pipelines and large-scale data systems. The role necessitates hands-on experience with Azure and AWS data services, specifically including Azure Data Factory, Synapse Analytics, and SQL Database. Furthermore, the candidate must demonstrate the ability to build data replication and synchronization between cloud environments and utilize API-based or event-driven integration patterns.
Disclaimer
Disclaimer: Job and company description information and some of the data fields may have been generated via GPT-4 summarisation and could contain inaccuracies. The full external job listing link should always be relied on for authoritative information.
About the company
AECOM
Description
AECOM is the world’s trusted infrastructure consulting firm, delivering professional services throughout the project lifecycle – from advisory, planning, design and engineering to program and construction management. On projects spanning transportation, buildings, water, new energy and the environment, our public- and private-sector clients trust us to solve their most complex challenges. Our teams are driven by a common purpose to deliver a better world through our unrivaled technical and digital expertise, a culture of equity, diversity and inclusion, and a commitment to environmental, social and governance priorities. AECOM is a Fortune 500 firm and its Professional Services business had revenue of $14.4 billion in fiscal year 2023. See how we are delivering sustainable legacies for generations to come at aecom.com and @AECOM.
Related jobs
QA
Project Management
Infrastructure
Data
Bogota, Colombia
Full Time
Data Management
Relational Database
Data Migration
Power BI
Bangalore, India
Full Time