Found.dev
Role Highlights
Languages used
Python
Key skills
Data Engineer
Big Data
Data Science
Data Management
Cloud Infrastructure
Data Quality
Data Warehousing
Streaming Data
Generative AI
Database
ETL
DataSets
RAG
ELT
Batch
Reliability
Security
Modelling
Glue
Startup
Tools, Libraries and Frameworks
GCP
Spark SQL
MongoDB
JSON
Hive
AWS
Azure
Description
The role involves designing, building, and maintaining scalable ETL and ELT pipelines across various architectures. The team focuses on ensuring data quality, reliability, and timeliness while managing large datasets using modern file and table formats. Responsibilities include deploying pipelines on cloud infrastructure and collaborating with cross-functional teams to meet data needs. Additionally, the position contributes to the development of a Generative AI framework to support internal applications. The work requires partnering with security and governance teams to ensure data is discoverable and compliant.
Required Qualifications and Skills
Candidates are required to have at least four years of experience building ETL pipelines for data lakes or warehouses. Necessary technical expertise includes proficiency in Python, Spark, SQL, and Airflow. Applicants must possess knowledge of data engineering concepts, including analytical data modeling, data quality validation, and pipeline reliability. Familiarity with big data file types and table formats such as Hive, Iceberg, Glue, Parquet, Avro, and JSON is required, along with a background in building data platforms on cloud infrastructure.
Disclaimer
Disclaimer: Job and company description information and some of the data fields may have been generated via GPT-4 summarisation and could contain inaccuracies. The full external job listing link should always be relied on for authoritative information.
About the company
MongoDB
Description
MongoDB is leading the charge in the global data management software market, which is experiencing significant growth. They are the first database provider to IPO in over twenty years and are dedicated to empowering developers with their developer data platform, enabling the creation of amazing apps. The Technical Services team at MongoDB plays a critical role in ensuring customer deployments of MongoDB's diverse product offerings, including the Atlas Data Platform, perform optimally. MongoDB is committed to innovation, offering an expanding suite of products and a culture supportive of personal growth and impact.
Related jobs
Technical Services Engineer
MongoDB
Product Management
Problem Solving
Control Systems
VCS
Kuala Lumpur, Malaysia
Full Time
Technical Services Engineer
MongoDB
Product Management
Problem Solving
Control Systems
VCS
Kuala Lumpur, Malaysia
Full Time
Cloud Infrastructure
SDLC
Change Management
Program Management
Dublin, Ireland
Remote
Full Time