Found.dev
Role Highlights
Languages used
Python
Java
SQL
Key skills
Data Engineer
Big Data
Data Architect
SME
Data Processing
Data Management
Financial Services
Design Patterns
Information Security
Cloud
Reliability
Automation
Storage
Transformation
ETL
ELT
Optimization
Modelling
DataSets
Tools, Libraries and Frameworks
AWS S3
DataBricks
Azure
Apache Spark
Description
The role involves serving as a subject matter expert on data engineering best practices and solution design. The individual will design and build scalable data pipelines and storage schemas across cloud and on-premise ecosystems. Responsibilities include defining reference architectures, design patterns, and engineering standards for data ingestion, transformation, and consumption. The position requires collaborating with stakeholders to translate business needs into technical storage solutions. Furthermore, the role ensures that all data solutions adhere to enterprise governance, security, and compliance standards. The individual will also mentor team members by sharing innovative techniques and emerging industry trends.
Required Qualifications and Skills
The role requires demonstrated experience in designing and building end-to-end data pipelines using ETL or ELT patterns. Candidates must possess hands-on experience with data lake, lake house, or data warehouse architectures, including schema design and performance optimization. Expert-level proficiency in Python or Java is necessary, alongside advanced SQL expertise for performance tuning large datasets. Additionally, deep experience with distributed data processing frameworks like Apache Spark is required. The position demands strong communication skills and the ability to lead execution across global time zones.
Disclaimer
Disclaimer: Job and company description information and some of the data fields may have been generated via GPT-4 summarisation and could contain inaccuracies. The full external job listing link should always be relied on for authoritative information.
About the company
Mastercard
Size
38185
HQ
Purchase, US
Description
MasterCard is framed as a technology company in the global payments business, emphasizing its role in connecting various stakeholders worldwide and enabling the use of secure and convenient electronic forms of payment. It describes its mission as working to connect and power an inclusive digital economy that benefits everyone everywhere by ensuring transactions are safe, simple, smart, and accessible. The company culture is driven by a decency quotient (DQ), cultivating an inclusive environment that values individual strengths, views, and experiences. It leverages secure data, networks, partnerships, and a passion for innovation to support various entities, including individuals, financial institutions, governments, and businesses, in realizing their potential.
Related jobs
SR Azure Database Engineer
Mastercard
Data Governance
Data Modelling
Data Factory
CICD
Dublin, Ireland
Temporary
Data Engineer
Deep Learning
Data Analysis
Feature Engineering
Pune, India
Full Time
Data Scientist
Mastercard
Scikit-learn
Data Engineer
Data Analysis
Big Data
San Francisco, CA, USA
Part Time
Full Time