Found.dev
Role Highlights
Languages used
SQL
Python
Key skills
Data Engineer
Data Infrastructure
Data Governance
Integrations
CICD
Code Reviews
Data Processing
Data Management
Data Quality
FinTech
Security
Transformation
Batch
Architecture
Modelling
Optimization
DataSets
Cluster
Automation
Streaming
Tools, Libraries and Frameworks
IOS
AWS S3
DataBricks
Airflow
Git
GitHub
Unity
Apache Spark
PySpark
Description
The role involves designing and building robust data pipelines for a corporate data lake. The individual will own data products from end to end within a production environment. Responsibilities include scaling global data infrastructure and delivering high-quality reporting. The position requires mentoring junior engineers and providing design guidance. The individual will collaborate with various teams to create consumer-friendly datasets and contribute to data governance practices.
Required Qualifications and Skills
The role requires production experience with Apache Spark, Databricks, and Delta Lake. Candidates must possess advanced SQL skills and proficiency in Apache Airflow or MWAA. Knowledge of Amazon S3 design, data modeling, and data quality frameworks is necessary. Additionally, the candidate must be proficient in Python, Git, and Terraform, and maintain a B2 level of English proficiency.
Disclaimer
Disclaimer: Job and company description information and some of the data fields may have been generated via GPT-4 summarisation and could contain inaccuracies. The full external job listing link should always be relied on for authoritative information.
About the company
Visa
Description
Visa is a world leader in digital payments, facilitating more than 215 billion payment transactions between various parties across over 200 countries and territories each year. Their mission is to connect the world through the most innovative, convenient, reliable, and secure payments network, enabling individuals, businesses, and economies to thrive. By including everyone everywhere, Visa believes in uplifting everyone everywhere. Working with Visa means contributing to a culture that embraces identity and purpose, ensuring that the work has a direct impact on billions of people globally by unlocking financial access and enabling the future of money movement.
Related jobs
Data Science
Data Engineer
Big Data
Project Management
USA
Full Time
Machine Learning
Data Science
Vector Database
Computer Science
USA
Full Time
Integrations
Manager
AI
Infrastructure
San Francisco, CA, USA
Full Time