Found.dev
Role Highlights
Languages used
SQL
Python
Key skills
Machine Learning
Big Data
Data Architect
ML Ops
Data Mining
Computer Science
CICD
Distributed Systems
Data Visualization
Data Warehousing
Shell Scripting
Modelling
ETL
Batch
Stream
Cloud
AI
LLMs
API
Data Engineer
Tools, Libraries and Frameworks
Power BI
HDFS
Hive
Kafka
Linux
AWS
DataBricks
GCP
Azure
Tableau
Spark SQL
Tensorflow
PyTorch
PySpark
Description
The role involves building and optimizing data pipelines for both batch and stream processing. The engineer will perform data mining, profiling, and modeling tasks while designing ETL processes. Responsibilities include working with distributed systems and maintaining data architecture. The position requires managing data within a fast-paced environment.
Required Qualifications and Skills
Candidates must possess a bachelor's degree in computer science or a related field along with at least one year of relevant experience. Alternatively, individuals without a degree may qualify with three or more years of relevant work experience. The role requires proficiency in Python, PySpark, and advanced SQL, alongside experience with data warehousing and ETL design. Strong problem-solving and communication skills are essential for success in this fast-paced environment.
Disclaimer
Disclaimer: Job and company description information and some of the data fields may have been generated via GPT-4 summarisation and could contain inaccuracies. The full external job listing link should always be relied on for authoritative information.
About the company
Visa
Description
Visa is a world leader in digital payments, facilitating more than 215 billion payment transactions between various parties across over 200 countries and territories each year. Their mission is to connect the world through the most innovative, convenient, reliable, and secure payments network, enabling individuals, businesses, and economies to thrive. By including everyone everywhere, Visa believes in uplifting everyone everywhere. Working with Visa means contributing to a culture that embraces identity and purpose, ensuring that the work has a direct impact on billions of people globally by unlocking financial access and enabling the future of money movement.
Related jobs
Data Science
Data Engineer
Big Data
Project Management
USA
Full Time
Machine Learning
Data Science
Vector Database
Computer Science
USA
Full Time
Integrations
Manager
AI
Infrastructure
San Francisco, CA, USA
Full Time