The role involves designing, building, and maintaining scalable data pipelines to support large-scale data infrastructure on cloud platforms. Responsibilities include optimizing data storage and processing performance while ensuring data quality, governance, and security. The position requires collaborating with data scientists and AI specialists to develop infrastructure for advanced projects, including Retrieval-Augmented Generation and Agentic AI systems. The individual will provide technical leadership, mentor junior engineers, and manage stakeholder expectations throughout the project lifecycle. Additionally, the role requires operating within an Agile environment to deliver iterative project milestones.

Candidates must possess 6-10 years of experience in data engineering, preferably within a large-scale enterprise or financial services environment. Proficiency in Python, PySpark, Databricks, Ab Initio, Snowflake, and Starburst is required, along with experience in cloud-native services. The role necessitates strong leadership, project management, and client-facing communication skills. A Bachelor’s degree or equivalent experience is required for this position.