Found.dev
Role Highlights
Languages used
Key skills
Data Engineer
Distributed Systems
Data Structures
AI
Infrastructure
Cloud
Storage
Database
Debugging
Optimization
Architecture
ProtoTyping
Backup
Tools, Libraries and Frameworks
SQL Server
MS SQL
MS SQL Server
MQ
DataBricks
SalesForce
Oracle
IBM
MLFlow
Apache Spark
SharePoint
NoteBooks
Description
The role involves building and maintaining a data ingestion platform that provides connectors for various enterprise applications, databases, and cloud storage systems. The engineer will focus on extracting data from OLTP systems while minimizing production load through techniques like incremental data capture and log parsing. Responsibilities include designing scalable architectures, debugging large-scale production clusters, and optimizing system performance. The position requires leading complex technical projects and collaborating with other product teams to embed ingestion capabilities across various platform surfaces. Additionally, the role involves mentoring team members, planning sprints, and influencing the engineering roadmap.
Required Qualifications and Skills
Candidates must possess at least 15 years of industry experience in building and supporting large-scale distributed systems. Required expertise includes knowledge of database replication, backup, and transaction recovery, specifically from major database vendors. A strong foundation in algorithms and data structures is necessary for the role. The position also requires experience in driving company initiatives and working toward multi-year visions with incremental deliverables.
Disclaimer
Disclaimer: Job and company description information and some of the data fields may have been generated via GPT-4 summarisation and could contain inaccuracies. The full external job listing link should always be relied on for authoritative information.
About the company
Databricks
Size
8632
HQ
San Francisco, US
Public/Private
Privately HeldDescription
Databricks is the data and AI company. More than 10,000 organizations worldwide including Comcast, Condé Nast, Grammarly, and over 50% of the Fortune 500 rely on the Databricks Data Intelligence Platform to unify and democratize data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark, Delta Lake and MLflow. --- Attention: Databricks applicants Due to reports of phishing, were requesting that all Databricks applicants apply through our official Careers page at databricks.com/company/careers (good news you are here). All official communication from Databricks will come from email addresses ending with @databricks.com or @goodtime.io (our meeting tool).
Related jobs
Sr. Solutions Engineer
Databricks
Apache Spark
Big Data
Data Science
Solution Architect
Zurich, Switzerland
Full Time
Named Enterprise Account Executive
Databricks
Apache Spark
Customer Success
GCP
Data
Stockholm, Sweden
Full Time
Apache Spark
Open Source
GCP
Data
London, UK
Full Time