Found.dev
Role Highlights
Languages used
SCALA
Rust
GO
Python
Java
C++
Key skills
Computer Science
Distributed Systems
UI UX
AI
Infrastructure
Logging
Search
Reliability
Tools, Libraries and Frameworks
DataBricks
MLFlow
Apache Spark
Description
The role involves designing and scaling a next-generation logging platform capable of processing petabytes of data daily. The engineer will develop and optimize log delivery pipelines to ensure low-latency and high-throughput ingestion. Responsibilities include enhancing log accessibility by creating tools for efficient searching and analysis. The position requires collaborating with various teams to standardize logging formats and improve developer experiences. Additionally, the role focuses on improving system reliability and cost-efficiency through the optimization of retention and indexing. The engineer will also mentor team members to foster technical excellence.
Required Qualifications and Skills
Candidates must possess a Bachelor of Science degree or higher in Computer Science or a related field. The role requires at least seven years of production-level experience in programming languages such as Scala, Rust, Go, Python, Java, or C++. Applicants need deep experience in software development within large-scale distributed systems. Furthermore, the position necessitates experience in driving complex projects that involve multiple teams and stakeholders. Familiarity with log collection, health monitoring, and observability tools is also required.
Disclaimer
Disclaimer: Job and company description information and some of the data fields may have been generated via GPT-4 summarisation and could contain inaccuracies. The full external job listing link should always be relied on for authoritative information.
About the company
Databricks
Size
8632
HQ
San Francisco, US
Public/Private
Privately HeldDescription
Databricks is the data and AI company. More than 10,000 organizations worldwide including Comcast, Condé Nast, Grammarly, and over 50% of the Fortune 500 rely on the Databricks Data Intelligence Platform to unify and democratize data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark, Delta Lake and MLflow. --- Attention: Databricks applicants Due to reports of phishing, were requesting that all Databricks applicants apply through our official Careers page at databricks.com/company/careers (good news you are here). All official communication from Databricks will come from email addresses ending with @databricks.com or @goodtime.io (our meeting tool).
Related jobs
Sr. Solutions Engineer
Databricks
Apache Spark
Big Data
Data Science
Solution Architect
Zurich, Switzerland
Full Time
Named Enterprise Account Executive
Databricks
Apache Spark
Customer Success
GCP
Data
Stockholm, Sweden
Full Time
Apache Spark
Open Source
GCP
Data
London, UK
Full Time