Senior Software Engineer - Distributed Data Systems

Job title: Senior Software Engineer - Distributed Data Systems

About the Role As a Senior Software Engineer on the Runtime team at Databricks, you will help build the next generation distributed data storage and processing systems that can outperform specialized SQL query engines while providing expressive abstractions to support diverse workloads from ETL to data science. You will contribute to projects such as Apache Spark, Data Plane Storage, Delta Lake, and Delta Pipelines, shaping scalable data infrastructure used by customers worldwide.

What You'll Do

• Develop and optimize distributed data storage and processing components that power modern data analytics.
• Build and enhance the next generation query optimizer and execution engine.
• Contribute to Data Plane Storage services and client libraries for cloud backends (e.g., AWS S3, Azure Blob Store).
• Work on Delta Lake features including ACID transactions and time travel, and simplify orchestration with Delta Pipelines.
• Collaborate across teams to scale services across millions of virtual machines and deliver customer value.
• Participate in performance engineering to improve speed and scalability.

What We're Looking For

• BS (or higher) in Computer Science or a related technical field, or equivalent practical experience.
• 5+ years of production-level experience in Java, Scala, or C++.
• Strong foundation in algorithms and data structures and their real-world use cases.
• Experience with distributed systems, databases, and big data systems (Apache Spark, Hadoop).
• Comfortable working towards a multi-year vision with incremental deliverables and a focus on customer impact.

Compensation & Benefits

• Local Pay Range $166,000—$225,000 USD.
• The total compensation package may include annual performance bonus, equity, and benefits.
• We offer comprehensive benefits; details vary by region.