About this role
Job title: Staff Software Engineer
About the Role As a Staff Software Engineer on the Data Platform team, you will leverage bleeding-edge AI developer tools and techniques to help build the Data Intelligence Platform for Databricks that will automate decision-making across the entire company. You will achieve this in collaboration with Databricks Product Teams, Data Science, and many more. You will define the future of a variety of tools spanning logging, orchestration, data transformation, metric store, governance platforms, and data consumption layers, just to name a few.
What You'll Do
- Design and run the cross-company Data Intelligence Platform, which contains every business and product metric used to run Databricks.
- Develop tooling and infrastructure to efficiently manage and run Databricks on Databricks at scale, across multiple clouds, geographies, and deployment types, including CI/CD processes, test frameworks for pipelines and data quality, and infrastructure-as-code tooling.
- Partner with engineering teams to provide leadership in developing the long-term vision and requirements for the Databricks product.
- Build reliable data pipelines and solve data problems using Databricks, partner products, and other OSS tools; provide early feedback on the design and operations of these products.
- Represent Databricks at academic and industrial conferences and events.
- Help balance data protection and ease of shareability for the Data Intelligence Platform as we transition to a public company.
What We're Looking For
- BS/MS/PhD in Computer Science or related majors, or equivalent experience.
- 10+ years of industry experience building and operating large-scale distributed systems.
- 4+ years of experience providing technical leadership on planet-scale production data systems.
- Experience leading architecture efforts for performance-sensitive systems, such as latency-critical services, multi-tenant platforms, and large-scale indexing pipelines.
- Strong communication skills and the ability to operate effectively in fast-paced, cross-functional environments.
- A strategic mindset with the ability to align engineering execution with longer-term product and company goals.
- Passion for mentoring and developing other engineers.
Compensation & Benefits
- Benefits: Databricks offers comprehensive benefits and perks that meet the needs of all employees; regional details can be accessed via the provided link.
- Diversity & Inclusion: Databricks is committed to fostering a diverse and inclusive culture with equal employment opportunity standards.
- Compliance: There may be export-controlled considerations requiring appropriate licenses where applicable.