Principal Data Engineer

Job title: Principal Data Engineer

About the Role

A Principal Data Engineer to join Atlassian's Data Engineering Team in a tech lead and architect role to build world-class data solutions powering critical business decisions. You will drive the data engineering practice, develop backend data systems and models, and help scale Atlassian's data-driven culture.

What You'll Do

• Own the technical evolution of the data engineering capabilities and ensure solutions are delivered incrementally, meeting outcomes, and promptly escalating risks and issues.

• Establish a deep understanding of how data engineering works, use this to direct and coordinate the technical aspects of work across data engineering, and systematically improve productivity across the teams.

• Maintain a high bar for operational data quality and proactively address performance, scale, complexity and security considerations.

• Drive complex decisions that can impact the work in data engineering. Set the technical direction and balance customer and business needs with long-term maintainability & scale.

• Understand and define the problem space, and architect solutions. Coordinate a team of engineers towards implementing them, unblocking them along the way if necessary.

• Lead a team of data engineers through mentoring and coaching, work closely with the engineering manager, and provide consistent feedback to help them manage and grow the team.

• Work with close counterparts in other departments as part of a multi-functional team, and build this culture in your team.

• What We're Looking For

• 12+ years of experience in a Data Engineer role as an individual contributor.

• At least 2 years of experience as a tech lead for a Data Engineering team.

• You are an engineer with a track record of driving and delivering large (multi-person or multi-team) and complex efforts.

• Great communicator and maintain many of the essential cross-team and cross-functional relationships necessary for the team's success.

• Experience with building streaming pipelines with a micro-services architecture for low-latency analytics.

• Experience working with varied forms of data infrastructure, including relational databases (e.g. SQL), Spark, and column stores (e.g. Redshift).

• Experience building scalable data pipelines using Spark using Airflow scheduler/executor framework or similar scheduling tools.

• Experience working in a technical environment with the latest technologies like AWS data services (Redshift, Athena, EMR) or similar Apache projects (Spark, Flink, Hive, or Kafka).

• Understanding of Data Engineering tools/frameworks and standards to improve the productivity and quality of output for Data Engineers across the team.

• Industry experience working with large-scale, high-performance data processing systems (batch and streaming) with a 'Streaming First' mindset to drive Atlassian's business growth and product experience.

• Compensation & Benefits

• Atlassian offers a wide range of perks and benefits designed to support you, your family and to help you engage with your local community.

• Our offerings include health and wellbeing resources, paid volunteer days, and so much more.

• To learn more, visit go.atlassian.com/perksandbenefits.