About this role
Job title: Sr. Software Engineer - Data Query Platform - London (Hybrid)
About the Role The data engineering team is on a mission to create a hyper scale data lake, which helps find bad actors and stop breaches. The team builds and operates systems to centralize all of the data the falcon platform collects, making it easy for internal and external customers to transform and access the data for analytics, machine learning, and threat hunting. As a Senior Software Engineer on the team, you will contribute to the full spectrum of our systems, from foundational processing and data storage, through scalable pipelines, to frameworks, tools and applications that make that data available to other teams and systems. Your primary toolset in your work will be Java microservices, Spark/Scala data processing (also some Flink), Kubernetes and AWS native tooling.
What You'll Do
- Write highly fault-tolerant Java code within Apache Spark to produce platform products used by our customers to query our event pipelines/ingestion for insight into active threat trends and related analytics
- Design, develop, and maintain ultra-high-scale data platforms that process petabytes of data
- Participate in technical reviews of our products and help us develop new features and enhance stability
- Continually help us improve the efficiency and reduce latency of our high-performance services to delight our customers
- Research and implement new ways for both internal stakeholders as well as customers to query their data efficiently and extract re