About this role
Senior Data Engineer, Credential Data Pipelines
With 1,000+ intelligence professionals serving over 1,900 clients worldwide, Recorded Future is the world’s most advanced, and largest, intelligence company!
Digital Risk Protection Engineering is hiring a full-time Engineer to own the credential data pipelines behind Digital Risk Protection: the ingestion path that turns raw stolen-credential data from infostealer logs, breach dumps, and combolists into the exposure records customers rely on. The role pairs that engineering ownership with the daily operational duties that keep the product serving customers, including domain approvals, instance provisioning, and data-correctness triage.
What You'll Do
- Own the domain approval queue, reviewing and approving customer domains within the requester’s working day
- Provision and backfill customer instances, including during live prospect evaluations
- Triage data-correctness escalations from CSMs and account teams, tracing each case from the customer's view back to the raw source log
- Build, release, and maintain the infostealer, dump, and combolist ingestion pipelines and the shared libraries the platform builds on
- Deliver the HIBP parity backlog and the historical non-HIBP backlog in the reference index
- Maintain routing parity on every published dump, applying the corporate-domain versus personal-domain rules
- Administer API access for internal consumers such as research analysts
What You'll Bring:
-
Required
-
Production experience building and operating ETL or data-ingestion pipelines, including parsing semi-structured and malformed source data
-
Working knowledge of Elasticsearch and AWS-hosted data services
-
Ability to debug end to end, from a customer-facing UI or API symptom to the originating log record
-
Clear written communication with non-engineering stakeholders under time pressure
-
Preferred
-
Familiarity with credential-exposure or threat-intelligence data (infostealer logs, breach dumps, combolists)
-
Experience owning an operational queue alongside a development backlog
-
The base salary range for this full-time position is $129,000 - $193,500. Our salary ranges are determined by role, level, and location. The salary displayed reflects the range for new hire salaries for the position across all US locations. Within the range, individual pay is determined by state, work location and additional factors, including job-related skills, experience, and relevant education or training. This position may be eligible for incentive compensation, equity, and medical, dental, vision, life insurance and 401K. Your recruiter can share more about the specific details of the compensation and benefit package during the hiring process.
-
LI-Hybrid
-
Why should you join Recorded Future?
-
Recorded Future employees (or “Futurists”), represent over 40 nationalities and embody our core values of having high standards, practicing inclusion, and acting ethically. Our dedication to empowering clients with intelligence to disrupt adversaries has earned us a 4.6-star user rating on G2 and more than 50% of Fortune 100 companies as customers.