Senior Data Engineer, Credential Data Pipelines
Boston, MA - USA
Job Summary
With 1000 intelligence professionals serving over 1900 clients worldwide Recorded Future is the worlds most advanced and largest intelligence company!
Digital Risk Protection Engineering is hiring a full-time Engineer to own the credential data pipelines behind Digital Risk Protection: the ingestion path that turns raw stolen-credential data from infostealer logs breach dumps and combolists into the exposure records customers rely on. The role pairs that engineering ownership with the daily operational duties that keep the product serving customers including domain approvals instance provisioning and data-correctness triage.
- Own the domain approval queue reviewing and approving customer domains within the requesters working day
- Provision and backfill customer instances including during live prospect evaluations
- Triage data-correctness escalations from CSMs and account teams tracing each case from the customers view back to the raw source log
- Build release and maintain the infostealer dump and combolist ingestion pipelines and the shared libraries the platform builds on
- Deliver the HIBP parity backlog and the historical non-HIBP backlog in the reference index
- Maintain routing parity on every published dump applying the corporate-domain versus personal-domain rules
- Administer API access for internal consumers such as research analysts
Required
- Production experience building and operating ETL or data-ingestion pipelines including parsing semi-structured and malformed source data
- Working knowledge of Elasticsearch and AWS-hosted data services
- Ability to debug end to end from a customer-facing UI or API symptom to the originating log record
- Clear written communication with non-engineering stakeholders under time pressure
Preferred
- Familiarity with credential-exposure or threat-intelligence data (infostealer logs breach dumps combolists)
- Experience owning an operational queue alongside a development backlog
The base salary range for this full-time position is $129000 - $193500. Our salary ranges are determined by role level and location. The salary displayed reflects the range for new hire salaries for the position across all US locations. Within the range individual pay is determined by state work location and additional factors including job-related skills experience and relevant education or training. This position may be eligible for incentive compensation equity and medical dental vision life insurance and 401K. Your recruiter can share more about the specific details of the compensation and benefit package during the hiring process.
#LI-Hybrid
Why should you join Recorded Future
Recorded Future employees (or Futurists) represent over 40 nationalities and embody our core values of having high standards practicing inclusion and acting ethically. Our dedication to empowering clients with intelligence to disrupt adversaries has earned us a 4.6-star user rating on G2 and more than 50% of Fortune 100 companies as customers.
Want more info
Blog & Podcast: Learn everything you want to know (and maybe some things youd rather not know) about the world of cyber threat intelligence
Linkedin Instagram&Twitter: Whats happening at Recorded Future
The Record: The Record is a cybersecurity news publication that explores the untold stories in this rapidly changing field
Timeline: History of Recorded Future
Recognition: Check out our awards and announcements
We are committed to maintaining an environment that attracts and retains talent from a diverse range of experiences backgrounds and lifestyles. By ensuring all feel included and respected for being unique and bringing their whole selves to work Recorded Future is made a better place every day.
If you need any accommodation or special assistance to navigate our website or to complete your application please send an e-mail with your request to our recruiting team at
Recorded Future is an equal opportunity and affirmative action employer and we encourage candidates from all backgrounds to apply. Recorded Future does not discriminate based on race religion color national origin gender including pregnancy sexual orientation gender identity age marital status veteran status disability or any other characteristic protected by law.
Recorded Future will not discharge discipline or in any other manner discriminate against any employee or applicant for employment because such employee or applicant has inquired about discussed or disclosed the compensation of the employee or applicant or another employee or applicant.
Recorded Future does not administer a lie detector test as a condition of employment or continued employment. This is in compliance with the law of the Commonwealth of Massachusetts and in alignment with our hiring practices across all jurisdictions.
Recorded Future maintains a drug-free workplace.
Note: Our interview process for all final-round candidates requires a mandatoryin-person interviewor a live scheduledvideo conference with the hiring manager. We do not conduct interviews via instant messaging or text. All communications during the application process will come from individuals within our HR department via their Recorded Future email address.
Notice to Agency and Search Firm Representatives: Recorded Future will not accept unsolicited resumes from any source other than directly from a candidate. Any unsolicited resumes sent to Recorded Future including those sent to our employees or through our website will become the property of Recorded Future. Recorded Future will not be liable for any fees related to unsolicited resumes.
Agencies must have a valid written agreement in place with Recorded Futures recruitment team and must receive written authorization before submitting resumes. Submissions made without such agreements and authorization will not be accepted and no fees will be paid.
Required Experience:
Senior IC
About Company
Our aim is ambitious: to organize and analyze threat data in an entirely new and different way for better, faster security. We believe that intelligence is the key to unlocking the potential of security programs – and protecting our organizations and communities. We believe that secu ... View more