Principal Data Engineer

Join to apply for the Principal Data Engineer role at Recorded Future Location: Boston, MA With over 1,000 intelligence professionals serving more than 1,900 clients worldwide, Recorded Future is the world’s most advanced and largest intelligence company. We are looking for a Data Engineer to improve the Security Intelligence Graph. As an engineer, you will build production‑grade pipelines to drive data convergence from various sources, ensure that Indicators of Compromise (IOCs) are properly attributed, and improve graph quality at scale. What You'll Do: Work with the Graph Quality team to align, analyze, and ingest asset maps into the Security Intelligence Graph Develop, productize, monitor, and maintain data pipelines to analyze and ingest data at scale Lead a team of Data Engineers by providing guidance on projects and direction of best practices Build tools and APIs to facilitate access to data and analytics developed from the intelligence graph Analyze and explain patterns in data to drive business‑critical decisions Create technical project plans and drive the successful execution of projects, with input from our Product team and other developers on the team Collaborate with Data Scientists, Data Engineers, and business leaders to develop and refine technical solutions Onboard and guide junior members of the team Assist in setting team goals, planning sprints, and leading Agile scrum meetings What You'll Bring: 6+ years of Python programming 2+ years of experience with cloud computing tools, e.g. from AWS, Azure, or Google Cloud 1+ years of experience leading and/or mentoring other team members Experience writing scalable, production‑grade applications and ETL/ELT pipelines Efficient & accurate problem‑solving skills, including the ability to debug both software and data Proven ability to analyze data and apply statistical techniques to draw accurate, impactful conclusions Proven success in delivering projects from design and implementation to release Excellent attention to detail & ability to work independently while delivering high‑quality results Excellent written & verbal communication when collaborating with colleagues across various locations and timezones, designing technical approaches, and writing documentation Eagerness to continue learning and teaching new skills to team members, in order to raise the bar across the team Preferred Qualifications: Familiarity with both batch and streaming pipelines Familiarity with any of the following: message buses (e.g. Kafka, RabbitMQ), NoSQL databases (e.g. MongoDB, AWS Neptune, Neo4j), ElasticSearch Bachelor's/Master's degree in Computer Science, Mathematics, Statistics, Engineering, or equivalent experience Exposure to ML approaches, including experience productizing ML models Experience with developing REST APIs with Python frameworks (e.g. Flask, Django, FastAPI) Leadership experience, with a track record of presenting information to stakeholders with varying levels of technical expertise The base salary range for this full‑time position is $152,000–$228,500. This position may be eligible for incentive compensation, equity, and benefits such as medical, dental, vision, life insurance, and 401(K). Why you should join Recorded Future Recorded Future employees (or “Futurists”) represent over 40 nationalities and embody our core values of having high standards, practicing inclusion, and acting ethically. Our dedication to empowering clients with intelligence to disrupt adversaries has earned us a 4.6‑star user rating on G2 and more than 50% of Fortune 100 companies as customers. Recorded Future is an equal opportunity and affirmative action employer and we encourage candidates from all backgrounds to apply. Recorded Future does not discriminate based on race, religion, color, national origin, gender including pregnancy, sexual orientation, gender identity, age, marital status, veteran status, disability or any other characteristic protected by law. Recorded Future will not discharge, discipline or in any other manner discriminate against any employee or applicant for employment because such employee or applicant has inquired about, discussed, or disclosed the compensation of another employee or applicant. #J-18808-Ljbffr