Data Pipeline Engineer

3 weeks ago

Georgetown, United States CareerBuilder Full time

Job Description

Data Pipeline Engineer

Clearance Requirement: TS

Location: Washington D.C. or NYC

Onsite Requirement: 5 Days/week onsite

The Role

Data Pipeline engineers ensure that our customers work with updated and accurate data in Foundry. You are the first to respond to data health failures on key pipelines. You are technical, with a passion for system support. You are comfortable reading code to identify fixes and making changes to improve the performance and stability of production data pipelines. Working alongside pipeline engineers from other customer accounts, your insights into the product and process will form an essential part of feedback to our product engineering team, and other user and product support teams.

Core Responsibilities

Maintaining and building schedules so that pipelines run.
Setting up and maintaining health checks on different pipelines.
Responding to, triaging, and debugging pipelines when there is a problem (usually this is when health checks fail). This will include limited out of hours support for critical issues (e.g. a critical subset of alerts can page you overnight or during the weekend*).
Reading code and writing code changes and/or modifying the monitoring set-up where necessary.
Knowing and understanding how to navigate the pipelines and documentation.
Following SOPs to contact other teams and data providers when data is incorrect or not received on time.
Communicating outages with the end users of a pipeline.
Contributing to and monitoring tooling improvements (where feasible).
Active work not required on weekends or out of hours, however due to the nature of on-call, the person must be available to respond if there is a critical outage during their assigned on-call weeks. After an on-call weekend the engineer will receive 2 days off.

What We Require

TS clearance or higher.

Qualifications:

What We Value

Comfortable reading and writing code in SQL, Python, Pyspark and Java.
Basic understanding of Spark and familiar/interested in learning the basics of tuning Spark jobs.
Practical experience with performing root cause analysis and documenting lessons learned from production incidents (e.g. creating post-mortem reports).
Ability to work within an agile team.
Strong written and verbal communication skills with the ability to skillfully engage with customers on complex, sensitive topics.
Strong organizational skills and attention to detail through effective prioritization.

Why is This a Great Opportunity:

Great salaries

Lots of upward mobility

401K, Sign On Bonuses, Tuition Reimbursements, Covered Healthcare

Salary Type : Annual Salary

Salary Min : 160000

Salary Max : 200000

Currency Type : US Dollars

#J-18808-Ljbffr

  • Data Engineering Analyst

    3 days ago

    Georgetown, United States TalentBurst, Inc. Full time

    Data Engineering AnalystLocation : Georgetown, KY10-Jun-2024 - 06-Jun-2025National/Domestic Travel (Canada and Mexico: Low but the resource should not have any restrictions)W2 acceptedRM Notes:Education:Degree: Engineering is preferred and computer science.Level of Experience:Not looking for a developer but a strong experience with dashboards and working...

  • Data Engineering Analyst

    3 days ago

    Georgetown, United States TekWissen LLC Full time

    Job DescriptionJob DescriptionOverview: TekWissen Group is a workforce management provider throughout the USA and many other countries in the world. Our client is a recognized prominent global enterprise in the automotive sector, listed among the top 50 companies in the Global Fortune rankings. As a leading player in the global automotive industry, our...

  • Data Engineering Analyst

    4 days ago

    Georgetown, United States Global Technology Associates Full time

    Job DescriptionJob DescriptionData Engineering AnalystJob ID: 1301800Location: Georgetown, KY 40324Pay Rate: Open Additional Benefits: Health, Dental, Vision, 401(k), company-paid holidays and more!Type of hire: Contract - 100% onsite Position Summary: Engage with department executives, management, engineers, and technicians to create data-driven apps to...

  • Data Technician

    4 days ago

    Georgetown, United States Insight Global Full time

    Required Skills & Experience* Experience using 3D environment software (CATIA, Delmia, or 3DX preferred)* 3-5 years of SharePoint Experience* Ability to read and interpret designs in AutoCAD or CATIA* Plant and Process management expertiseNice to Have Skills & Experience/Plusses*Experience working with 3DExperience*Ability to integrate data and designs into...

  • Data Technician

    5 days ago

    Georgetown, United States Insight Global Full time

    Required Skills & Experience* Experience using 3D environment software (CATIA, Delmia, or 3DX preferred)* 3-5 years of SharePoint Experience* Ability to read and interpret designs in AutoCAD or CATIA* Plant and Process management expertiseNice to Have Skills & Experience/Plusses*Experience working with 3DExperience*Ability to integrate data and designs into...

  • Data Technician

    5 days ago

    Georgetown, United States Insight Global Full time

    Required Skills & Experience* Experience using 3D environment software (CATIA, Delmia, or 3DX preferred)* 3-5 years of SharePoint Experience* Ability to read and interpret designs in AutoCAD or CATIA* Plant and Process management expertiseNice to Have Skills & Experience/Plusses*Experience working with 3DExperience*Ability to integrate data and designs into...

  • Data Analyst

    15 hours ago

    Georgetown, United States Kaygen, Inc. Full time

    Description:Travel: Less than 5%, but always potential: National/Domestic Travel (Canada and Mexico: Low but the resource should not have any restrictions).100% OnsiteResponsibilities:- Be the Business Technology leader in a department of 100 diverse technical team members and assist team members to work with Our Client's Information Technology and Digital...

  • Data Analyst

    1 day ago

    Georgetown, United States Kaygen, Inc. Full time

    Description:Travel: Less than 5%, but always potential: National/Domestic Travel (Canada and Mexico: Low but the resource should not have any restrictions).100% OnsiteResponsibilities:- Be the Business Technology leader in a department of 100 diverse technical team members and assist team members to work with Our Client's Information Technology and Digital...

  • Data Technician

    5 days ago

    Georgetown, United States Insight Global Full time

    Required Skills & Experience * Experience using 3D environment software (CATIA, Delmia, or 3DX preferred) * 3-5 years of SharePoint Experience * Ability to read and interpret designs in AutoCAD or CATIA * Plant and Process management expertise Nice to Have Skills & Experience * Experience working with 3DExperience * Ability to integrate data and...

  • Data Technician

    5 days ago

    Georgetown, United States Insight Global Full time

    Required Skills & Experience * Experience using 3D environment software (CATIA, Delmia, or 3DX preferred) * 3-5 years of SharePoint Experience * Ability to read and interpret designs in AutoCAD or CATIA * Plant and Process management expertise Nice to Have Skills & Experience * Experience working with 3DExperience * Ability to integrate data and...

  • Data Technician

    5 days ago

    Georgetown, United States Insight Global Full time

    Required Skills & Experience * Experience using 3D environment software (CATIA, Delmia, or 3DX preferred) * 3-5 years of SharePoint Experience * Ability to read and interpret designs in AutoCAD or CATIA * Plant and Process management expertise Nice to Have Skills & Experience * Experience working with 3DExperience * Ability to integrate data and...

  • Data Center Engineer

    1 week ago

    Georgetown, United States World Wide Technology Full time

    Why WWT? Fueled by creativity and ideation, Worldwide Technology strives to accelerate our growth and nurture future innovation. From our world-class culture to our generous benefits, to developing cutting-edge technology solutions, WWT constantly works towards its mission of creating a profitable growth company that is a great place to work. We encourage...

  • Data Center Engineer

    2 weeks ago

    Georgetown, United States World Wide Technology Full time

    Why WWT?Fueled by creativity and ideation, Worldwide Technology strives to accelerate our growth and nurture future innovation. From our world-class culture to our generous benefits, to developing cutting-edge technology solutions, WWT constantly works towards its mission of creating a profitable growth company that is a great place to work. We encourage our...

  • Data Center Engineer

    2 weeks ago

    Georgetown, United States World Wide Technology Full time

    Why WWT?Fueled by creativity and ideation, Worldwide Technology strives to accelerate our growth and nurture future innovation. From our world-class culture to our generous benefits, to developing cutting-edge technology solutions, WWT constantly works towards its mission of creating a profitable growth company that is a great place to work. We encourage our...

  • Data Center Engineer

    2 weeks ago

    Georgetown, United States World Wide Technology Full time

    Why WWT?Fueled by creativity and ideation, Worldwide Technology strives to accelerate our growth and nurture future innovation. From our world-class culture to our generous benefits, to developing cutting-edge technology solutions, WWT constantly works towards its mission of creating a profitable growth company that is a great place to work. We encourage our...

  • Data Center Manager/Chief Building Engineer

    5 days ago

    Georgetown, United States Boden US Full time

    JOB SUMMARY - 120K + Bonus This role provides leadership and management of the on-site tech team at the Data Center, managing and planning day to day activities, auditing and monitoring the Fusion team’s effectiveness against SLAs and KPIs, and improving service delivery to ensure expectations are met or exceeded. To be successful in the role, the...

  • Data Center Manager/Chief Building Engineer

    5 days ago

    Georgetown, United States Boden US Full time

    JOB SUMMARY - 120K + Bonus This role provides leadership and management of the on-site tech team at the Data Center, managing and planning day to day activities, auditing and monitoring the Fusion team’s effectiveness against SLAs and KPIs, and improving service delivery to ensure expectations are met or exceeded. To be successful in the role, the...

  • Data Center Manager/Chief Building Engineer

    5 days ago

    Georgetown, United States Boden US Full time

    JOB SUMMARY - 120K + Bonus This role provides leadership and management of the on-site tech team at the Data Center, managing and planning day to day activities, auditing and monitoring the Fusion team’s effectiveness against SLAs and KPIs, and improving service delivery to ensure expectations are met or exceeded. To be successful in the role, the...

  • Data Center Manager/Chief Building Engineer

    1 day ago

    Georgetown, United States Boden US Full time

    JOB SUMMARY - 120K + Bonus This role provides leadership and management of the on-site tech team at the Data Center, managing and planning day to day activities, auditing and monitoring the Fusion teams effectiveness against SLAs and KPIs, and improving service delivery to ensure expectations are met or exceeded. To be successful in the role, the potential...

  • Principal Electrical Engineer

    2 days ago

    Georgetown, United States Pats Aircraft Llc Full time

    Join the High-Flying Team at ALOFT AeroArchitects! Hey there, aviation enthusiasts! Are you ready to take your career to new heights? ALOFT AeroArchitects is on the lookout for talented individuals to join our crew of airplane maintenance, modification, and completion experts. We're seeking aviation professionals who are passionate about transforming...