Sr. Data Engineer

2 months ago


Columbia, United States Burtch Works Full time

Senior Data Engineer

  • Chicago, IL or Columbia, MD
  • Hybrid (Tues, Wed, Thur)
  • Direct Hire, Full-time (No C2C or C2H)
  • 120K to 130K + 15% - 30% Bonus
  • No Sponsorship
  • No Relocation
  • No Remote Option


Job Description:

  • Work closely with various Business, IT, Analyst and Data Science groups to collect business requirements.
  • Design, develop, deploy and support high performance data pipelines both inbound and outbound.
  • Optimize data pipelines for performance, scalability, and reliability.
  • Implement CI/CD pipelines to ensure continuous deployment and delivery of our data products.
  • Ensure quality of critical data element, prepare data quality remediation plans and collaborate with business and system owners to fix the quality issues at its root.
  • Document the design and support strategy of the data pipelines.
  • Capture, store and socialize data lineage and operational metadata.
  • Troubleshoot and resolve data engineering issues as they arise.
  • Develop REST APIs to expose data to other teams within the company.
  • Mentor and guide junior data engineers.


Qualifications:

  • Six (6) plus years of experience in building data lakes and cloud data platforms
  • Experience working with GCP technologies like BigQuery, Composer, GCS, DataStream, Dataflows
  • Expert knowledge on SQL and Python programming
  • Experience working with Airflow as workflow management tools and build operators to connect, extract and ingest data as needed.
  • Experience in tuning queries for performance and scalability
  • Experience in Real Time Data Ingestion using GCP PubSub, Kafka, Spark or similar.
  • Excellent organizational, prioritization and analytical abilities
  • Have proven experience working in incremental execution through successful launches.
  • Excellent problem-solving and critical-thinking skills to recognize and comprehend complex data issues affecting the business environment.


Additional Information:

Benefits including-

  • Health, dental, vision, life and disability insurance
  • 401k Retirement Program + 6% employer match
  • Participation in Flexible Time Off (FTO) Policy
  • 12 Paid Holidays


Keywords: GCP, Google Cloud Platform, BigQuery, Composer, SQL, Python, Data Engineering, Data Pipelines


  • Sr Structural Engineer

    3 months ago


    Columbia, South Carolina, United States Arthur Grand Technologies Inc Full time

    Company DescriptionArthur Grand Technologies ) is in the business of providing staffing and technology consulting services. We have doubled our revenue year over year for the past 5 years. This speaks to the long-lasting relationship and customer satisfaction that we have built in this short span of time. Our company is managed by a team of professionals who...


  • Columbia, United States Leidos Full time

    Description Come join our fast-growing National Security Sector at Leidos! We offer competitive salaries, bonus programs, competitive paid leave, holidays, beyond ordinary benefits, and many opportunities for continual professional growth and development, including a robust technical upskilling program, paid/sponsored certifications, leadership development...


  • Columbia, United States Lorven technologies Full time

    Job DescriptionJob DescriptionRole Name: Sr. Security Analytics Architect (Azure + Data Bricks) Location: Columbia, SCKey Responsibilities: Work directly with the business to co-create a detailed vision of the tools they need to effectively monitor the dark-web and other data sources to protect their company and their clients from threats Define a set of...

  • Data Engineer

    3 months ago


    Columbia, United States The Swift Group Full time

    Job DescriptionJob DescriptionThe Swift Group is seeking a highly motivated and experienced Data Engineer to join our fast-paced data team. You will play a critical role in ensuring the successful acquisition and management of mission-critical and mission support data sets. You will work closely with our team of experts to design and implement data solutions...

  • Shift Engineer-

    2 months ago


    Columbia, South Carolina, United States Shift Engineer (Part Time) Full time

    Competitive Benefits:401k Plan and after 1 year up to 3% Match Complimentary Meal during your shift Pre-tax commuter benefits A clear career pathway - career advancement opportunitiesRelationship Hospitality. It's in the genes. Some just have it; a natural desire to deliver meaningful and heartfelt experiences. It's a calling. At Rosewood Hotel Group we work...

  • Data Engineer

    3 months ago


    Columbia, United States Merit 321 Full time

    Position: Data Engineer Location: Columbia, MD (Hybrid) Clearance: Current active PLACEMENT MANAGER, SCI eligible Summary We are looking for a talented Data Engineer to support the acquisition of mission critical and mission support data sets. The preferred candidate will have a background in supporting cyber and/or network related missions within the...


  • Columbia, United States Hobson Associates Full time

    Ready to make a global impact and advance your career? Join a leading medical device OEM in South Carolina!... 100+ years of innovation 75,000+ employees worldwide Collaborative culture Competitive pay and benefits, We’re looking for a results-oriented Sr. Continuous Improvement Engineer to enhance operations at their $50M upgraded facility. This role...


  • Columbia, United States Applied Insight Full time

    Job DescriptionJob DescriptionAbout Us: Innovating to solve real-world problemsApplied Insight enhances the ability of federal government customers to preserve national security, deliver justice and serve the public with advanced technologies and quality analysis. We work closely with agencies and industry to overcome technical and cultural hurdles to...


  • Columbia, United States PRI Technology Full time

    Title: Sr. C++ Software EngineerFull-time/Permanent - No 3rd party resumes please.Hybrid remote - 3 days a week onsite in Columbia, MD.US Citizen only - Must be eligible to obtain a Top Secret Security ClearanceOur client is seeking a highly skilled and experienced Senior C++ Software Engineer to join our innovative team of dedicated, diverse professionals....


  • Columbia, United States PRI Technology Full time

    Title: Sr. C++ Software EngineerFull-time/Permanent - No 3rd party resumes please.Hybrid remote - 3 days a week onsite in Columbia, MD.US Citizen only - Must be eligible to obtain a Top Secret Security ClearanceOur client is seeking a highly skilled and experienced Senior C++ Software Engineer to join our innovative team of dedicated, diverse professionals....

  • Data Engineer

    4 days ago


    Columbia, United States Metronome LLC Full time

    Job Title: Data Engineer Location: Columbia, MD Status: Hybrid; able to work on customer site in Ft. Meade, MD most of the time (Average 3-4 days/week) Employment Type: Full-Time Clearance Level: TS/SCI with a polygraph level security clearance Education: 5+ years of experience as a developer, analyst, or engineer with Bachelors in related field; 3...


  • Columbia, United States Tintri Full time

    Overview DDN Storage is seeking great candidates to join our dynamic team of passionate customer-enabling technologists! This is an incredible opportunity to be part of a company that has been at the forefront of AI and high-performance data storage innovation for over two decades. DDN Storage is a global market leader renowned for powering many of the...


  • Columbia, South Carolina, United States Shelter Insurance Full time

    About Shelter InsuranceShelter Insurance is a leading provider of insurance solutions, dedicated to serving the needs of its customers. As a company built on a foundation of excellence, we recognize the importance of our employees in driving our success.Job SummaryWe are seeking an experienced Data Engineering Manager to join our team. The successful...

  • Data Engineer

    4 days ago


    Columbia, United States CRISP Shared Services Full time

    Company Summary CRISP Shared Services (CSS) serves as the technology partner for health information exchange (HIE) affiliates in Maryland, DC, West Virginia, Connecticut, Alaska, and Virginia. CSS facilitates the electronic transfer of clinical information between disparate information systems in order to positively impact the healthcare system through...

  • Mid Data Engineer

    4 days ago


    Columbia, United States Amentum Full time

    Amentum is seeking a Mid Data Engineer (RDT&E) to support a DIA Analytic Innovations Office Advanced Analytics & Product Evaluation contract. This position is based in Washington, D.C. All employees will start in the Washington D.C office but upon request and with customer approval may be allowed to work from Reston VA, Quantico VA, or College Park MD....

  • Data Engineer

    4 days ago


    Columbia, United States Techizee Inc. Full time

    Job Description Position Title: Data Engineer Key Required Skills: Technical experience in information architecture, data architecture, data modeling, data governance, ETL design, data quality and BI-analytics. Position Description Collaborate with Solution & Enterprise Architects, Business analysts, DBAs and others to understand business requirements....


  • Columbia, United States The Ladders Full time

    Overview DDN Storage is seeking great candidates to join our dynamic team of passionate customer-enabling technologists! This is an incredible opportunity to be part of a company that has been at the forefront of AI and high-performance data storage innovation for over two decades. DDN Storage is a global market leader renowned for powering many of the...

  • Data Engineer

    3 months ago


    Columbia, United States Techizee Inc Full time

    Job DescriptionJob DescriptionPosition Title: Data EngineerKey Required Skills: Technical experience in information architecture, data architecture, data modeling, data governance, ETL design, data quality and BI-analytics.Position Description · Collaborate with Solution & Enterprise Architects, Business analysts, DBAs and others to understand business...

  • Sr Systems Engineer

    1 month ago


    Columbia, United States ELEVI Associates Full time

    In order to join the ELEVI Team you will need A CURRENT  SECURITY CLEARANCE WITH FS IS REQUIRED.   A Bachelor’s degree in a Qualified Engineering Field is great   Fifteen (15) + years of systems engineering experience Required Skills:• Strong experience developing and maintaining Niagara Files Solutions (NiFi Engineering / Flows)• Familiar with...


  • West Columbia, United States Flextronics Full time

    Job Posting Start Date 08-21-2024 Job Posting End Date 10-21-2024Flex is the diversified manufacturing partner of choice that helps market-leading brands design, build and deliver innovative products that improve the world.We believe in the power of diversity and inclusion and cultivate a workplace culture of belonging that views uniqueness as a competitive...