Senior Data Engineer

1 month ago


St Louis, United States Daugherty Business Solutions Full time
Title

Senior Data Engineer (Databricks)

Overview

This is a full-time, employee position. Corp-to-Corp or 1099/W2 contract is NOT available for this position.

Must be located in one of the following: Atlanta, Chicago, Columbus, Dallas, Minneapolis, New York Area, St. Louis. This position is mostly Remote but there may be certian clients/projects where onsite is required up to 3 days a week.

Daugherty Business Solutions brings a fresh approach to data engineering by delivering results through unmatched innovation and world-class technology and talent. This is why many of the most well-known companies in the world trust us with their mission-critical projects. As a team member at Daugherty, you will play an integral role in our company's success and are recognized and valued for your contributions. We have an entrepreneurial culture with the maturity and security of a 35+ year company helping you to create your best work and take your career to the next level.

We are seeking a skilled Senior/Principal Consultant and experienced Data Engineer with expertise in Databricks, Azure, and Spark to join our dynamic team.

Responsibilities

  • Translate business needs into technology strategies and solutions that drive value for clients
  • Convey complex technical concepts to non-technical audiences
  • Design, develop and deploy end-to-end data pipelines using Databricks, Azure Data Factory and Spark to ingest, process and analyze large volumes of structured and unstructured data
  • Collaborate with data scientists, analysts and other stakeholders to understand business requirements and translate them into technical solutions
  • Optimize and tune data pipelines for performance, reliability and scalability to ensure efficient processing of data
  • Implement data governance and security best practices to ensure the integrity and confidentiality of data
  • Develop and maintain documentation, including data flow diagrams, technical specifications and user guides
  • Stay up to date with emerging technologies and best practices in data engineering, cloud computing and big data analytics
Qualifications
  • 7+ years in technology consulting or a related field, with a track record of delivering technology solutions to clients
  • Experience in a leadership or senior consulting role, demonstrating the ability to manage and execute complex projects
  • Proven experience as a Data Engineer, with at least 5 years of hands-on experience in designing and building data pipelines
  • Ability leading teams in delivering large-scale, complex technology solutions
  • Ability to oversee all phases of the project lifecycle, from scoping and planning to execution and delivery
  • Proficiency in Databricks, Azure services (e.g., Azure Data Lake Storage, Azure Synapse Analytics) and Spark for big data processing and analytics
  • Strong programming skills in Python, Scala or Java, with experience in writing complex SQL queries
  • Experience with data modeling, ETL/ELT processes and data warehousing concepts
  • Excellent problem-solving skills and attention to detail, with the ability to troubleshoot and debug complex data engineering issues
  • Strong communication and interpersonal skills, with the ability to collaborate effectively with cross-functional teams
  • Able to articulate ideas clearly, present findings persuasively and build rapport with clients and team members
  • Ability to effectively communicate technical concepts to non-technical stakeholders
  • Relevant certifications in Databricks, Azure or Spark (e.g., Azure Data Engineer, Databricks Certified Associate) are a plus
  • Bachelor's degree in computer science, Engineering or related field; Master's degree preferred
Why Daugherty?
  • Opportunity to work on high-impact projects with Fortune 500 companies.
  • A culture that promotes collaboration, innovation, and continuous learning.
  • Competitive compensation and benefits package.
  • Flexible work environment with remote options.
  • Strong commitment to professional development and career growth.


Daugherty Business Solutions is an inclusive Equal Employment Opportunity employer that considers applicants without regard to gender, gender identity, sexual orientation, race, ethnicity, disabled or veteran status, or any other characteristic protected by law.

If you require accommodations or assistance to complete the online application process, please inform any recruiter you are working with (or send an email to careers@daugherty.com) and identify the type of accommodation or assistance you are requesting. Do not include any medical or health information in this email. The recruiting team will respond to your email promptly.

#LI-Hybrid
  • Senior Data Engineer

    2 weeks ago


    St Louis, Missouri, United States Tierpoint Full time

    OverviewTierpoint is committed to delivering exceptional data-driven solutions that drive business success. As a Senior Analytics Engineer, you will play a vital role in building and maintaining our enterprise data architecture, ensuring seamless integration with various systems and platforms.

  • Senior Data Engineer

    1 month ago


    St Louis, Missouri, United States Daugherty Business Solutions Full time

    We are looking for an experienced Senior/Principal Consultant and Data Engineer to join our dynamic team. As a key member of our team, you will play an integral role in delivering technology solutions to clients.Key ResponsibilitiesTranslate business needs into technology strategies and solutions that drive value for clientsDesign, develop and deploy...

  • Senior Data Engineer

    1 month ago


    St Louis, United States Equifax Full time

    Equifax is where you can power your possible. If you want to achieve your true potential, chart new paths, develop new skills, collaborate with bright minds, and make a meaningful impact, we want to hear from you. Equifax is where you can power your possible. If you want to achieve your true potential, chart new paths, develop new skills, collaborate with...


  • St Louis, Missouri, United States Grimco Full time

    About the JobWe are seeking an experienced Senior Data Engineer to join our dynamic data engineering team in Sunset Hills, MO. As a key member of our team, you will play a pivotal role in designing, building, and maintaining our data infrastructure.Key Responsibilities:Design and develop robust and scalable data pipelines to collect, process, and transform...

  • Senior Technical Lead

    2 weeks ago


    St Louis, Missouri, United States Brilliant Infotech Full time

    Technical Lead - Data EngineeringWe are seeking a seasoned Senior Technical Lead - Data Engineering to join our team at Brilliant Infotech. This is a 12-24 month contract opportunity with an estimated salary range of $120,000-$180,000 per year, based on location and experience.About the RoleThe successful candidate will have experience of working on real...

  • Data Engineer

    8 hours ago


    St Louis, United States VLink Inc Full time

    Job Title: Data EngineerLocation: Saint Louis, MOEmployment Type: (Full-time or contract)Duration: Long TermOnly USC/GCJob Description:Development operations (DevOps) engineers are responsible for the production and ongoing maintenance of a website platform. They also manage cloud infrastructure and system administration and work with teams to identify and...

  • Data Engineer

    17 hours ago


    St Louis, United States VLink Inc Full time

    Job Title: Data EngineerLocation: Saint Louis, MOEmployment Type: (Full-time or contract)Duration: Long TermOnly USC/GCJob Description:Development operations (DevOps) engineers are responsible for the production and ongoing maintenance of a website platform. They also manage cloud infrastructure and system administration and work with teams to identify and...


  • St Louis, Missouri, United States Burns & McDonnell Full time

    About the RoleWe are seeking a highly skilled Senior Process Engineer to join our team at Burns & McDonnell. The ideal candidate will have 7 years of process engineering experience and a strong background in chemical engineering.About the JobThe Senior Process Engineer will lead piping design project teams, creating world-class designs for various projects...

  • Data Engineer

    1 month ago


    St Louis, United States Energizer Holdings Full time

    What you'll love about this job St Louis based / Great Benefits / Bonus Structure This is Energizer Holdings, Inc. Energizer Holdings responsibly creates products to make lives easier and more enjoyable. To do this, we lean into our culture as an organization – we win together, while serving each other, with a willingness to act boldly, all while doing...

  • Data Engineer

    1 month ago


    St Louis, United States Duvari Group Full time

    As a Data Engineer, you'll be at the forefront of developing and maintaining innovative data solutions, ensuring the seamless execution of our data engineering processes. You will also play a key role in shaping and supporting our Next Generation Data Warehouse, driving impactful data strategies for the future. Essential Functions: At the core of this role...


  • St Louis, United States PRI Global Full time

    Senior Data EngineerContractRemoteonly on w2 Only USC or GC Qualifications Required• Strong data analysis skills including oral and written communication skills to effectively communicate with IT and business representatives.• Strong enterprise data modeling expertise• Must have 6 or more years of experience using data modeling tools and...


  • St Louis, Missouri, United States Centraprise Full time

    Job Title: Senior DevOps Engineer at Centraprise">">About Us: At Centraprise, we're a forward-thinking organization that's passionate about innovation and excellence. Our team is dedicated to delivering cutting-edge solutions that transform industries.">">Job Summary: We're seeking an experienced Senior DevOps Engineer to join our team in St Louis, MO. As a...

  • Sr. Data Engineer

    3 weeks ago


    St Louis, United States Brilliant Infotech Full time

    Role: Sr. Data Engineer / Big Data Engineer Duration: 12Months -24 Months Location: St Louis, Missouri Client : Master Card Prime Vendor : MooFwd Pay Rate to candidate: On W2 Hourly - $60/hour - on Yearly Salary $120K/Year on C2C $70/hour Tax Terms : C2C and W2 Relocation : Okay (but preferred locals) Interview: Video Role • Develop high quality, secure...

  • Senior Data Engineer

    18 hours ago


    Saint Louis, United States Grimco Full time

    Job DescriptionJob DescriptionSENIOR DATA ENGINEERDo you want to work for a company where the people are the purpose? Joining our dynamic data engineering team means more than just a job - it's an opportunity to be a vital part of our success story. Your role will be pivotal in designing, building, and maintaining our data infrastructure. Your expertise...

  • Jr. Data Engineer

    4 weeks ago


    St Louis, United States inSync Staffing Full time

    Positions Requested 1 Total Hours 2,064.00 Description: Job Summary: We are seeking a highly motivated and detail-oriented Junior Data Engineer to join our dynamic data engineering team. The ideal candidate will have a strong understanding of computer science concepts and demonstrate skills in maintainable engineering practices, including unit testing and...


  • St Louis, Missouri, United States ServiceSource Full time

    About the RoleWe are seeking a skilled Senior Mechanical Engineer to join our team at ServiceSource. As a key member of our facilities management department, you will be responsible for overseeing the design, construction, and maintenance of our facilities.The ideal candidate will have a strong background in mechanical engineering, with experience in project...


  • St Louis, United States gpac Full time

    Job Description Job Description: Senior Mechanical Engineer gpac, a 30+ year recruitment company, is partnered with a well-established company in the Mechanical Contractor industry. Our client company has been building confidence nationwide since the early 1920s, providing engineering, construction, fabrication, mechanical solutions, and service. With a...

  • Data Engineer

    7 months ago


    St Louis, United States 1904labs Full time

    About Us At 1904labs, we are a human-centered technology company that focuses on using modern tools and technologies to solve enterprise organizations' crunchiest challenges. We look for innovative, courageous, intensely curious, and team-minded people. At 1904labs, we are committed to providing each team member with opportunities that will allow personal...

  • Lead Data Engineer

    1 month ago


    St. Louis, United States Nestl Purina North America Full time

    Driven by integrity and united by the people-and-pet bond, we find strong purpose in the work we do and an even greater joy in those we get to work alongside. Together, we harness the expertise of our long-standing tradition of excellence to embrace possibility and continuously push to do what's never been done before in pet care. Discover your purpose and...


  • St Louis, Missouri, United States Energizer Holdings Full time

    Energizer Holdings is an innovative organization that creates products to make lives easier and more enjoyable. We are currently seeking a highly skilled Data Solutions Engineer to join our Enterprise Intelligence team in St Louis, offering great benefits and bonus structure.Job Summary:The successful candidate will be responsible for the development of data...