Lead Data Engineer

1 month ago

kansas, United States Capstone IT Staffing Full time

Capstone IT is seeking an experienced Lead Data Engineer to join one of clients' Data Platform team to build scalable enterprise data solutions that drive strategic business outcomes.


As the Lead Data Engineer, you will partner with Product Owners on strategic initiatives, understand business and functional requirements on projects, provide hands-on technical leadership to the engineering team with project execution and ensure deliverables are delivered with high quality and on time. You will help lead the iterative design and development of our cloud data warehouse. You will be responsible for designing, developing and maintaining data pipelines and data in our data warehouse to support Data Science, Business Intelligence and business operations. You will lead and guide the data engineering team, ensuring adherence to quality, standards, processes, and methodologies. Additionally, you will support the team in overcoming any technical challenges they encounter.


Duties & Responsibilities


  • Work closely with Product Manager and business stakeholders and develop a strong business understanding of our clients strategic and project level data needs.
  • Work with Product Owners to understand and translate business requirements into technical specifications and logical & physical data model requirements.
  • Design and extend data models working closely with Product and Data Architecture.
  • Design data pipelines that process both real time and batch data leveraging modern data engineering best practices.
  • Build, implement and test data pipelines using Databricks, Azure Data Factory, SSIS and other data integration tools.
  • Take technical ownership of projects and ensure deliverables meet scope, quality and timelines.
  • Provide technical leadership and guidance to the data engineering team, including mentoring, coaching, and fostering a collaborative work environment between all team members.
  • Support team members with troubleshooting and resolving complex technical issues and challenges.
  • Implement coding standards, conduct code reviews to ensure proper code quality level.
  • Implement effective source code management and CI/CD best practices to ensure data pipelines are automatically tested, integrated and deployed to production.
  • Partner with Data Architects to implement effective data integration and storage design patterns. Contribute to continuously improve existing data architecture and frameworks.
  • Assist in the development and implementation of data governance and management solutions.


Required Experience:


  • Bachelor’s Degree or higher in Computer Science, Engineering, or related field required.
  • 10+ years of experience in data engineering and data warehousing.
  • 5+ years of cloud data engineering and big data experience .


Required Knowledge, Skills And Abilities:


  • Experience with cloud data engineering and data warehouse technologies in Microsoft Azure, Google or AWS. Experience in Azure is highly preferred.
  • Strong programming skills in python and SQL for data processing and automation.
  • Strong technical skills in big data and Data integration technologies including Spark, Kafka, Databricks, Azure Data Factory, SSIS and SQL.
  • Experience with designing and building both cloud and on-prem data warehouses. Experience with Lake house architecture is highly preferred.
  • Experience in data modeling for transactional and analytical needs. Experience with NoSQL databases is preferred.
  • Development experience in Microsoft SQL Server including experience with tuning queries to optimize performance.
  • Skilled in Visual Studio with the use of source control applications such as Azure DevOps.
  • Experience with CI/CD and Jenkins.
  • In-depth knowledge of data management principles and best practices, including data governance, data security, data quality, and data integration.
  • Experience with delivering data solutions iteratively using the Agile Scrum framework and development processes.
  • Experience in providing guidance, mentorship, and technical support to a team of data engineers.
  • Demonstrated ability to troubleshoot and resolve complex technical issues related to data processing in a cloud big data infrastructure.
  • Exceptional analytical and conceptual thinking skills coupled with strong written and verbal communication skills.

  • Lead Data Engineer

    1 month ago

    Kansas City, United States Capstone IT Staffing Full time

    Capstone IT is seeking an experienced Lead Data Engineer to join one of clients' Data Platform team to build scalable enterprise data solutions that drive strategic business outcomes. As the Lead Data Engineer, you will partner with Product Owners on strategic initiatives, understand business and functional requirements on projects, provide hands-on...

  • Data Engineering Lead

    2 days ago

    Kansas City, Missouri, United States CloudBC Labs Full time

    Job Summary:CloudBC Labs is hiring a talented Data Engineer to lead our cloud-based data engineering initiatives. The ideal candidate will have expertise in designing, developing, and deploying scalable data solutions using Azure services, such as Data Lake and Data Factory, as well as SQL Server and SSIS.About the Role:In this position, you will be...

  • Enterprise Data Engineer Lead

    2 days ago

    Kansas City, Missouri, United States Spring Venture Group Full time

    Job Description: Enterprise Data Engineer Lead About the Role:We are seeking an experienced Enterprise Data Engineer Lead to join our team at Spring Venture Group. As an Enterprise Data Engineer Lead, you will be responsible for leading the development and implementation of large-scale data engineering projects that support our business operations.About the...

  • Capstone IT Staffing | Lead Data Engineer | kansas

    3 weeks ago

    kansas, United States Capstone IT Staffing Full time

    Capstone IT is seeking an experienced Lead Data Engineer to join one of clients' Data Platform team to build scalable enterprise data solutions that drive strategic business outcomes. As the Lead Data Engineer, you will partner with Product Owners on strategic initiatives, understand business and functional requirements on projects, provide hands-on...

  • Data Engineering Lead Developer

    2 weeks ago

    Kansas City, Missouri, United States Spring Venture Group Full time

    Job OverviewWe are seeking a highly skilled Data Engineer III to join our team at Spring Venture Group.Company OverviewSpring Venture Group is a leading digital direct-to-consumer sales and marketing company with product offerings focused on the senior market. We specialize in distributing Medicare Supplement, Medicare Advantage, and related products via our...

  • Senior Data Engineer

    1 month ago

    kansas, United States Capstone IT Staffing Full time

    Capstone IT is seeking an experienced Senior Data Engineer to join a client in the Kansas City area. This person will be responsible for developing and maintaining data pipelines across multiple platforms and managing our clients data warehouse to support business intelligence and business operations. This role will also assist with defining and implementing...

  • Data Engineering Architect

    3 weeks ago

    Kansas City, Kansas, United States Sogeti Full time

    About SogetiSogeti is a leading provider of professional technology services, specializing in Application Management, Infrastructure Management, and High-Tech Engineering. The company offers cutting-edge solutions around Testing, Business Intelligence, Mobility, Cloud, and Security, combining world-class methodologies and the global delivery model,...

  • Data Engineer III

    1 week ago

    Kansas City, United States Spring Venture Group Full time

    Company DescriptionWho We Are: Spring Venture Group is a leading digital direct-to-consumer sales and marketing company with product offerings focused on the senior market. We specialize in distributing Medicare Supplement, Medicare Advantage, and related products via our family of brands and dedicated team of licensed insurance agents. Powered by our unique...

  • Cybersecurity Data Engineer for a Leading Health Organization

    2 weeks ago

    Kansas City, Missouri, United States Centene Full time

    Job Summary:We are seeking a skilled Cybersecurity Data Engineer to join our team at Centene. As a key member of our organization, you will play a vital role in developing and implementing data-driven security solutions that protect our sensitive information.Key Responsibilities:Design and develop efficient data pipelines to ensure the smooth flow of...

  • data quality engineer

    2 months ago

    Kansas City, United States TechnoGen Full time

    Job Title:: Data Quality Engineer Location: Preferably KC (if not, will have to travel to KC as needed) Type: Long-term Contract Job Summary: Work with P&C Analytics group to understand the current data validation solution and business scenarios. Make enhancements as directed by Core broking business team in collaboration with data services and other app...

  • Senior Data Engineer

    1 month ago

    Kansas City, United States Capstone IT Staffing Full time

    Capstone IT is seeking an experienced Senior Data Engineer to join a client in the Kansas City area. This person will be responsible for developing and maintaining data pipelines across multiple platforms and managing our clients data warehouse to support business intelligence and business operations. This role will also assist with defining and implementing...

  • Senior Data Engineer

    3 weeks ago

    Kansas City, United States Capstone IT Staffing Full time

    Capstone IT is seeking an experienced Senior Data Engineer to join a client in the Kansas City area. This person will be responsible for developing and maintaining data pipelines across multiple platforms and managing our clients data warehouse to support business intelligence and business operations. This role will also assist with defining and implementing...

  • Data Engineering Leader

    2 days ago

    Kansas City, Missouri, United States NBKC Bank Full time

    OverviewNBKC Bank is a forward-thinking financial institution seeking an experienced Senior Data Engineer to drive data foundation development. This position offers a unique blend of technical expertise and business acumen, ideal for individuals passionate about shaping the future of data architecture.About the RoleThe Senior Data Engineer will be...

  • Lead Cybersecurity Engineer

    4 days ago

    Kansas City, Missouri, United States KPMG Full time

    **Job Summary**KPMG is seeking a highly experienced Lead Cybersecurity Engineer to join our Enterprise Security Services organization. In this role, you will be responsible for leading the development and implementation of security monitoring and incident response strategies, as well as overseeing the day-to-day operational responsibility of security...

  • Data Engineer

    3 weeks ago

    Kansas City, United States CloudBC Labs Full time

    POSITIONData EngineerLOCATION2x a week onsite in Castle Rock, MO (must be local)DURATION12+ MonthsINTERVIEW TYPEVideoVISA RESTRICTIONSNoneREQUIRED SKILLS TOP SKILLS: Azure (Data Lake, Data Factory), SSIS, SQL Server, (Must have most if not all skills) Proficient in using Azure DevOps to manage CI/CD pipelines and artifacts Proficient in performing system...

  • Senior Data Engineer

    3 weeks ago

    Kansas City, United States NBKC Bank Full time

    Summary Description nbkc bank is currently looking for an experienced, flexible Senior Data Engineer to help build a lasting data foundation at nbkc. As a Senior Data Engineer, you'll help build and maintain data pipelines that keep the bank running smoothly, while getting hands-on with all things data - storage, reporting, and more. You'll collaborate...

  • Senior Data Architect

    3 weeks ago

    Kansas, United States Capstone IT Staffing Full time

    Capstone IT Staffing is seeking an experienced Senior Data Engineer to join a client in the Kansas City area. This person will be responsible for developing and maintaining data pipelines across multiple platforms and managing our clients' data warehouse to support business intelligence and business operations.About the RoleWe are looking for a highly...

  • Capstone IT Staffing | Senior Data Engineer | kansas

    3 weeks ago

    kansas, United States Capstone IT Staffing Full time

    Capstone IT is seeking an experienced Senior Data Engineer to join a client in the Kansas City area. This person will be responsible for developing and maintaining data pipelines across multiple platforms and managing our clients data warehouse to support business intelligence and business operations. This role will also assist with defining and implementing...

  • Lead Environmental Engineer

    5 months ago

    Kansas City, United States WSP Full time

    Our Business We are a global leader in environmental consulting - made stronger with the recent acquisition of Wood’s Environment & Infrastructure business and Golder - with world-class expertise in environmental, social and governance (ESG), climate resiliency & sustainability (CRS), and earth sciences. Combined we have over 20,000 multidisciplinary...

  • Cloud Data Architect Lead

    2 weeks ago

    Kansas, United States Hexaware Technologies Full time

    About the RoleWe are seeking an experienced Senior Data Architect to lead the design, development, and implementation of our data management strategy. This is a senior-level position that requires extensive experience in cloud and on-prem data architecture, with expertise in Snowflake, Databricks, Informatica, and Collibra.ResponsibilitiesDevelop and...