Big Data Engineering Team Lead

3 days ago


New York, New York, United States Resource Informatics Group Inc Full time
Job Description

We are seeking a highly skilled Big Data Engineering Team Lead to join our team at Resource Informatics Group Inc. This is an exciting opportunity for experienced professionals to take their careers to the next level.

A strong background in Big Data technologies, such as Hadoop, Spark, Redshift, Snowflake, Hive, Pig, and hands-on experience with Talend or Informatica ETL tools, is required. Additionally, experience with design and implementation of ETL/ELT frameworks for complex warehouses/marts, data integration, data quality, and data architecture is essential.

As a Big Data Engineering Team Lead, you will be responsible for developing and configuring Big Data batch jobs using the Spark framework in Talend, building data catalogues using IBM/Informatica/Talend tools, and working closely with cross-functional teams to drive business outcomes.

The ideal candidate will have excellent leadership skills, a strong technical foundation, and the ability to motivate and guide a team of engineers towards achieving project goals.

This role offers a competitive salary of $140,000 per annum, commensurate with experience, and a comprehensive benefits package.

Key Responsibilities:

  • Lead a team of engineers to design, develop, and implement Big Data solutions using Talend and Informatica tools.
  • Develop and configure Big Data batch jobs using the Spark framework in Talend.
  • Build data catalogues using IBM/Informatica/Talend tools.
  • Collaborate with cross-functional teams to drive business outcomes.
  • Maintain and improve existing Big Data infrastructure and processes.
  • Stay up-to-date with industry trends and emerging technologies in Big Data and analytics.

Requirements:

  • Bachelor's degree in Computer Science, Information Technology, or related field.
  • Minimum 8 years of experience in Big Data engineering, with a focus on Talend and Informatica tools.
  • Proven experience in designing and implementing ETL/ELT frameworks for complex warehouses/marts.
  • Strong understanding of data integration, data quality, and data architecture principles.
  • Excellent leadership and communication skills.
  • Ability to motivate and guide a team of engineers towards achieving project goals.

What We Offer:

  • Competitive salary of $140,000 per annum, commensurate with experience.
  • Comprehensive benefits package.
  • Ongoing training and development opportunities.
  • Collaborative and dynamic work environment.
  • Opportunities for career growth and advancement.


  • New York, New York, United States CyberTec Full time

    We are CyberTec, a leading technology company seeking a highly skilled Big Data Architect with DevOps expertise to join our team. Job Title: Big Data Architect with DevOpsEstimated Salary: $120,000 - $180,000 per annumAs a key member of our engineering team, you will be responsible for designing and implementing scalable data architectures using industry...

  • Big Data Engineer

    4 days ago


    New York, New York, United States Diverse Lynx Full time

    About the PositionWe are seeking a Big Data Engineer to join our team at Diverse Lynx LLC. As a key member of our data engineering team, you will be responsible for designing and implementing big data pipelines using Apache Kafka and other technologies.Key ResponsibilitiesDesign and implement big data pipelines using Apache Kafka and other...


  • New York, New York, United States Capital One Full time

    Role OverviewWe are seeking a highly skilled Cloud Engineering Lead to spearhead the development of our big data and streaming solutions. As a key member of our engineering team, you will be responsible for designing, implementing, and maintaining scalable and secure cloud-based infrastructure.Job DescriptionAs a Cloud Engineering Lead, you will work closely...


  • New York, New York, United States The Data Sherpas Full time

    Job Summary:We are seeking an experienced GCP Data Science Engineering Lead to join our team at The Data Sherpas. As a GCP Data Science Engineering Lead, you will be responsible for driving technology innovation by delivering world-class machine learning solutions on Google Cloud Platform (GCP).Key Responsibilities:Lead the design and deployment of...


  • New York, New York, United States Glow Networks Full time

    Job Title: Big Data Engineer SpecialistGlow Networks is looking for an experienced Big Data Engineer Specialist to join our team in New York City. This is a 6-month contract position with possible extensions, offering a salary of $120,000 per year.Job Overview:The ideal candidate will have extensive hands-on experience in big data engineering in cloud...


  • New York, New York, United States Blood Bank of Delmarva Full time

    Job DescriptionNew York Blood Center Enterprises (NYBCe) is a leading blood bank that provides blood products and services to hospitals and healthcare organizations. We are seeking a skilled Data Engineering Lead to join our team.The successful candidate will lead the architectural design and optimization of robust, scalable data pipelines using SQL, Python,...

  • Big Data Engineer

    5 days ago


    New York, New York, United States CapB InfoteK Full time

    At CapB InfoteK, we are seeking a highly skilled Big Data Engineer to join our team. The ideal candidate will have 8+ years of experience working with ETL, Hadoop, and related technologies. With a strong background in data warehousing and ETL tools, the successful candidate will be responsible for designing, developing, and implementing efficient ETL...

  • Big Data Engineer

    2 weeks ago


    New York, New York, United States InterSources Full time

    Job Summary:We are seeking an experienced Big Data Engineer to lead our ETL efforts. The successful candidate will have a strong background in building and optimizing data processing systems using cloud-based technologies such as Azure. This is an excellent opportunity for someone who wants to work on complex projects and collaborate with a talented team of...


  • New York, New York, United States Amazon Full time

    As a Sr. Data Engineer on the Amazon Publisher Monetization team, you will play a key role in shaping the future of monetization for Amazon's advertising-supported publishers.About This RoleThis is an exceptional opportunity to work with large datasets and design scalable real-time analytical solutions that meet the rapidly growing demands of rich data.The...


  • New York, New York, United States CapB InfoteK Full time

    Job OverviewWe are seeking a Big Data Engineering Specialist to join our team at CapB InfoteK. As a Big Data Engineering Specialist, you will be responsible for designing, developing and implementing highly efficient and scalable ETL processes.About the Role:Design develop and implement highly efficient highly scalable ETL processes.Strong knowledge of...


  • New York, New York, United States HexaQuEST Global, Inc. Full time

    HexaQuEST Global, Inc. is seeking a highly skilled Senior Big Data Engineer to join our team.We are offering an estimated salary of $120,000 per year for this role in the United States.About UsAs a leading provider of innovative solutions, HexaQuEST Global, Inc. prides itself on its commitment to excellence and customer satisfaction.Job DescriptionThis is a...


  • New York, New York, United States TechnoGen Full time

    About the RoleWe are looking for an experienced Big Data Engineer Specialist to join our team at TechnoGen. As a Big Data Engineer Specialist, you will be responsible for designing, developing, and optimizing data pipelines within the Snowflake data platform. Your expertise in AWS services, including Data Migration Service (DMS) and Kinesis, will be...


  • New York, New York, United States Capital One Services, LLC Full time

    About Capital One Services, LLCAt Capital One Services, LLC, we believe that data is the key to driving business success. As a Senior Data Engineer, you will be responsible for designing, developing, and deploying data solutions that transform the way we operate and interact with customers.Job SummaryThis is an exciting opportunity for a highly motivated...


  • New York, New York, United States Hudson Data Full time

    Hudson Data is a cutting-edge technology company that is seeking a highly skilled Azure Data Engineering Lead to join our team.We are looking for an experienced professional with hands-on knowledge of various Azure services, including but not limited to Azure Data Factory, Databricks, Data Lake, and Power BI. The ideal candidate should be able to design,...

  • Big Data Engineer

    6 days ago


    New York, New York, United States ShiftCode Analytics Full time

    Job Description:Hiring for a Big Data Engineer in New York. The ideal candidate will have 5+ years of experience in Hadoop and related technologies. Responsibilities include designing and implementing scalable data architectures, developing and maintaining large-scale data processing systems, and collaborating with cross-functional teams to ensure seamless...


  • New York, New York, United States CyberTec Full time

    Job Description: Devops Engineer for Big Data SolutionsCyberTec is looking for an experienced Devops Engineer to work on our big data projects. The successful candidate will have a strong background in Devops and big data, with excellent technical skills and experience in designing and implementing scalable and efficient solutions.Job Summary:Design and...


  • New York, New York, United States Capital One Full time

    Job OverviewCapital One is seeking a highly experienced Senior Lead Data Engineer to join our Card Data Organization & Data Foundations group. As a key member of this team, you will have the opportunity to drive major transformations within the organization and be on the forefront of driving innovation in big data technologies.About the RoleWe are looking...


  • New York, New York, United States S&P Global Full time

    Job Description:We're looking for a seasoned professional to lead our Data Lake team as a Senior Engineering Manager. The successful candidate will have extensive experience in designing and building large-scale data architectures using ETL/ELT pipelines on Databricks, Snowflake, and Azure Data Lake.This role requires a deep understanding of database and...

  • Data Engineering Lead

    12 hours ago


    New York, New York, United States 1stdibs Full time

    About the JobAt 1stDibs, we're driven by a passion for design and a commitment to empowering creatives. As a Data Engineering Lead, you'll be responsible for overseeing the design, development, and maintenance of our data pipelines and ETL/ELT processes. Your expertise will shape the future of our analytics capabilities, driving business growth and...


  • New York, New York, United States Early Warning Services Full time

    About Our TeamWe are Early Warning Services, a leading provider of payment solutions. We are seeking a highly skilled Big Data Analytics Expert to join our team.The successful candidate will be responsible for developing, documenting, testing, debugging, and maintaining data engineering solutions for Paze.The ideal candidate will have expertise in software...