Big Data Engineering Lead

3 days ago


New York, New York, United States InterSources Full time
Job Title: Big Data Engineer Lead

A highly skilled Big Data Engineer Lead is required to handle the ETL jobs, optimization, and automation of data processing for complex scenarios.

Responsibilities:
  • Data ingestion from various sources
  • Data quality checks and validation
  • Designing and implementing ETL pipelines in ADF or ADLS Gen2
  • Building features and variables for data processing
  • Ensuring data quality and integrity
Requirements:
  • Subject matter expert in building and designing ETL pipelines
  • Proficient in using Spark, Synapse, and Azure Data Lake
  • Experience in downloading data from UDL and ingesting in PDS
  • Hands-on knowledge in Azure Databricks or Azure Purview, Synapse
  • Ability to design constructs for different data sets and create reusable templates
  • Experience in implementing Data Quality methodologies
About Us:

InterSources Inc is a Certified Diverse Supplier and a Google Cloud partner company. We offer innovative solutions to help clients with Digital Transformations across various domains and industries.

We provide strategic and technical advice, and we have expertise in areas covering Artificial Intelligence, Cloud Migration, Custom Software Development, Data Analytics Infrastructure & Cloud Solutions, Cyber Security Services, and more.

We make reasonable accommodations for clients and employees and we do not discriminate based on any protected attribute.



  • New York, New York, United States SAIC Full time

    Job Title: Big Data Engineer/ArchitectSAIC is seeking an experienced professional to support the US Air Force Agency for Modeling and Simulation (AFMS) program. This is a fully remote position with no travel or onsite requirements.About the RoleThe Big Data Engineer/Architect will be responsible for designing and implementing big data solutions to support...

  • Data Architect Lead

    6 days ago


    New York, New York, United States CTI DATA Full time

    Join Our Team of Data and Analytics ExpertsWe are seeking a highly skilled and experienced Data Architect Lead to join our team at CTI Data. As a key member of our team, you will be responsible for crafting modern data and analytics solutions for our Global 2000 customers.Key ResponsibilitiesLead the development of cloud data strategies and implementation...

  • Data Engineer Lead

    5 days ago


    New York, New York, United States PMX Full time

    About PMX:PMX is a leading media and technology company that provides innovative solutions to its clients. Our team is dedicated to delivering exceptional results and pushing the boundaries of what is possible.Job Description:We are seeking a highly skilled Lead Data Engineer to join our team. As a Lead Data Engineer, you will be responsible for designing,...

  • Data Engineer Lead

    5 days ago


    New York, New York, United States PMX Full time

    Job Title: Lead Data EngineerAt PMX, we're seeking a highly skilled Lead Data Engineer to join our team. As a key member of our engineering team, you will be responsible for designing, developing, and implementing data-driven software platforms.Responsibilities:Analyze business requirements and collaborate with the product team to provide strategic...


  • New York, New York, United States Fidelity Information Services Full time

    About the RoleWe are seeking a highly skilled Big Data Administrator to join our team at Fidelity Information Services. As a key member of our team, you will be responsible for designing, implementing, and maintaining our Enterprise Hadoop environment.Key ResponsibilitiesInstall and configure Hadoop clusters, ensuring optimal performance and...


  • New York, New York, United States The Data Sherpas Full time

    About The Data SherpasWe are a team of highly skilled and motivated engineers who help our clients at every phase of their cloud journey. Our expertise spans cloud infrastructure, data engineering, and application development.Job DescriptionWe are seeking a self-motivated and data-driven engineer to join our team. As a Data Engineer for Cloud Data Platforms,...


  • New York, New York, United States The Data Sherpas Full time

    About The Data SherpasWe are a team of highly skilled and motivated engineers who help our clients at every phase of their cloud journey. Our expertise spans cloud infrastructure, data engineering, and application development.Job DescriptionWe are seeking a self-motivated and data-driven engineer to join our team. The ideal candidate will have a solid...


  • New York, New York, United States The Data Sherpas Full time

    About The Data SherpasWe are a team of highly skilled and motivated engineers who help our clients at every phase of their cloud journey.Our expertise spans cloud infrastructure, data engineering, and analytics, with a focus on delivering scalable and intuitive solutions.Job DescriptionWe are seeking a self-motivated and data-driven engineer to join our team...

  • Lead Data Architect

    5 days ago


    New York, New York, United States Hulu Full time

    Job Title: Lead Data EngineerJob Summary:Hulu is seeking a highly skilled Lead Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data systems that support our business needs.Key Responsibilities:Design and develop scalable data architectures and...

  • Data Engineering Lead

    2 weeks ago


    New York, New York, United States Career Renew Full time

    Career Renew is Recruiting a Lead Data EngineerWe are seeking a highly skilled Lead Data Engineer to join our team at Career Renew. As a key member of our organization, you will play a critical role in designing and scaling our data infrastructure.Key Responsibilities:Indexing Complex Onchain Data: Design systems that index complex onchain data for ease of...

  • Data Engineer Intern

    2 weeks ago


    New York, New York, United States Point72 Full time

    About Point72Point72 Asset Management is a global investment firm that seeks to deliver superior risk-adjusted returns through a disciplined and research-driven approach. With a strong commitment to ethics and a focus on developing the industry's brightest talent, we offer a unique opportunity for individuals to grow and succeed in a dynamic and challenging...

  • PySpark Data Engineer

    2 weeks ago


    New York, New York, United States Oakridge Staffing Full time

    Job Title: PySpark Data EngineerAbout Oakridge Staffing:Oakridge Staffing is a leading provider of top talent to the hospitality industry.Job Summary:We are seeking an experienced PySpark Data Engineer to join our team at Oakridge Staffing. As a key member of our data engineering team, you will be responsible for designing and developing data pipelines and...


  • New York, New York, United States Nexxen Full time

    About NexxenNexxen is a leading digital video advertising company that enables quality advertising across various digital content platforms. Our mission is to provide innovative solutions for our partners and clients worldwide.Job OverviewWe are seeking a highly skilled Senior Big Data Engineer to join our Data Engineering team in New York. As a key member...

  • Lead Data Engineer

    3 weeks ago


    New York, New York, United States Arcesium Full time

    Arcesium seeks an exceptional technology leader to join our Data Platform team. The ideal candidate will help architect and implement the next generation of our data platform, leveraging expertise in distributed systems, modern data lake technology, and infrastructure.Key ResponsibilitiesDesign and develop cutting-edge technology used by leading financial...

  • Data Engineering Lead

    20 hours ago


    New York, New York, United States Algobrain Full time

    Job Title: Lead Data EngineerAt Algobrain, we are seeking a highly skilled Lead Data Engineer to lead the design and development of enhanced data services and cloud enablement for Data and Services. As a key member of our team, you will push the limits of the state of the art with best-in-class data product enablement in the cloud and design the roadmap to...

  • Data Engineer Lead

    2 weeks ago


    New York, New York, United States PMX Full time

    About PMX:PMX is a leading media and technology company that empowers businesses to thrive in a rapidly changing world.Job Description:We are seeking a highly skilled Data Engineer Lead to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and implementing data-driven software platforms that drive...

  • Azure Data Engineer

    3 weeks ago


    New York, New York, United States Chelsoft Solutions Co Full time

    Job Description**Job Summary**Chelsoft Solutions Co is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, implementing, and maintaining large-scale data pipelines and architectures on our Enterprise Data & Analytics Platform.Key ResponsibilitiesDesign and implement data pipelines using...

  • DevOps Engineer

    16 hours ago


    New York, New York, United States NTT DATA Full time

    Job Title: DevOps Engineer - Data Center OperationsWe are seeking a highly skilled DevOps Engineer to join our team in New York, NY. As a DevOps Engineer, you will be responsible for designing and implementing efficient batch workflows, configuring and scheduling batch processing systems, and troubleshooting issues to ensure business continuity.Key...

  • Data Engineer

    1 week ago


    New York, New York, United States Ascendion Full time

    About AscendionWe are a full-service digital engineering solutions company that empowers growth and delivers captivating experiences to consumers and employees. Our engineering, cloud, data, experience design, and talent solution capabilities accelerate transformation and impact for enterprise clients.Headquartered in New Jersey, our workforce of 6,000+...


  • New York, New York, United States Big Cloud Full time

    Revolutionary Technology and Large-Scale NLPWe're seeking a highly skilled Senior Software Engineer to join our world-class team at Big Cloud. As a key member of our engineering team, you'll be responsible for building scalable systems and shaping the infrastructure, APIs, and deployment process behind our cutting-edge content discovery platform.Key...