Current jobs related to Big Data Engineering Lead - New York, New York - InterSources


  • New York, New York, United States InterSources Full time

    Job Title: Big Data EngineerType: ContractLocation: New York, NY ( Day 1 onsite)Job Description:A Big Data Engineering lead handles the ETL jobs, Optimization, Automation of data processing for complex scenarios. This role requires expertise in designing and building ETL pipelines in ADF or ADLS Gen2, as well as experience with Spark, Synapse, and Azure...

  • Lead Data Engineer

    1 month ago


    New York, New York, United States Capital One Services, LLC Full time

    Job Title: Lead Data EngineerCapital One is seeking a Lead Data Engineer to join our team. As a Lead Data Engineer, you will be responsible for designing, developing, and implementing technical solutions in full-stack development tools and technologies.You will work with a team of developers with deep experience in machine learning, distributed...

  • Lead Data Engineer

    4 weeks ago


    New York, New York, United States Capital One Full time

    About the Role:Capital One is seeking a highly skilled Data Engineer to join our team. As a Lead Data Engineer, you will be responsible for designing, developing, and implementing technical solutions in full-stack development tools and technologies.Key Responsibilities:Collaborate with Agile teams to design and develop technical solutionsWork with a team of...

  • Lead Data Engineer

    1 month ago


    New York, New York, United States Capital One Full time

    Job DescriptionCapital One is seeking a Lead Data Engineer to join our team. As a Lead Data Engineer, you will be responsible for designing, developing, testing, implementing, and supporting technical solutions in full-stack development tools and technologies.You will work with a team of developers with deep experience in machine learning, distributed...

  • Lead Data Engineer

    4 weeks ago


    New York, New York, United States Capital One Full time

    About the Role:Capital One is seeking a skilled Data Engineer to join our team. As a Lead Data Engineer, you will be responsible for designing, developing, and implementing technical solutions in full-stack development tools and technologies. You will work closely with Agile teams to deliver robust cloud-based solutions that drive powerful experiences for...

  • Scala Spark Lead

    4 weeks ago


    New York, New York, United States Chabez Tech Full time

    Job Title: Scala Spark Lead - Senior Data EngineerJob Role:We are seeking a highly skilled Scala Spark Lead to join our dynamic team at Chabez Tech. In this role, you will lead the design, development, deployment, and optimization of data processing applications using Spark and Scala.Key Responsibilities:Design, develop, and maintain data processing...


  • New York, New York, United States Hudson Data Full time

    Job Title: Senior Azure Data EngineerLocation: NYC, NYDuration: Long Term W2 RoleJob Description:The ideal candidate should have hands-on experience with various Azure services, including Azure Data Factory, Databricks, Data Lake, and Power BI. They should be able to design, build, and maintain ETL pipelines, manage data lakes, and create insightful reports...


  • New York, New York, United States The Data Sherpas Full time

    About The Data SherpasWe are a team of highly skilled and motivated engineers who help our clients at every phase of their cloud journey.Our team has extensive experience in data and analytics engineering, with a strong foundation in Snowflake, FiveTran, and DBT.We are looking for a self-motivated and data-driven engineer to join our team and collaborate...

  • Data Engineering Lead

    4 weeks ago


    New York, New York, United States Blood Bank of Delmarva Full time

    Job Title: Data Engineering LeadDescription:We are seeking a highly skilled Data Engineering Lead to join our team at the Blood Bank of Delmarva. As a key member of our data engineering team, you will be responsible for designing, implementing, and leading initiatives for optimizing databases and data pipelines.Responsibilities:* Lead the architectural...

  • Senior Data Engineer

    4 weeks ago


    New York, New York, United States Neudesic Full time

    Job Summary:We are seeking a highly skilled Data Science and Engineering Expert to join our team at Neudesic. As a key member of our data engineering team, you will be responsible for designing, developing, and implementing large-scale distributed systems and pipelines that process large volumes of data.Key Responsibilities:Design and develop complex data...

  • Data Engineer Lead

    4 weeks ago


    New York, New York, United States Pfizer Full time

    Pfizer is seeking a highly skilled Data Engineer to lead the development of its cloud-based data lake and drive digital transformation across the enterprise.The successful candidate will design, architect, and build data products that span the areas of supply chain execution, planning, manufacturing, quality, logistics, and more.As a Data Engineer Lead, you...

  • Data Engineering Lead

    1 month ago


    New York, New York, United States Pfizer Full time

    Job SummaryPfizer is seeking a highly skilled Data Engineering Lead to join our team. As a key member of our Enterprise Data and Analytics team, you will be responsible for designing and delivering data products that drive business outcomes. You will work closely with our Digital Partners, Enterprise Architecture, and Business Unit stakeholders to develop...


  • New York, New York, United States Tech Tammina Full time

    Position: Data Engineer (with expertise in AI and data products)We are seeking a highly skilled Data Engineer to join our team at Tech Tammina. As a Data Engineer, you will be responsible for building data pipelines using DBT, ELT, and Python, as well as working with big data platforms like Redshift and Snowflake. You will also be expected to have advanced...

  • Lead Data Engineer

    4 weeks ago


    New York, New York, United States Rhode Island Blood Center Full time

    Job Title: Data Infrastructure ArchitectJob Summary:We are seeking a highly skilled Data Infrastructure Architect to lead the design and implementation of our data infrastructure. As a key member of our team, you will be responsible for architecting and implementing scalable, secure, and efficient data pipelines using SQL, Python, and cloud-based ETL tools...


  • New York, New York, United States Vic Full time

    About VicVic is a cutting-edge technology company that's revolutionizing the way businesses operate. We're a team of innovators, entrepreneurs, and experts in AI, data engineering, and cloud computing.Job DescriptionWe're seeking an exceptional Data Engineering Manager to join our team. As a key member of our engineering leadership, you'll be responsible for...


  • New York, New York, United States Capital One Services, LLC Full time

    About the Role:We are seeking a Senior Lead Data Engineer to join our team at Capital One Services, LLC. As a Senior Lead Data Engineer, you will be responsible for leading a team of developers in designing, developing, and implementing technical solutions in full-stack development tools and technologies.Key Responsibilities:Collaborate with Agile teams to...


  • New York, New York, United States City of New York Full time

    Job Title: Data Engineering Team LeadJob Summary:The City of New York is seeking a highly skilled Data Engineering Team Lead to join the Information Technology Division (ITD). As a key member of the Data Engineering team, you will be responsible for leading a team of data engineers, planning and executing projects, and ensuring the delivery of high-quality...


  • New York, New York, United States RiVi Consulting Group Full time

    Job SummaryAs a seasoned Spark Developer at RiVi Consulting Group, you will play a vital role in designing and implementing cutting-edge big data solutions. Your expertise in Spark and HDFS will enable us to deliver scalable and efficient data processing capabilities to drive business growth.Key Responsibilities• Collaborate with stakeholders to understand...


  • New York, New York, United States 1stdibs Full time

    Job DescriptionAt 1stDibs, we're seeking a seasoned Data Engineering Director to lead our data engineering team and drive the design, development, and maintenance of our data pipelines and ETL/ELT processes. As a key member of our analytics team, you'll collaborate closely with engineers, product teams, and stakeholders to ensure data availability for...

  • Data Engineer Lead

    4 weeks ago


    New York, New York, United States GroupM Choreograph Full time

    Job SummaryGroupM Choreograph is seeking a highly skilled Data Engineer to lead the design and implementation of cloud-based data solutions. The ideal candidate will have a strong background in data engineering, cloud platforms, and business intelligence tools.Key ResponsibilitiesDesign and build cloud-based data solutions using data engineering platforms...

Big Data Engineering Lead

1 month ago


New York, New York, United States InterSources Full time
Job Title:
Big Data Engineer

Type:
Contract

Location:
New York, NY ( Day 1 onsite)

Job Description:
A Big Data Engineering lead handles the ETL jobs, Optimization, Automation of data processing for complex scenarios. The ideal candidate will have expertise in designing and building ETL pipelines in Azure Data Factory (ADF) or Azure Data Lake Storage Gen2 (ADLS Gen2). They will also be proficient in using Spark, Synapse, and Azure Databricks or Azure Purview to process data from Azure data lake. Additionally, they should have experience in downloading data from UDL and ingesting it in PDS, with good experience in ADF. The candidate should be an expert in Spark for structured, semi-structured, and unstructured data processing and have hands-on knowledge in Azure Databricks or Azure Purview, Synapse. They should be able to design constructs for different data sets and come up with reusable templates for the same. They should also have experience of implementing Data Quality methodologies to pre-empt errors in patterns and to identify Data Quality issues.

About Us:


InterSources Inc , a Certified Diverse Supplier, was founded in 2007 and offers innovative solutions to help clients with Digital Transformations across various domains and industries.

Our history spans over 16 years and today we are an Award-Winning Global Software Consultancy solving complex problems with technology.

We recognize that our employees and our clients are our strengths as the diverse talents and opportunities they bring to the table enable us to grow as a global platform and they are causally linked with our success.

We provide strategic and technical advice, and we have expertise in areas covering

Artificial Intelligence, Cloud Migration, Custom Software Development, Data Analytics Infrastructure & Cloud Solutions, Cyber Security Services,

etc.

We make reasonable accommodations for clients and employees and we do not discriminate based on any protected attribute including race, religion, color, national origin, gender sexual orientation, gender identity, age, or marital status.

We also are a

Google Cloud partner

company.

We align strategy with execution and provide secure service solutions by developing and using the latest technologies that thrive our resources to deliver industry-leading capabilities to our clients and customers, making it convenient for our clients to do business with InterSources Inc.

Our teams also drive growth by refining technology-driven client experiences that put the users first, providing an unparalleled experience.

This results in strengthening the core technologies of clients, enabling them to scale with flexibility, create seamless digital experiences and build lifelong relationships.