Data Engineer II

4 days ago

New York, New York, United States CDW Full time

The Senior Software Engineer II - Data will play a pivotal role in building and operationalizing the minimally inclusive data necessary for the enterprise data and analytics initiatives following best practices. The bulk of the data engineer's work would be in building, managing and optimizing data pipelines and then moving these data pipelines effectively into production for key data and analytics consumers like business/data analysts, data scientists or any persona that needs curated data for data and analytics use cases across the enterprise.

Key Responsibilities:

  • Develops and maintains scalable data pipelines to support continuing increases in data volume and complexity.
  • Interface with other technology teams to extract, transform, and load data from a wide variety of data sources using big data technologies and SQL.
  • Collaborates with business teams to improve data models that feed business intelligence tools, increasing data accessibility and fostering data-driven decision making across the organization.
  • Collaborate with other technology teams to help engineer data sets that data science teams uses to implement advanced analytics algorithms that exploit our rich datasets for statistical analysis, prediction, clustering and machine learning.
  • Responsible for using innovative and modern tools, techniques and architectures to partially or completely automate the most-common, repeatable and tedious data preparation and integration tasks in order to minimize manual and error-prone processes and improve productivity.
  • Train counterparts such as data scientists, data analysts, data consumers in data pipelines and preparation techniques, which make it easier for them to integrate and consume the data they need for their own use cases.
  • Helps ensure compliance and governance during use of data.
  • Be curious and knowledgeable about new data management techniques and how to apply them to solve business problems.

Qualifications:

  • BS or MS degree in Computer Science or a related technical field.
  • 7+ years data application development experience.

Requirements:

  • Strong experience with various Data Management architectures like Data Warehouse, Data Lake, Data Hub and the supporting processes like Data Integration, Governance, Metadata Management.
  • Extensive experience with popular data processing languages including SQL, PL/SQL, Python, others for relational databases and on NoSQL/Hadoop oriented databases like MongoDB, Cassandra, others for nonrelational databases.
  • Demonstrated ability to build rapport and maintain productive working relationships cross-departmentally and cross-functionally.
  • Demonstrated ability to coach and mentor others.
  • Excellent written and verbal communication skills with the ability to effectively interact with and present to all stakeholders including senior leadership.
  • Strong organizational, planning and creative problem solving-skills with critical attention to detail.
  • Demonstrated success of facilitation and solutions implementation.
  • History of balancing competing priorities with the ability to adapt to the changing needs of the business while meeting deadlines.

Preferred Qualifications:

  • Extensive experience with Azure Data Factory.
  • Extensive experience working with cloud platform (at least one of Azure, AWS, GCP).
  • Experience with ETL Tools (SSIS, Informatica, Ab Initio, Talend), Python, Databricks, Microsoft SQL Server Platform (version 2012 or later), and/or working in an Agile environment.

  • Data Engineer for Cloud Data Platforms

    1 month ago

    New York, New York, United States The Data Sherpas Full time

    About The Data SherpasWe are a team of highly skilled and motivated engineers who help our clients at every phase of their cloud journey. Our expertise spans cloud infrastructure, data engineering, and application development.Job DescriptionWe are seeking a self-motivated and data-driven engineer to join our team. As a Data Engineer for Cloud Data Platforms,...

  • Data Engineer II

    1 week ago

    New York, New York, United States Memorial Sloan Kettering Full time

    Job DescriptionAt Memorial Sloan Kettering Cancer Center, we are seeking a highly skilled Data Engineer II to join our Data Management team. As a Data Engineer II, you will play a critical role in shaping and maintaining the data infrastructure of our organization. This is a mid-level professional position that requires making tactical decisions based on...

  • Data Engineer II

    4 days ago

    New York, New York, United States Memorial Sloan Kettering Full time

    Job DescriptionWe are seeking a skilled Data Engineer II to join our Data Management team at Memorial Sloan Kettering. In this role, you will be responsible for developing and maintaining the data infrastructure of our organization.Key Responsibilities:Develop and manage data pipelines to ensure seamless data flow from various sources into our repository...

  • Data Engineer for Cloud Data Platform

    1 month ago

    New York, New York, United States The Data Sherpas Full time

    Job Title: Data Engineer for Cloud Data PlatformThe Data Sherpas are seeking a highly skilled Data Engineer to join our team and help our clients at every phase of their cloud journey. As a Data Engineer, you will be responsible for designing, building, and maintaining scalable data platforms on cloud-based infrastructure.Responsibilities:Design and...

  • Data Engineer for Cloud Data Platforms

    3 weeks ago

    New York, New York, United States The Data Sherpas Full time

    About The Data SherpasWe are a team of highly skilled and motivated engineers who help our clients at every phase of their cloud journey.Our expertise spans cloud infrastructure, data engineering, and analytics, with a focus on Snowflake, FiveTran, and DBT.Job DescriptionWe are seeking a self-motivated and data-driven engineer to join our team and help our...

  • Data Engineer II

    5 days ago

    New York, New York, United States Mount Sinai Health System Full time

    Job Title: Data Engineer IIJob Summary:We are seeking a skilled Database Engineer to join our team within the Division of Data Driven and Digital Medicine (D3M) and Institute for Critical Care Medicine (ICCM).Responsibilities:- Facilitate data collection from a variety of different sources, getting it in the right formats, assuring that it adheres to data...

  • Senior Azure Data Engineer

    5 days ago

    New York, New York, United States Hudson Data Full time

    Job Title: Senior Azure Data EngineerLocation: NYC, NYDuration: Long Term W2 RoleJob Description:The ideal candidate should have hands-on experience with various Azure services, including Azure Data Factory, Databricks, Data Lake, and Power BI. They should be able to design, build, and maintain ETL pipelines, manage data lakes, and create insightful reports...

  • Data Engineer for Cloud Data Platforms

    2 weeks ago

    New York, New York, United States The Data Sherpas Full time

    Who We Are:The Data Sherpas are a team of highly skilled and motivated engineers who help our clients at every phase of their cloud journey. We have expertise in cloud, data, and applications, and we're passionate about delivering innovative solutions that drive business value.What We're Looking For:We're seeking a self-motivated and data-driven engineer to...

  • Azure Data Engineer

    1 week ago

    New York, New York, United States Hudson Data Full time

    Job Title: Azure Data Engineer - Design and Implement Data SolutionsLocation: NYC, NYDuration: Long Term W2 RoleJob Description:The ideal candidate will have hands-on experience with various Azure services, including Azure Data Factory, Databricks, Data Lake, and Power BI. They should be able to design, build, and maintain ETL pipelines, manage data lakes,...

  • Data Engineer for Cloud Data Platforms

    2 weeks ago

    New York, New York, United States The Data Sherpas Full time

    Job Description:The Data Sherpas are a team of skilled engineers who help clients with their cloud journey. We are looking for a self-motivated and data-driven engineer to join our team.Responsibilities:Leverage DBT on Snowflake to build scalable transformations for landed dataBuild business logic and transform raw data for analytic, ML, and reporting use...

  • Data Engineering Specialist

    4 days ago

    New York, New York, United States The Data Sherpas Full time

    About The Data SherpasWe are a team of highly skilled and motivated engineers who help our clients at every phase of their cloud journey.Our team has extensive experience in data and analytics engineering, with a strong foundation in Snowflake, FiveTran, and DBT.We are looking for a self-motivated and data-driven engineer to join our team and collaborate...

  • Data Scientist II

    1 week ago

    New York, New York, United States POINT72, L.P. Full time

    Job Title: Data Scientist II - MI DataJob Summary:Point72, L.P. is seeking a highly skilled Data Scientist II to join our team in New York, NY. As a Data Scientist II, you will be responsible for conducting research through data mining and statistical modeling to discover insights from Big Data that are used by investment professionals to make investment...

  • Data Engineer II-MSH-Psychiatry

    2 weeks ago

    New York, New York, United States Mount Sinai Hospital Full time

    About the RoleWe are seeking a highly skilled Data Engineer II to join our team at Mount Sinai Hospital. As a key member of our data engineering team, you will play a critical role in designing, developing, and deploying complex scientific software solutions for basic and clinical research studies.Key ResponsibilitiesDesign and develop scalable data...

  • Data Engineer II-MSH-Psychiatry

    3 weeks ago

    New York, New York, United States Icahn School of Medicine at Mount Sinai Full time

    About the RoleWe are seeking a highly skilled Data Engineer II to join our team at the Icahn School of Medicine at Mount Sinai. As a key member of our data engineering team, you will play a critical role in designing and implementing complex data systems to support our research initiatives.Key ResponsibilitiesDesign and deploy scalable data pipelines to...

  • Data Engineer II, MI

    1 week ago

    New York, New York, United States POINT72, L.P. Full time

    Job Summary:Point72, L.P. is seeking a highly skilled Data Engineer II to join our team in New York, NY. This is a hybrid role, allowing for up to 2 days of remote work per week. The successful candidate will be responsible for building and maintaining big data processing pipelines, developing solutions for processing large and unstructured data sets, and...

  • Senior Data Engineer

    1 week ago

    New York, New York, United States The Data Sherpas Full time

    Job SummaryWe are seeking a highly skilled Senior Data Engineer to lead our team in designing, developing, and deploying high-performance data analytics solutions on Google Cloud Platform (GCP). As a key member of our team, you will be responsible for architecting transformation and modernization of enterprise data solutions on GCP, integrating native GCP...

  • Data Engineer II

    5 days ago

    New York, New York, United States Mediavine Full time

    About the Role:Mediavine is seeking an experienced Data Engineer to join our engineering team. As a Data Engineer at Mediavine, you will play a key role in building and maintaining our data infrastructure. This includes creating scalable data pipelines, managing transformation processes, and ensuring data quality and security at all steps along the...

  • Data Product Manager II

    4 weeks ago

    New York, New York, United States Hulu Full time

    Job Title: Senior Data Product Manager IIDisney Entertainment & ESPN Technology is seeking a highly skilled Senior Data Product Manager II to join its Commerce, Growth and Identity (CGI) organization. In this role, you will be responsible for delivering data products and solutions for the Acquisition Marketing vertical of Disney Streaming.About the RoleThis...

  • Senior Data Engineer

    3 weeks ago

    New York, New York, United States CDW Full time

    Job Title: Senior Software Engineer II - DataThe Senior Software Engineer II - Data will play a pivotal role in building and operationalizing the minimally viable data necessary for the enterprise data and analytics initiatives following best practices. The bulk of the data engineer's work would be in building, managing, and optimizing data pipelines and...

  • Project Engineer

    2 weeks ago

    New York, New York, United States Engineer Rec Full time

    Project Engineer Job DescriptionWe are seeking a highly skilled Project Engineer to join our team at Engineer Rec. The successful candidate will be responsible for performing engineering work, project preparation, and providing operational support for multiple projects along the East Coast, USA.Key Responsibilities:Develop and maintain project documentation,...