Sr. Data Engineer

1 day ago

New York, United States Integrated Resources Full time

The Sr. data engineer will play a pivotal role in designing, building and operationalizing data pipelines that feed the enterprise data ecosystem for a variety of multi-faceted analytics created by data consumers. The data engineer needs to guarantee compliance with data governance and data security requirements while creating, improving and operationalizing integrated and reusable data pipelines. The data engineer will be measured on their ability to create repeatable, efficient, high-quality code, automation-friendly processes, and delivering work products quickly.

Responsibilities:
• Lead construction, maintenance, & optimization of data pipelines.
• Drive Automation through effective metadata management, using innovative and modern tools, techniques, and architectures to improve productivity.
• Lead renovation of the data management infrastructure to drive automation in data integration and management.
• Collaborate with multiple Analytics Center of Excellence teams and EIM team in refining their data requirements for various DnA initiatives and data consumption requirements.
• Identify gaps in new data initiatives and how to address new data requirements.
• Transfer knowledge of data and/or domain understanding in addressing new data requirements.
• Propose appropriate (and innovative) data ingestion, preparation, integration and operationalization techniques to optimize data requirements.
• Work with data governance teams to ensure data scientists and consumers use corresponding data responsibly through data governance and compliance initiatives.
• Design and implement data quality monitoring systems, which includes source-to-target data validations as well as anomaly detection

Requirements:
• Minimum 7 years of work experience in data management disciplines, including data integration, modeling, optimization and data quality, and/or other areas directly relevant to data engineering responsibilities and tasks.
• Minimum 7 years of hands-on experience designing and implementing production grade data warehousing solutions on large scale databases such as SQL Server, Oracle or DB2
• 5+ years data pipeline development experience with Informatica PowerCenter
• 3+ years of experience with advanced analytics tools for Object-oriented/object function scripting using languages such as R, Python, Java, C++, Scala, others
• 3+ years of experience with Client/Perl Scripting
• 5+ years of experience with popular database programming languages including SQL, PL/SQL (required), others for relational databases and certifications on upcoming NoSQL/Hadoop oriented databases (preferred) like MongoDB, Cassandra, others for nonrelational databases.
• Minimum 2 years designing and implementing a fully operational production grade large scale data solution on Snowflake Data Warehouse.

Preferred skills:
• Hands on experience with Palantir Foundry + AiP
• Preferred experience in working with data science teams in refining and optimizing data science and machine learning models and algorithms
• Full Lifecycle Data Warehouse, Data Mart Development experience is a big plus.
• Agile Software development methodologies
• Preferred experience with any automation tool such as AutoSys, Cntl-M

  • Sr. Director, Data Engineering

    22 hours ago

    New York, United States Capital One Full time

    Sr. Director, Data Engineering at Capital One summary: The Sr. Director of Data Engineering at Capital One will lead teams to establish a cohesive data strategy within the Card Technology organization, emphasizing high-performance data and fraud products. This role requires strong leadership and technical skills to attract talent and innovate solutions...

  • Sr. Director, Data Engineering

    2 days ago

    New York, United States Capital One Full time

    Sr. Director, Data Engineering Capital One is seeking a Senior Director, Data Engineering to work in our Card Technology organization. This individual will be accountable to drive a cohesive data strategy across our Card Data portfolio in collaboration with multiple enterprise partners. This role will build teams to deliver highly performant and scalable...

  • Sr. Director, Data Engineering

    1 day ago

    New York, United States Capital One Full time

    Sr. Director, Data Engineering at Capital One summary: The Sr. Director of Data Engineering at Capital One will lead teams to establish a cohesive data strategy within the Card Technology organization, emphasizing high-performance data and fraud products. This role requires strong leadership and technical skills to attract talent and innovate solutions...

  • Sr. Director, Data Engineering

    7 days ago

    New York, United States Capital One Full time

    Sr. Director, Data EngineeringCapital One is seeking a Senior Director, Data Engineering to work in our Card Technology organization. This individual will be accountable to drive a cohesive data strategy across our Card Data portfolio in collaboration with multiple enterprise partners. This role will build teams to deliver highly performant and scalable data...

  • Sr. Director, Data Engineering

    6 days ago

    New York, United States Capital One Full time

    Sr. Director, Data EngineeringCapital One is seeking a Senior Director, Data Engineering to work in our Card Technology organization. This individual will be accountable to drive a cohesive data strategy across our Card Data portfolio in collaboration with multiple enterprise partners. This role will build teams to deliver highly performant and scalable data...

  • Capital One | Sr. Director, Data Engineering

    23 hours ago

    New York, United States Capital One Full time

    Sr. Director, Data Engineering at Capital One summary: The Sr. Director of Data Engineering at Capital One will lead teams to establish a cohesive data strategy within the Card Technology organization, emphasizing high-performance data and fraud products. This role requires strong leadership and technical skills to attract talent and innovate solutions...

  • Sr. Data Engineer

    1 day ago

    New York, United States NBCUniversal Full time

    Job DescriptionJob DescriptionCompany DescriptionNBCUniversal owns and operates over 20 different businesses across 30 countries including a valuable portfolio of news and entertainment television networks, a premier motion picture company, significant television production operations, a leading television stations group, world-renowned theme parks and a...

  • Sr. Data Scientist

    6 days ago

    New York, United States MedMine LLC Full time

    Sr. Data Scientist needed w/Master’s Degree or Foreign Equivalent in Information Technology & Analytics or Computer Science or Computer Engineering or Data Analytics & one (1) year experience as Sr. Data Scientist or Data Scientist performing following job duties: Architect and implement machine learning models, leveraging Random Forest, SVM and neural...

  • Sr. Data Engineer/ Architect

    7 days ago

    New York, United States Compunnel Inc. Full time

    Role: Sr. Data Engineer/ ArchitectLocation: New York City, NY – (3 days onsite 2 day remote)Job type: Full Time only No Sponrship provided Primary Responsibility:Client is searching for a hands-on business-focused technology lead. The ideal candidate will have functional knowledge in Sales and Marketing processes and core data engineering technologies such...

  • Sr. Data Engineer/ Architect

    1 week ago

    New York, United States Compunnel Inc. Full time

    Role: Sr. Data Engineer/ ArchitectLocation: New York City, NY – (3 days onsite 2 day remote)Job type: Full Time only No Sponrship provided Primary Responsibility:Client is searching for a hands-on business-focused technology lead. The ideal candidate will have functional knowledge in Sales and Marketing processes and core data engineering technologies such...

  • Sr. Data Engineer/ Architect

    6 days ago

    New York, United States Compunnel Inc. Full time

    Role: Sr. Data Engineer/ ArchitectLocation: New York City, NY – (3 days onsite 2 day remote)Job type: Full Time only No Sponrship provided Primary Responsibility:Client is searching for a hands-on business-focused technology lead. The ideal candidate will have functional knowledge in Sales and Marketing processes and core data engineering technologies such...

  • Sr. Data Engineer

    1 day ago

    New York, United States UnitedMasters | Translation Full time

    Who We Are UnitedMasters is building a marketplace that connects artists, brands and fans - empowering artists to earn and grow. UnitedMasters has taken the bold step of building a music distribution service that, radically, puts artists first - disrupting the legacy music business by letting up-and-coming artists distribute their music directly to fans...

  • Capital One | Sr. Director, Data Engineering

    32 minutes ago

    new york city, United States Capital One Full time

    Sr. Director, Data Engineering at Capital One summary: The Sr. Director of Data Engineering at Capital One will lead teams to establish a cohesive data strategy within the Card Technology organization, emphasizing high-performance data and fraud products. This role requires strong leadership and technical skills to attract talent and innovate solutions...

  • Sr. Data Platform Engineer

    2 days ago

    New York, United States BBR Partners Full time

    Job DescriptionJob DescriptionFIRM OVERVIEWBBR Partners is a boutique wealth management firm providing customized investment strategies and bespoke advice to high-net-worth individuals and families. Our clients are comprised of the brightest minds in the financial and investing worlds, entrepreneurs, business owners, leaders, and influential families who...

  • Sr. Manager, Data Platform Engineering

    7 days ago

    New York, United States Vimeo Full time

    Job DescriptionJob DescriptionAt Vimeo, our mission is to help businesses drive impact through video. With a vibrant community of video professionals and the vast volume of video consumption and uploads on our platform, data plays a crucial role in our success. Vimeo supports about 200 million registered video creators, billions of monthly video views, and...

  • Sr Data Scientist

    1 day ago

    New York, United States StartUs GmbH Full time

    We seek an outstanding Sr. Data Scientist to join our Forecasting team in New York.  This individual will be responsible for developing enterprise-grade predictive models to estimate Spotify’s future user growth and content consumption. The output of your models will serve as the basis for the company’s financial forecast as well as provide context for...

  • Azure Data Engineering Expert

    7 days ago

    New York, New York, United States Hudson Data Full time

    Job DescriptionHudson Data is seeking an experienced Azure Data Engineer to design, implement, and maintain data solutions using Azure cloud services. The ideal candidate will develop ETL processes, optimize data pipelines, and ensure data quality and security. ResponsibilitiesDevelop ETL processes and optimize data pipelinesEnsure data quality and...

  • Senior Data Engineer Manager

    7 days ago

    New York, New York, United States Vish Consulting IT Full time

    About the RoleWe are looking for a highly skilled Sr. Data Engineer/Architect to lead our data engineering efforts. The ideal candidate will have functional knowledge in Sales and Marketing processes and core data engineering technologies such as databases, BI, ETL, and AI tools.Responsibilities include setting up Semarchy MDM tools and maintenance, strong...

  • Senior Lead Data Engineer

    19 hours ago

    New York, United States Capital One Full time

    Senior Lead Data Engineer at Capital One summary: As a Senior Lead Data Engineer at Capital One, you will lead a team in developing innovative solutions that leverage big data and cloud technologies to solve complex business challenges. Your role will involve collaborating with Agile teams, mentoring junior engineers, and utilizing programming languages such...

  • Master Data Engineer Leader

    4 days ago

    New York, New York, United States Monarch Staffing Full time

    Job OverviewWe are seeking a highly skilled Sr. Master Data Management (MDM) Engineer to join our team at Monarch Staffing. The ideal candidate will have experience in designing and delivering innovative MDM solutions, enabling secure and connected healthcare across NY State.