Data Engineering Professional

6 days ago


New York, New York, United States HR Recruiting Services Full time

Job Summary

">
  • We are seeking a highly skilled Data Cloud Engineer to join our team at HR Recruiting Services.
">

About the Role

">

The successful candidate will be responsible for taking ownership of the entire data engineering lifecycle, including design, implementation, performance tuning, and monitoring. They will work closely with the firms database managed service provider (MSP) to manage and monitor evolving database requirements. Additionally, they will design, develop, and maintain scalable data pipelines and ETL processes critical to support business operations and analytics using Python and SQL.

">

Key Responsibilities

">
  • Design, develop, and maintain scalable data pipelines and ETL processes
  • Manage and work with the firms database MSP to manage and monitor evolving database requirements
  • Optimize and tune data systems for high performance and reliability
  • Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality data solutions
  • Implement and manage data storage solutions in cloud environments
  • Ensure data quality and integrity through rigorous testing and validation
  • Continuously evaluate and integrate new technologies and tools to improve data processing capabilities
  • Manage distributed scheduled tasks on individual servers to a centralized ruleset
  • Work with the development team and database MSP to modernize the backup and recovery strategy for 3-4 SQL servers across different cloud environments
  • Support the addition of new tenants on the firms production data platform
">

Requirements

">
  • Bachelors or Masters degree in Computer Science, Engineering, Information Technology, or a related field from a top-tier university
  • 4-5 years of relevant professional experience in data engineering
  • Strong programming skills in SQL and Python
  • Proficiency in database administration
  • Proven experience migrating on-prem data and associated processes to cloud platforms
  • Demonstrated ability to design and implement efficient and reliable data pipelines and ETL processes
  • Strong problem-solving skills and ability to troubleshoot complex data issues
  • Excellent communication skills and ability to work collaboratively in a team environment
  • A proactive mindset with a willingness to take ownership and drive projects to completion
  • Experience with monitoring, CI/CD, Load Balancing, and Testing tools
">

Preferred Qualifications

">
  • Knowledge of fixed-income or equity data and/or risk management in a fixed-income environment
  • Experience managing and updating technologies such as Jenkins, NGINX, Celery, Octopus, TeamCity
  • Experience with front-end programming languages/tools such as JavaScript, TypeScript, React, or AG-Grid
">

Salary and Benefits

">

The estimated salary for this position is $120,000 - $150,000 per year, depending on experience. We also offer a comprehensive benefits package, including medical, dental, and vision insurance, 401(k) matching, and paid time off.



  • New York, New York, United States Ness Digital Engineering Full time

    Ness Digital Engineering, a pioneering firm in digital advisory and scaled engineering services, invites applications for a Digital Engineering Professional role. Based in Hudson yards, NY, this is a full-time position that offers an exciting blend of strategy and technology.Estimated Salary: $120,000 - $180,000 per yearThis role requires a Python Full Stack...


  • New York, New York, United States Delphi-US Full time

    Job Title: Senior ELT Data EngineerDescription:We're seeking a Senior ELT Data Engineer to develop and implement our new enterprise data warehousing architecture. The ideal candidate will have advanced experience with dbt, Snowflake, Fivetran, and GitHub, and will be responsible for designing, developing, testing, deploying, and supporting data pipelines and...


  • New York, New York, United States Jane Street Full time

    About the RoleWe are seeking a talented Data Engineer to join our team at Jane Street. As a Data Engineer, you will play a critical role in helping us understand, clean, manage, and share data that guides our trading activities.Our team utilizes a mix of in-house and open-source software to analyze datasets from various sources, identify anomalies, match...


  • New York, New York, United States Diverse Lynx Full time

    **Job Title:** Azure Data EngineerJob Summary: We are seeking a talented Data Engineer to lead a critical project in the insurance domain. The ideal candidate will have experience in developing and managing cutting-edge technology applications, with a passion for technology and data analysis.Key Responsibilities:Develop and manage data pipelines using Azure...

  • Cloud Data Engineer

    2 weeks ago


    New York, New York, United States HR Recruiting Services Full time

    Job Description:We are seeking an experienced Cloud Data Engineer to join our team at HR Recruiting Services. This is a challenging and rewarding opportunity for a skilled professional with a strong background in data engineering and cloud computing.About the Role:This role will be responsible for designing, implementing, and maintaining scalable data...


  • New York, New York, United States Alethea LLC Full time

    Job Title: Senior Data EngineerAbout Us:Alethea LLC is a technology company that specializes in detecting and mitigating disinformation and social media manipulation.Job Summary:We are seeking a highly skilled Senior Data Engineer to design, implement, and maintain our backend data processing pipeline.Responsibilities:• Lead complex projects with...


  • New York, New York, United States Encora Full time

    About the RoleWe're seeking a skilled Data Engineer to join our team at Encora. As a Data Engineer, you will be responsible for ensuring that data is received, verified, transformed, stored, and accessible to the team.Key ResponsibilitiesBuild and promote data pipeline management and database maintenanceGather and prepare data to be analyzed and worked on,...


  • New York, New York, United States Tech Tammina Full time

    Job Title: Data EngineerJob Type: Full TimeResponsibilities:Ingesting, structuring, and analyzing a wide range of unstructured data sourcesDesigning, maintaining, and orchestrating data pipelines in an AWS environment for production processing and training flowsContinuously evaluating, analyzing, testing, and improving the quality, privacy, and performance...


  • New York, New York, United States Data Intellect Full time

    Job OverviewWe are seeking a skilled kdb+ data analyst specialist to join our team at Data Intellect.This role involves working with business users to define requirements for new application functionality, developing and testing code for client applications, and supporting project delivery as part of a collaborative team.About the RoleDevelop and implement...


  • New York, New York, United States Capital One Full time

    About UsCapital One is a leading financial institution dedicated to empowering individuals and families to achieve financial freedom. We are committed to innovation, collaboration, and diversity in our workplace.Job SummaryWe are seeking an experienced Data Transformation Engineer to join our team. As a key member of our data engineering group, you will...


  • New York, New York, United States Canoe Intelligence Full time

    We are seeking a skilled Data Engineer to join our team at Canoe Intelligence. Our ideal candidate will have a strong background in software development and data engineering, with experience working with large datasets.Job OverviewAs a Data Engineer at Canoe Intelligence, you will play a critical role in designing and building scalable, reliable, and...


  • New York, New York, United States WebMD Full time

    Job Title:Lead, Data EngineeringJob Summary:The ideal candidate has experience and passion for data engineering with expertise in front-end (data visualization, DAX, Power BI, SQL) or back-end (SSIS, Azure Data Factory, Synapse, data modeling, SQL) of the data engineering world.Responsibilities:Builds software to extract, transform, and load data using SSIS,...


  • New York, New York, United States Rhode Island Blood Center Full time

    Lead Data EngineerAt Rhode Island Blood Center, we are seeking a highly skilled Lead Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, implementing, and leading initiatives for optimizing databases and data pipelines.Key Responsibilities:Lead the architectural design and optimization of...


  • New York, New York, United States INFOTRON Full time

    Job Title: Data Engineering SpecialistINFOTRON seeks a detail-oriented Data Engineer to analyze large amounts of raw data and discover patterns and insights.About the Role:We are looking for an analytical professional with a passion for data to collect, analyze, and present findings in an easy-to-understand manner. The ideal candidate will design, develop,...

  • Data Engineer Manager

    2 months ago


    New York, New York, United States DataBricks Full time

    Job DescriptionWe are seeking a highly experienced Data Engineer Manager to lead our Field Engineering team. As a key member of our organization, you will be responsible for building and leading a team of technical pre-sales professionals to drive business growth in the Financial Services vertical.Key Responsibilities:Lead a team of Solutions Architects to...


  • New York, New York, United States Capital One Services, LLC Full time

    About This RoleThis is a critical role for Capital One Services, LLC, where we are seeking a seasoned Data Engineer to join our team. As a Data Engineer, you will play a key part in designing, developing, and implementing cutting-edge data solutions that drive business growth and customer satisfaction.Key Responsibilities:Collaborate with cross-functional...


  • New York, New York, United States FleishmanHillard Full time

    About the RoleMethods+Mastery is seeking an experienced Data Engineer to join our talented team. The ideal candidate will have a strong background in building scalable data pipelines that process unstructured text data.ResponsibilitiesDesign and Build Scalable Data Pipelines: Develop and maintain efficient data pipelines, ETL processes, and data integration...


  • New York, New York, United States Infojini Full time

    **Job Description:**We are seeking a highly skilled Data Engineering Expert to join our team at Infojini. As a key member of our data engineering team, you will be responsible for designing and implementing scalable data pipelines that meet the needs of our business.**Key Responsibilities:**Create optimal data pipeline architecture using best practices and...


  • New York, New York, United States Current Full time

    About the RoleThis position on the data team will play a crucial part in contributing to the future of Current's growth and serving data analytics and science needs of various teams at Current.Building dimensional models in the data warehouse, data marts, and transformation pipelines is something you are proficient at.You will contribute in building Data...

  • Data Engineer

    6 days ago


    New York, New York, United States American Express Full time

    About This RoleWe are seeking a highly skilled Data Engineer to join our team at American Express. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems that support our business operations.Your primary focus will be on developing and maintaining a dynamic technology infrastructure cost allocation...