Senior Data and Cloud Engineer

3 days ago


New York, United States CV Library Full time

Lead Data Engineer

Full-time/Permanent

Onsite - NYC

Responsibilities:

Take ownership of the entire data engineering lifecycle, including design, implementation, performance tuning, and monitoring

Manage and work with the firm's database managed service provider (MSP) to manage and monitor the firm's evolving database requirements

Design, develop, and maintain scalable data pipelines and ETL processes critical to support business operations and analytics. (Python / SQL)

Optimize and tune data systems for high performance and reliability

Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality data solutions

Implement and manage data storage solutions in cloud environments (AWS, Azure, Google Cloud)

Ensure data quality and integrity through rigorous testing and validation

Continuously evaluate and integrate new technologies and tools to improve data processing capabilities

Manage distributed scheduled tasks on individual servers to a centralized ruleset

Work with the development team and database MSP to modernize the backup and recovery strategy for 3-4 SQL servers across different cloud environments

Support the addition of new tenants on the firm's production data platform

Qualifications:

Bachelor's or Master's degree in Computer Science, Engineering, Information Technology, or a related field from a top-tier university.

4-5 years of relevant professional experience in data engineering

Strong programming skills in SQL and Python.

Proficiency in database administration

Proven experience migrating on-prem data and associated processes to cloud platforms (AWS, Azure, Google Cloud)

Demonstrated ability to design and implement efficient and reliable data pipelines and ETL processes

Strong problem-solving skills and ability to troubleshoot complex data issues

Excellent communication skills and ability to work collaboratively in a team environment

A proactive mindset with a willingness to take ownership and drive projects to completion. Strong organizational skills along with a desire to continually be challenged

Experience with monitoring, CI/CD, Load Balancing, and Testing tools (e.g. Redgate, Datadog)



  • New York, New York, United States Eliassen Group Full time

    Hybrid Role Opportunity in New York CityEliassen Group, a leading provider of workforce solutions, is seeking an experienced Senior Cloud Data Solutions Engineer to join our client's team in developing and extending their next-generation data platform. This platform will empower fans to access personalized content and related offerings through advanced...


  • New York, New York, United States Perennial Resources International Full time

    Job Title: Senior Data and Cloud EngineerJob Summary:Perennial Resources International seeks a Senior Data and Cloud Engineer to lead data engineering lifecycle, manage database services, and design scalable data pipelines in cloud environments. The ideal candidate will have 4-5 years of experience in data engineering, strong programming skills in SQL and...


  • New York, New York, United States Point72 Full time

    Job OverviewAs a Senior Data Engineer at Point72, you will lead the design and development of data pipelines and infrastructure using cloud-based technologies. You will collaborate closely with our investment professionals, researchers, and data scientists to deliver robust solutions that extract valuable insights from large datasets.


  • New York, New York, United States Harrington Starr Full time

    Job OverviewHarrington Starr is seeking a highly skilled Senior Software Engineer - Cloud and Data to join our team in Manhattan.About the RoleWe are looking for an experienced software engineer with expertise in cloud-based technologies, particularly AWS.The successful candidate will work closely with the CTO to design, develop, test, and maintain...


  • New York, New York, United States Lorven Technologies Full time

    We are seeking a skilled Senior Cloud Data Specialist to join our team at Lorven Technologies. In this role, you will be responsible for designing and implementing cloud-based data solutions using Azure cloud services.Job Summary:The successful candidate will have 10+ years of experience in software development using Python, PySpark, and its frameworks, with...


  • New York, United States Perennial Resources International Full time

    Lead Data Engineer Full-time/Permanent Onsite - NYCResponsibilities: Take ownership of the entire data engineering lifecycle, including design, implementation, performance tuning, and monitoring Manage and work with the firm's database managed service provider (MSP) to manage and monitor the firm's evolving database requirements Design, develop, and maintain...

  • Senior Data Engineer

    2 weeks ago


    New York, New York, United States NYC IT Inc Full time

    We are seeking a Senior Data Engineer to join our team at NYC IT Inc.Job SummaryThis is an exciting opportunity for an experienced Data Engineer to work on cloud-based data solutions and lead the development of large-scale data processing systems. The ideal candidate will have extensive experience in designing, implementing, and maintaining complex data...


  • New York, New York, United States Capital One Full time

    OverviewCapital One is a dynamic financial institution that seeks to hire experienced Senior Data Engineers. Our ideal candidate will be passionate about building and pioneering in the technology space, with expertise in marrying data with emerging technologies.Estimated Salary: $173,300 - $198,100 per year, depending on location and experience. Job...

  • Senior Data Engineer

    3 weeks ago


    New York, New York, United States Capital One Full time

    Role OverviewWe are seeking a Senior Data Engineer to join our team at Capital One. This role is responsible for designing, developing, testing, implementing, and supporting technical solutions in full-stack development tools and technologies.About the JobThis position requires collaboration with Agile teams to design, develop, test, implement, and support...

  • Cloud Data Engineer

    1 month ago


    New Brighton, United States All Volusia and Flagler Heating and Air Full time

    Bell Lumber and Pole Company requires a Cloud Data Engineer to enhance business processes and deliver data solutions by leveraging cloud data services. The role involves analyzing data workflows, identifying improvement areas, and leading advanced data solution implementations. The engineer will also develop custom business applications integrating with ERP...

  • Senior Cloud Engineer

    3 weeks ago


    New York, United States Allcloud Inc. Full time

    Description Senior AWS Cloud Engineer Location: US / Canada (Eastern Time) - Home basedJob Type: Full-time, Permanent About AllCloud AllCloud is a global professional services company providing organizations with cloud enablement and transformation tools. As an AWS Premier Consulting Partner and audited MSP, a Salesforce Platinum Partner, and a Snowflake...

  • Cloud Data Engineer

    4 weeks ago


    New York, New York, United States HR Recruiting Services Full time

    Job Description:We are seeking an experienced Cloud Data Engineer to join our team at HR Recruiting Services. This is a challenging and rewarding opportunity for a skilled professional with a strong background in data engineering and cloud computing.About the Role:This role will be responsible for designing, implementing, and maintaining scalable data...


  • New York, New York, United States Inizio Partners Full time

    About the JobData Engineers at Inizio Partners design, build, and maintain large-scale data systems. We are seeking a highly skilled Data Engineer to join our team. Key Responsibilities:Design and implement scalable data architectures using cloud-based platforms (i.e., Azure, GCP, AWS)Develop and maintain real-time data pipelines using technologies like...

  • Cloud Data Engineer

    1 month ago


    New York, United States Atlas Search Full time

    3 days onsiteWe are seeking an experienced Cloud Data Engineer with expertise in Kafka, Snowflake, and MongoDB to design and manage robust, scalable data pipelines within a cloud environment. This role involves building CI/CD pipelines to automate and streamline data workflows, ensuring data integrity and security across test and production...

  • Cloud Data Engineer

    1 month ago


    New York, United States People Placers Staffing Full time

    Title : Data/Cloud Engineer Location : New York, NY Salary/Pay Rate: $175,000 - $275,000 per year + Bonus Schedule: Full-Time, Partially Remote About the Client: People Placers Staffing is partnering with a $10 billion AUM hedge fund committed to developing state-of-the-art models and technology. They are building a cutting-edge, cloud-based data and...


  • New York, United States Big Cloud Full time

    Are you interested in revolutionary technology?Are you passionate about large-scale NLP and search?Would you like to help shape a world-class ML platform with proven results?I'm recruiting for one of the most advanced NLP start-ups in New York City. Their open-source content discovery platform uses NLP to extract research and connect data points across the...


  • New York, New York, United States Capital One Full time

    About the Role:Capital One is seeking a Senior Data Engineer to join our team, responsible for designing, developing, and implementing data engineering solutions using Python, Spark, and AWS. As a key member of our team, you will work on complex business problems in a fast-paced environment, collaborating with Agile teams to deliver robust cloud-based...


  • New York, New York, United States New York Life Insurance Company Full time

    Transforming Enterprise Data ArchitectureIn the heart of New York Life Insurance Company, we're seeking an exceptionally skilled Senior Cloud Data Architect to spearhead our company's modern data management strategy. This pivotal role will require you to collaborate with cross-functional teams, including Data Product Owners, Data Scientists, and end-users,...


  • New York, New York, United States Saxon Global Full time

    Career Opportunity: Senior Cloud Engineer:Saxon Global seeks a highly skilled Senior Cloud Engineer to drive innovation in our cloud department. As a Senior Cloud Engineer, you will be responsible for designing, developing, and deploying scalable cloud-based systems using AWS services. About the Job:This role involves working closely with cross-functional...

  • Senior Data Engineer

    2 weeks ago


    New York, United States TechnoGen Full time

    Please Note: As of July 22, 2021, our team will require that all candidate submissions include a LinkedIn profile. Please do not submit any candidates that do not have a LinkedIn. Kforce has a client in Brooklyn, NY that is seeking a Senior Data Engineer. Our team is headquartered in Brooklyn but has a remote-first culture and we encourage remote applicants...