Cloud Data Solutions Engineer

1 week ago


New York, New York, United States The Custom Group of Companies Full time
Cloud Data Solutions Engineer:

We are seeking a highly skilled Cloud Data Solutions Engineer to join our team at The Custom Group of Companies. As a key member of our organization, you will be responsible for designing, developing, and maintaining data pipelines in Databricks on an AWS 6 ecosystem with Delta Lake, Python, SQL, and Starburst as the technology stack.

In this role, you will work closely with cross-functional teams to understand data needs and translate them into effective data pipeline solutions. You will also establish data quality checks, ensure data integrity and accuracy throughout the data lifecycle, automate testing of the data pipelines, optimize data processing and query performance for large-scale datasets within AWS and Databricks environments, document data engineering processes, architecture, and configurations, troubleshoot and debug data-related issues on the AWS Databricks platform, and integrate Databricks with other AWS products such as SNS, SQS, and MSK.

Main Responsibilities:
  • Design, develop, and maintain data pipelines in Databricks on an AWS 6 ecosystem.
  • Work closely with cross-functional teams to understand data needs and translate them into effective data pipeline solutions.
  • Establish data quality checks and ensure data integrity and accuracy throughout the data lifecycle.
  • Automate testing of the data pipelines and configure as part of CICD.
  • Optimize data processing and query performance for large-scale datasets within AWS and Databricks environments.
  • Document data engineering processes, architecture, and configurations.
  • Troubleshoot and debug data-related issues on the AWS Databricks platform.
  • Integrate Databricks with other AWS products such as SNS, SQS, and MSK.


  • New York, New York, United States RIT Solutions, Inc. Full time

    We are looking for a talented Cloud Data Solutions Engineer to lead our data engineering efforts on Azure. This is a challenging opportunity with a competitive estimated salary of $125,000 per year.Key Responsibilities:Design and implement scalable data pipelines using Azure servicesDevelop and maintain data models, architectures, and workflowsCollaborate...

  • Cloud Data Engineer

    7 days ago


    New York, New York, United States Damco Solutions Full time

    Job DescriptionWe are seeking a highly skilled Cloud Data Engineer to join our team at Damco Solutions in NYC. As a key member of our cloud data platform team, you will be responsible for designing, building, and maintaining large-scale data pipelines and systems.This role requires expertise in cloud-based data warehousing, ETL development, and data...


  • New York, New York, United States Hudson Data Full time

    Hudson Data is seeking a highly skilled Cloud Data Engineer Expert to join our team.We are looking for an experienced professional with hands-on knowledge of various Azure services, including but not limited to Azure Data Factory, Databricks, Data Lake, and Power BI. The ideal candidate should be able to design, build, and maintain ETL pipelines, manage data...


  • New York, New York, United States Futran Tech Solutions Pvt. Ltd. Full time

    Job Summary:Futran Tech Solutions Pvt. Ltd. is hiring a highly skilled Cloud Data Solutions Architect to lead the development of cloud-based data solutions on Azure. The ideal candidate will have expertise in designing and implementing scalable data architectures, working closely with data scientists, analysts, and business stakeholders.Key...


  • New York, New York, United States Rhode Island Blood Center Full time

    Job Summary: As a Senior Data Engineer - Cloud Solutions, you will be responsible for designing, implementing, and optimizing cloud-based data solutions to support our business needs. You will work closely with cross-functional teams to develop and deploy scalable data architectures.About Our Company: Our company is a leading provider of blood products and...


  • New York, New York, United States VS Tech Solutions Full time

    **Job Title:** Cloud Data Solutions ExpertJoin Vs Tech Solutions, a global leader in human resources consulting, as a seasoned Cloud Data Solutions Expert.About the RoleThis position requires a strong technical background in data architecture, as well as leadership qualities to lead cross-functional teams.The ideal candidate will have 10+ years of experience...


  • New York, New York, United States Perennial Resources International Full time

    Job DescriptionWe are seeking a highly skilled Senior Data and Cloud Engineer to lead our data engineering efforts at Perennial Resources International. This role will be responsible for designing, implementing, and maintaining scalable data pipelines and ETL processes critical to support business operations and analytics.The ideal candidate will have strong...


  • New York, New York, United States Eliassen Group Full time

    Hybrid Role Opportunity in New York CityEliassen Group, a leading provider of workforce solutions, is seeking an experienced Senior Cloud Data Solutions Engineer to join our client's team in developing and extending their next-generation data platform. This platform will empower fans to access personalized content and related offerings through advanced...

  • Cloud Data Engineer

    1 week ago


    New York, New York, United States Futran Tech Solutions Pvt. Ltd. Full time

    Job Title: Cloud Data EngineerLocation: New York City, NY (Day one Onsite)About the Job:We are seeking an experienced Cloud Data Engineer to join our team at Futran Tech Solutions Pvt. Ltd. in New York City. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining scalable ETL pipelines to ensure...


  • New York, New York, United States Capital One Full time

    About the Role:Capital One is seeking a Senior Data Engineer to join our team, responsible for designing, developing, and implementing data engineering solutions using Python, Spark, and AWS. As a key member of our team, you will work on complex business problems in a fast-paced environment, collaborating with Agile teams to deliver robust cloud-based...


  • New York, New York, United States A-Line Staffing Solutions Full time

    **Job Summary**We are seeking an experienced Cloud Data Engineering Manager to lead our data engineering team in designing and developing complex data solutions.**Estimated Salary:** $180,000 - $280,000 per year.**Key Responsibilities:** Lead the design and development of complex data solutions, ensuring scalability and security. Develop and implement...


  • New York, New York, United States Hudson Data Full time

    Hudson Data is a leading provider of data engineering solutions, and we are seeking a talented Senior Azure Cloud Solutions Architect to join our team.We are looking for an experienced professional with a strong background in designing and implementing large-scale data architectures on the Azure cloud platform. The ideal candidate should have hands-on...


  • New York, New York, United States Futran Tech Solutions Pvt. Ltd. Full time

    Futran Tech Solutions Pvt. Ltd. is seeking a highly skilled Azure Cloud Data Solutions Architect to lead our data engineering efforts. As a key member of our team, you will design, implement, and optimize data solutions on the Azure cloud platform, ensuring scalability, security, and performance.Key Responsibilities:Develop and maintain data pipelines using...


  • New York, New York, United States RIT Solutions, Inc. Full time

    We are looking for a Senior Big Data Cloud Architect to lead our team's efforts in designing and implementing cloud-based data solutions.About the RoleThis role offers an opportunity to work on complex data solutions, collaborate with cross-functional teams, and drive business outcomes.The successful candidate will have a strong background in big data...

  • Senior Data Engineer

    4 weeks ago


    New York, New York, United States NYC IT Inc Full time

    We are seeking a Senior Data Engineer to join our team at NYC IT Inc.Job SummaryThis is an exciting opportunity for an experienced Data Engineer to work on cloud-based data solutions and lead the development of large-scale data processing systems. The ideal candidate will have extensive experience in designing, implementing, and maintaining complex data...


  • New York, New York, United States Capital One Full time

    Role OverviewWe are seeking a highly skilled Cloud Engineering Lead to spearhead the development of our big data and streaming solutions. As a key member of our engineering team, you will be responsible for designing, implementing, and maintaining scalable and secure cloud-based infrastructure.Job DescriptionAs a Cloud Engineering Lead, you will work closely...

  • Data Engineer

    7 days ago


    New York, New York, United States Indsafri Full time

    Job Title: Data Engineer on W2Estimated Salary: $120,000 per year (based on location and industry standards)About the Role:Indsafri is seeking a highly skilled Data Engineer with experience in the Financial or Banking industry to join our team. As a key member of our Agile development team, you will be responsible for designing and developing scalable data...


  • New York, New York, United States The Dignify Solutions LLC Full time

    AWS Cloud Solutions EngineerAbout The Dignify Solutions LLCThe Dignify Solutions LLC is a cutting-edge technology company that specializes in delivering innovative solutions to clients worldwide. With a strong focus on cloud computing, cybersecurity, and data analytics, we are committed to helping businesses achieve their digital transformation goals.About...

  • Cloud Data Engineer

    1 week ago


    New York, New York, United States Memorial Sloan Full time

    Job Title: Cloud Data Engineer About the Role:We are seeking an experienced Cloud Data Engineer to join our team at Memorial Sloan Kettering Cancer Center. The ideal candidate will have a strong background in designing, implementing, and maintaining data infrastructure solutions for hybrid and multi-cloud data ecosystems. Key Responsibilities:- Design and...

  • Cloud Data Engineer

    1 month ago


    New York, New York, United States HR Recruiting Services Full time

    Job Description:We are seeking an experienced Cloud Data Engineer to join our team at HR Recruiting Services. This is a challenging and rewarding opportunity for a skilled professional with a strong background in data engineering and cloud computing.About the Role:This role will be responsible for designing, implementing, and maintaining scalable data...