Cloud Data Solutions Engineer
1 week ago
We are seeking a highly skilled Cloud Data Solutions Engineer to join our team at The Custom Group of Companies. As a key member of our organization, you will be responsible for designing, developing, and maintaining data pipelines in Databricks on an AWS 6 ecosystem with Delta Lake, Python, SQL, and Starburst as the technology stack.
In this role, you will work closely with cross-functional teams to understand data needs and translate them into effective data pipeline solutions. You will also establish data quality checks, ensure data integrity and accuracy throughout the data lifecycle, automate testing of the data pipelines, optimize data processing and query performance for large-scale datasets within AWS and Databricks environments, document data engineering processes, architecture, and configurations, troubleshoot and debug data-related issues on the AWS Databricks platform, and integrate Databricks with other AWS products such as SNS, SQS, and MSK.
Main Responsibilities:
- Design, develop, and maintain data pipelines in Databricks on an AWS 6 ecosystem.
- Work closely with cross-functional teams to understand data needs and translate them into effective data pipeline solutions.
- Establish data quality checks and ensure data integrity and accuracy throughout the data lifecycle.
- Automate testing of the data pipelines and configure as part of CICD.
- Optimize data processing and query performance for large-scale datasets within AWS and Databricks environments.
- Document data engineering processes, architecture, and configurations.
- Troubleshoot and debug data-related issues on the AWS Databricks platform.
- Integrate Databricks with other AWS products such as SNS, SQS, and MSK.
-
Cloud Data Solutions Engineer
2 weeks ago
New York, New York, United States RIT Solutions, Inc. Full timeWe are looking for a talented Cloud Data Solutions Engineer to lead our data engineering efforts on Azure. This is a challenging opportunity with a competitive estimated salary of $125,000 per year.Key Responsibilities:Design and implement scalable data pipelines using Azure servicesDevelop and maintain data models, architectures, and workflowsCollaborate...
-
Cloud Data Engineer
7 days ago
New York, New York, United States Damco Solutions Full timeJob DescriptionWe are seeking a highly skilled Cloud Data Engineer to join our team at Damco Solutions in NYC. As a key member of our cloud data platform team, you will be responsible for designing, building, and maintaining large-scale data pipelines and systems.This role requires expertise in cloud-based data warehousing, ETL development, and data...
-
Cloud Data Engineer Expert
1 week ago
New York, New York, United States Hudson Data Full timeHudson Data is seeking a highly skilled Cloud Data Engineer Expert to join our team.We are looking for an experienced professional with hands-on knowledge of various Azure services, including but not limited to Azure Data Factory, Databricks, Data Lake, and Power BI. The ideal candidate should be able to design, build, and maintain ETL pipelines, manage data...
-
Cloud Data Solutions Architect
1 week ago
New York, New York, United States Futran Tech Solutions Pvt. Ltd. Full timeJob Summary:Futran Tech Solutions Pvt. Ltd. is hiring a highly skilled Cloud Data Solutions Architect to lead the development of cloud-based data solutions on Azure. The ideal candidate will have expertise in designing and implementing scalable data architectures, working closely with data scientists, analysts, and business stakeholders.Key...
-
Senior Data Engineer
1 week ago
New York, New York, United States Rhode Island Blood Center Full timeJob Summary: As a Senior Data Engineer - Cloud Solutions, you will be responsible for designing, implementing, and optimizing cloud-based data solutions to support our business needs. You will work closely with cross-functional teams to develop and deploy scalable data architectures.About Our Company: Our company is a leading provider of blood products and...
-
Cloud Data Solutions Expert
1 week ago
New York, New York, United States VS Tech Solutions Full time**Job Title:** Cloud Data Solutions ExpertJoin Vs Tech Solutions, a global leader in human resources consulting, as a seasoned Cloud Data Solutions Expert.About the RoleThis position requires a strong technical background in data architecture, as well as leadership qualities to lead cross-functional teams.The ideal candidate will have 10+ years of experience...
-
Data Engineer and Cloud Solutions Architect
1 week ago
New York, New York, United States Perennial Resources International Full timeJob DescriptionWe are seeking a highly skilled Senior Data and Cloud Engineer to lead our data engineering efforts at Perennial Resources International. This role will be responsible for designing, implementing, and maintaining scalable data pipelines and ETL processes critical to support business operations and analytics.The ideal candidate will have strong...
-
Senior Cloud Data Solutions Engineer
4 weeks ago
New York, New York, United States Eliassen Group Full timeHybrid Role Opportunity in New York CityEliassen Group, a leading provider of workforce solutions, is seeking an experienced Senior Cloud Data Solutions Engineer to join our client's team in developing and extending their next-generation data platform. This platform will empower fans to access personalized content and related offerings through advanced...
-
Cloud Data Engineer
1 week ago
New York, New York, United States Futran Tech Solutions Pvt. Ltd. Full timeJob Title: Cloud Data EngineerLocation: New York City, NY (Day one Onsite)About the Job:We are seeking an experienced Cloud Data Engineer to join our team at Futran Tech Solutions Pvt. Ltd. in New York City. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining scalable ETL pipelines to ensure...
-
New York, New York, United States Capital One Full timeAbout the Role:Capital One is seeking a Senior Data Engineer to join our team, responsible for designing, developing, and implementing data engineering solutions using Python, Spark, and AWS. As a key member of our team, you will work on complex business problems in a fast-paced environment, collaborating with Agile teams to deliver robust cloud-based...
-
Cloud Data Engineering Manager
2 weeks ago
New York, New York, United States A-Line Staffing Solutions Full time**Job Summary**We are seeking an experienced Cloud Data Engineering Manager to lead our data engineering team in designing and developing complex data solutions.**Estimated Salary:** $180,000 - $280,000 per year.**Key Responsibilities:** Lead the design and development of complex data solutions, ensuring scalability and security. Develop and implement...
-
Senior Azure Cloud Solutions Architect
1 week ago
New York, New York, United States Hudson Data Full timeHudson Data is a leading provider of data engineering solutions, and we are seeking a talented Senior Azure Cloud Solutions Architect to join our team.We are looking for an experienced professional with a strong background in designing and implementing large-scale data architectures on the Azure cloud platform. The ideal candidate should have hands-on...
-
Azure Cloud Data Solutions Architect
4 weeks ago
New York, New York, United States Futran Tech Solutions Pvt. Ltd. Full timeFutran Tech Solutions Pvt. Ltd. is seeking a highly skilled Azure Cloud Data Solutions Architect to lead our data engineering efforts. As a key member of our team, you will design, implement, and optimize data solutions on the Azure cloud platform, ensuring scalability, security, and performance.Key Responsibilities:Develop and maintain data pipelines using...
-
Cloud Data Engineering Lead
7 days ago
New York, New York, United States RIT Solutions, Inc. Full timeWe are looking for a Senior Big Data Cloud Architect to lead our team's efforts in designing and implementing cloud-based data solutions.About the RoleThis role offers an opportunity to work on complex data solutions, collaborate with cross-functional teams, and drive business outcomes.The successful candidate will have a strong background in big data...
-
Senior Data Engineer
4 weeks ago
New York, New York, United States NYC IT Inc Full timeWe are seeking a Senior Data Engineer to join our team at NYC IT Inc.Job SummaryThis is an exciting opportunity for an experienced Data Engineer to work on cloud-based data solutions and lead the development of large-scale data processing systems. The ideal candidate will have extensive experience in designing, implementing, and maintaining complex data...
-
New York, New York, United States Capital One Full timeRole OverviewWe are seeking a highly skilled Cloud Engineering Lead to spearhead the development of our big data and streaming solutions. As a key member of our engineering team, you will be responsible for designing, implementing, and maintaining scalable and secure cloud-based infrastructure.Job DescriptionAs a Cloud Engineering Lead, you will work closely...
-
Data Engineer
7 days ago
New York, New York, United States Indsafri Full timeJob Title: Data Engineer on W2Estimated Salary: $120,000 per year (based on location and industry standards)About the Role:Indsafri is seeking a highly skilled Data Engineer with experience in the Financial or Banking industry to join our team. As a key member of our Agile development team, you will be responsible for designing and developing scalable data...
-
AWS Cloud Solutions Engineer
7 days ago
New York, New York, United States The Dignify Solutions LLC Full timeAWS Cloud Solutions EngineerAbout The Dignify Solutions LLCThe Dignify Solutions LLC is a cutting-edge technology company that specializes in delivering innovative solutions to clients worldwide. With a strong focus on cloud computing, cybersecurity, and data analytics, we are committed to helping businesses achieve their digital transformation goals.About...
-
Cloud Data Engineer
1 week ago
New York, New York, United States Memorial Sloan Full timeJob Title: Cloud Data Engineer About the Role:We are seeking an experienced Cloud Data Engineer to join our team at Memorial Sloan Kettering Cancer Center. The ideal candidate will have a strong background in designing, implementing, and maintaining data infrastructure solutions for hybrid and multi-cloud data ecosystems. Key Responsibilities:- Design and...
-
Cloud Data Engineer
1 month ago
New York, New York, United States HR Recruiting Services Full timeJob Description:We are seeking an experienced Cloud Data Engineer to join our team at HR Recruiting Services. This is a challenging and rewarding opportunity for a skilled professional with a strong background in data engineering and cloud computing.About the Role:This role will be responsible for designing, implementing, and maintaining scalable data...