Cloud Data Platform Engineer
3 months ago
Cloud Data Platform Engineer needs 5+ years' implementing data applications or data platforms with BigData/Hadoop, Python/Java/Spark full stack, etc.
5+ year support experience of Big Cloud Data Platform Engineer requires:
•3 days a week, hybrid
•Locations: Iselin, NJ, Charlotte, NC, NY, NY
•Data Engineering 60-70 %.
•Infrastructure 30-40%. (Moving Data in & Out of cloud)
•Snowflake exp is preferred
•Master's or Bachelor's degree in computer science or related discipline
•Manage and ensure delivery of project tasks as required
•Excellent documentation skills to create and manage design, implementation and automation related documentation
•Implementation experience for Hadoop distribution platforms like Cloudera or AWS EMR.
•Extensive experience in designing, engineering and managing data lake ingestion, validation, transformation and consumption services leveraging cloud data tools like Hive, Spark, EMR, Glue ETL and Catalog, Snowflake etc.
•Experience on implementing solutions with Worflow orchestration/scheduling tools such as Airflow, Autosys etc.
•Experience building CI/CD pipelines for infrastructure implementations with Teraform, Gitlab etc.
•Must be ability to multi-task and prioritize tasks for self
•Must experience working in agile environment with multiple priorities
Preferred Skills:
• 5+ years implementing data applications or data platforms with BigData/Hadoop, Python/Java/Spark full stack, etc.
• 5+ year support experience of Big Data technologies in Hadoop ecosystem - Hive, HDFS, MapReduce, Spark, Yarn, Kafka, Pig, HBase, Sqoop, Elastic Search, Kerberos.
• 5+ years' experience with ETL/ELT tools such as AWS Glue ETL, Talend, Datastage etc.
• 5+ years' experience with Orchestration tools such as Airflow, Autosys etc.
• Experience with Jira and Agile methodology is a plus;
• Experience with understanding DevOps or CI/CD process w.r.t to infrastructure management activities
Cloud Data Platform Engineer duties:
• Design, develop and deliver cloud datastore solutions and develop automation pipelines to migrate data sets from On-prem to Cloud platforms. Practice Infrastructure as code to develop automation routines and integration flows to manage state of the datastore platform systems
• Provision secures from start datastores and enable them with required security controls including encryption, masking, certificate/keys rotation etc.
• Collaborates with developers, analysts, various system administrators to identify business requirements in designing efficient datastore solutions and interfaces.
• Identifies and documents all system constraints, implications, and consequences of various proposed system changes.
• Reviews technical documentation to guide system users and to assist with the ongoing operation, maintenance, and development of the system. Evaluates the efficiency and effectiveness of application operations and troubleshooting problems.
• Provide expert level IT technical lead services, including the direction, evaluation, selection, configuration, implementation, and integration of new and existing technologies and tools in a cloud platform.
•
-
Data Engineer for Cloud Data Platform
3 weeks ago
New York, New York, United States The Data Sherpas Full timeJob Title: Data Engineer for Cloud Data PlatformThe Data Sherpas are seeking a highly skilled Data Engineer to join our team and help our clients at every phase of their cloud journey. As a Data Engineer, you will be responsible for designing, building, and maintaining scalable data platforms on cloud-based infrastructure.Responsibilities:Design and...
-
Data Engineer for Cloud Data Platforms
4 weeks ago
New York, New York, United States The Data Sherpas Full timeAbout The Data SherpasWe are a team of highly skilled and motivated engineers who help our clients at every phase of their cloud journey. Our expertise spans cloud infrastructure, data engineering, and application development.Job DescriptionWe are seeking a self-motivated and data-driven engineer to join our team. As a Data Engineer for Cloud Data Platforms,...
-
Data Engineer for Cloud Data Platforms
3 weeks ago
New York, New York, United States The Data Sherpas Full timeAbout The Data SherpasWe are a team of highly skilled and motivated engineers who help our clients at every phase of their cloud journey.Our expertise spans cloud infrastructure, data engineering, and analytics, with a focus on delivering scalable and intuitive solutions.Job DescriptionWe are seeking a self-motivated and data-driven engineer to join our team...
-
Data Engineer for Cloud Data Platforms
1 week ago
New York, New York, United States The Data Sherpas Full timeAbout The Data SherpasWe are a team of highly skilled and motivated engineers who help our clients at every phase of their cloud journey.Our expertise spans cloud infrastructure, data engineering, and analytics, with a focus on Snowflake, FiveTran, and DBT.Job DescriptionWe are seeking a self-motivated and data-driven engineer to join our team and help our...
-
Cloud Data Platform Engineer
2 days ago
New York, New York, United States Global Channel Management Full timeJob Title: Cloud Data Platform EngineerWe are seeking a highly skilled Cloud Data Platform Engineer to join our team at Global Channel Management. As a Cloud Data Platform Engineer, you will be responsible for designing, developing, and delivering cloud datastore solutions and automation pipelines to migrate data sets from on-prem to cloud platforms.Key...
-
Data Engineer for Cloud Data Platforms
2 days ago
New York, New York, United States The Data Sherpas Full timeWho We Are:The Data Sherpas are a team of highly skilled and motivated engineers who help our clients at every phase of their cloud journey. We have expertise in cloud, data, and applications, and we're passionate about delivering innovative solutions that drive business value.What We're Looking For:We're seeking a self-motivated and data-driven engineer to...
-
Data Engineer for Cloud Data Platforms
13 hours ago
New York, New York, United States The Data Sherpas Full timeJob Description:The Data Sherpas are a team of skilled engineers who help clients with their cloud journey. We are looking for a self-motivated and data-driven engineer to join our team.Responsibilities:Leverage DBT on Snowflake to build scalable transformations for landed dataBuild business logic and transform raw data for analytic, ML, and reporting use...
-
Cloud Data Platform Engineer
1 day ago
New York, New York, United States Global Channel Management Full timeAbout the JobGlobal Channel Management is seeking a highly skilled Cloud Data Platform Engineer to join our team.Key ResponsibilitiesDesign, develop, and deliver cloud datastore solutions and automation pipelines to migrate data sets from on-prem to cloud platforms.Provision secure datastores and enable them with required security controls, including...
-
Data Platform Engineer
1 day ago
New York, New York, United States Penske Truck Leasing Full timeAbout the RolePenske Truck Leasing is seeking a highly skilled Data Platform Engineer to join our team. As a key member of our technology team, you will be responsible for designing, deploying, and maintaining our cloud-based data platforms.Key ResponsibilitiesDesign and implement scalable and secure cloud-based data platforms using Kubernetes and...
-
Senior Data Architect/Engineer
2 months ago
New York, New York, United States Oakridge Staffing Full timeAbout Oakridge StaffingWe are partnering with a leading buy-side firm to build out their data function and team. This is a unique opportunity to join a greenfield project and shape the future of their data platform.Key ResponsibilitiesDesign and implement cloud-based data pipelines for portfolio teams and data scientistsDevelop and maintain data...
-
Senior Software Engineer
4 weeks ago
New York, New York, United States Big Cloud Full timeRevolutionary Technology and Large-Scale NLPWe're seeking a highly skilled Senior Software Engineer to join our world-class team at Big Cloud. As a key member of our engineering team, you'll be responsible for building scalable systems and shaping the infrastructure, APIs, and deployment process behind our cutting-edge content discovery platform.Key...
-
Cloud Data Engineer
3 weeks ago
New York, New York, United States Inizio Partners Full timeAbout the JobAt Inizio Partners, we are seeking a highly skilled Cloud Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing and developing enterprise data processing applications using cloud-based technologies.Key Responsibilities:Design and develop data processing applications using GCP, AWS,...
-
Data Engineer
2 weeks ago
New York, New York, United States Professional Search Group (PSG) Full timeJob Title: Sr. Data EngineerWe are seeking an experienced Sr. Data Engineer to join our team in New York, where technology meets storytelling. As a key member of our data engineering team, you will play a critical role in shaping the future of entertainment through innovation.Job DescriptionKey Responsibilities:Contribute to maintaining, updating, and...
-
Data Platform Engineer
13 hours ago
New York, New York, United States RIT Solutions, Inc. Full timeJob Summary:We are seeking a highly skilled Data Platform Engineer to join our team at RIT Solutions, Inc. in New York City. As a key member of our engineering team, you will be responsible for designing, developing, and maintaining large-scale data platforms to support our business operations.Key Responsibilities:Design and develop data pipelines to...
-
Cloud Data Engineer
1 day ago
New York, New York, United States Cynet Systems Full timeJob Description:As a Senior Databricks Cloud Data Engineer at Cynet Systems, you will play a key role in designing and building large-scale data systems that drive business insights and decision-making. Your expertise in cloud databases, data warehousing, and data governance will be instrumental in shaping our data platform strategy.Responsibilities:Develop...
-
Cloud Data Infrastructure Engineer
3 weeks ago
New York, New York, United States Memorial Sloan Kettering Cancer Center Full timeCloud Data Infrastructure EngineerJoin Memorial Sloan Kettering Cancer Center in driving its data modernization journey as a Cloud Data Infrastructure Engineer. This exciting opportunity involves designing, implementing, and maintaining data infrastructure solutions for a hybrid and multi-cloud data ecosystem.Key Responsibilities:Collaborate with technical...
-
Senior Cloud Platform Engineer
2 days ago
New York, New York, United States Celonis GmbH Full timeAbout CelonisCelonis is a global leader in Process Mining technology and one of the world's fastest-growing SaaS firms. Our mission is to unlock productivity by placing data and intelligence at the core of business processes.The RoleWe're seeking a Senior Cloud Platform Engineer to join our Platform Infrastructure team. As a key member of this team, you will...
-
Senior Manager Data Platform Engineering
1 day ago
New York, New York, United States Associated Banc-Corp Full timeAbout the RoleAssociated Banc-Corp is seeking a highly skilled Senior Manager Data Platform Engineering to lead our data platform engineering team. As a key member of our organization, you will be responsible for developing and executing the data platform DataOps technical strategy and roadmap of capabilities, ensuring scalability, reliability, reusability,...
-
Cloud Data Engineer
3 weeks ago
New York, New York, United States Inizio Partners Full timeAbout the JobCloud Data Engineer - GCPWe are seeking a highly skilled Cloud Data Engineer to join our team at Inizio Partners. As a Cloud Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing applications on Google Cloud Platform (GCP).Key ResponsibilitiesDesign and develop enterprise data processing...
-
Senior Cloud Data Engineer
12 hours ago
New York, New York, United States Tech Tammina Full timeJob Description**Senior Cloud Data Engineer**We are seeking a highly skilled Senior Cloud Data Engineer to join our team at Tech Tammina. As a Senior Cloud Data Engineer, you will be responsible for designing, developing, and maintaining data pipelines on Google Cloud Platform (GCP).The ideal candidate should have extensive experience in IT and data...