Cloud Data Platform Engineer

3 months ago


New York, United States Global Channel Management Full time

Cloud Data Platform Engineer needs 5+ years' implementing data applications or data platforms with BigData/Hadoop, Python/Java/Spark full stack, etc.

5+ year support experience of Big Cloud Data Platform Engineer requires:

•3 days a week, hybrid

•Locations: Iselin, NJ, Charlotte, NC, NY, NY

•Data Engineering 60-70 %.

•Infrastructure 30-40%. (Moving Data in & Out of cloud)

•Snowflake exp is preferred

•Master's or Bachelor's degree in computer science or related discipline

•Manage and ensure delivery of project tasks as required

•Excellent documentation skills to create and manage design, implementation and automation related documentation

•Implementation experience for Hadoop distribution platforms like Cloudera or AWS EMR.

•Extensive experience in designing, engineering and managing data lake ingestion, validation, transformation and consumption services leveraging cloud data tools like Hive, Spark, EMR, Glue ETL and Catalog, Snowflake etc.

•Experience on implementing solutions with Worflow orchestration/scheduling tools such as Airflow, Autosys etc.

•Experience building CI/CD pipelines for infrastructure implementations with Teraform, Gitlab etc.

•Must be ability to multi-task and prioritize tasks for self

•Must experience working in agile environment with multiple priorities

Preferred Skills:
• 5+ years implementing data applications or data platforms with BigData/Hadoop, Python/Java/Spark full stack, etc.
• 5+ year support experience of Big Data technologies in Hadoop ecosystem - Hive, HDFS, MapReduce, Spark, Yarn, Kafka, Pig, HBase, Sqoop, Elastic Search, Kerberos.
• 5+ years' experience with ETL/ELT tools such as AWS Glue ETL, Talend, Datastage etc.
• 5+ years' experience with Orchestration tools such as Airflow, Autosys etc.
• Experience with Jira and Agile methodology is a plus;
• Experience with understanding DevOps or CI/CD process w.r.t to infrastructure management activities

Cloud Data Platform Engineer duties:
• Design, develop and deliver cloud datastore solutions and develop automation pipelines to migrate data sets from On-prem to Cloud platforms. Practice Infrastructure as code to develop automation routines and integration flows to manage state of the datastore platform systems
• Provision secures from start datastores and enable them with required security controls including encryption, masking, certificate/keys rotation etc.
• Collaborates with developers, analysts, various system administrators to identify business requirements in designing efficient datastore solutions and interfaces.
• Identifies and documents all system constraints, implications, and consequences of various proposed system changes.
• Reviews technical documentation to guide system users and to assist with the ongoing operation, maintenance, and development of the system. Evaluates the efficiency and effectiveness of application operations and troubleshooting problems.
• Provide expert level IT technical lead services, including the direction, evaluation, selection, configuration, implementation, and integration of new and existing technologies and tools in a cloud platform.



  • New York, New York, United States The Data Sherpas Full time

    Job Title: Data Engineer for Cloud Data PlatformThe Data Sherpas are seeking a highly skilled Data Engineer to join our team and help our clients at every phase of their cloud journey. As a Data Engineer, you will be responsible for designing, building, and maintaining scalable data platforms on cloud-based infrastructure.Responsibilities:Design and...


  • New York, New York, United States The Data Sherpas Full time

    About The Data SherpasWe are a team of highly skilled and motivated engineers who help our clients at every phase of their cloud journey. Our expertise spans cloud infrastructure, data engineering, and application development.Job DescriptionWe are seeking a self-motivated and data-driven engineer to join our team. As a Data Engineer for Cloud Data Platforms,...


  • New York, New York, United States The Data Sherpas Full time

    About The Data SherpasWe are a team of highly skilled and motivated engineers who help our clients at every phase of their cloud journey.Our expertise spans cloud infrastructure, data engineering, and analytics, with a focus on delivering scalable and intuitive solutions.Job DescriptionWe are seeking a self-motivated and data-driven engineer to join our team...


  • New York, New York, United States The Data Sherpas Full time

    About The Data SherpasWe are a team of highly skilled and motivated engineers who help our clients at every phase of their cloud journey.Our expertise spans cloud infrastructure, data engineering, and analytics, with a focus on Snowflake, FiveTran, and DBT.Job DescriptionWe are seeking a self-motivated and data-driven engineer to join our team and help our...


  • New York, New York, United States Global Channel Management Full time

    Job Title: Cloud Data Platform EngineerWe are seeking a highly skilled Cloud Data Platform Engineer to join our team at Global Channel Management. As a Cloud Data Platform Engineer, you will be responsible for designing, developing, and delivering cloud datastore solutions and automation pipelines to migrate data sets from on-prem to cloud platforms.Key...


  • New York, New York, United States The Data Sherpas Full time

    Who We Are:The Data Sherpas are a team of highly skilled and motivated engineers who help our clients at every phase of their cloud journey. We have expertise in cloud, data, and applications, and we're passionate about delivering innovative solutions that drive business value.What We're Looking For:We're seeking a self-motivated and data-driven engineer to...


  • New York, New York, United States The Data Sherpas Full time

    Job Description:The Data Sherpas are a team of skilled engineers who help clients with their cloud journey. We are looking for a self-motivated and data-driven engineer to join our team.Responsibilities:Leverage DBT on Snowflake to build scalable transformations for landed dataBuild business logic and transform raw data for analytic, ML, and reporting use...


  • New York, New York, United States Global Channel Management Full time

    About the JobGlobal Channel Management is seeking a highly skilled Cloud Data Platform Engineer to join our team.Key ResponsibilitiesDesign, develop, and deliver cloud datastore solutions and automation pipelines to migrate data sets from on-prem to cloud platforms.Provision secure datastores and enable them with required security controls, including...


  • New York, New York, United States Penske Truck Leasing Full time

    About the RolePenske Truck Leasing is seeking a highly skilled Data Platform Engineer to join our team. As a key member of our technology team, you will be responsible for designing, deploying, and maintaining our cloud-based data platforms.Key ResponsibilitiesDesign and implement scalable and secure cloud-based data platforms using Kubernetes and...


  • New York, New York, United States Oakridge Staffing Full time

    About Oakridge StaffingWe are partnering with a leading buy-side firm to build out their data function and team. This is a unique opportunity to join a greenfield project and shape the future of their data platform.Key ResponsibilitiesDesign and implement cloud-based data pipelines for portfolio teams and data scientistsDevelop and maintain data...


  • New York, New York, United States Big Cloud Full time

    Revolutionary Technology and Large-Scale NLPWe're seeking a highly skilled Senior Software Engineer to join our world-class team at Big Cloud. As a key member of our engineering team, you'll be responsible for building scalable systems and shaping the infrastructure, APIs, and deployment process behind our cutting-edge content discovery platform.Key...

  • Cloud Data Engineer

    3 weeks ago


    New York, New York, United States Inizio Partners Full time

    About the JobAt Inizio Partners, we are seeking a highly skilled Cloud Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing and developing enterprise data processing applications using cloud-based technologies.Key Responsibilities:Design and develop data processing applications using GCP, AWS,...

  • Data Engineer

    2 weeks ago


    New York, New York, United States Professional Search Group (PSG) Full time

    Job Title: Sr. Data EngineerWe are seeking an experienced Sr. Data Engineer to join our team in New York, where technology meets storytelling. As a key member of our data engineering team, you will play a critical role in shaping the future of entertainment through innovation.Job DescriptionKey Responsibilities:Contribute to maintaining, updating, and...

  • Data Platform Engineer

    13 hours ago


    New York, New York, United States RIT Solutions, Inc. Full time

    Job Summary:We are seeking a highly skilled Data Platform Engineer to join our team at RIT Solutions, Inc. in New York City. As a key member of our engineering team, you will be responsible for designing, developing, and maintaining large-scale data platforms to support our business operations.Key Responsibilities:Design and develop data pipelines to...


  • New York, New York, United States Cynet Systems Full time

    Job Description:As a Senior Databricks Cloud Data Engineer at Cynet Systems, you will play a key role in designing and building large-scale data systems that drive business insights and decision-making. Your expertise in cloud databases, data warehousing, and data governance will be instrumental in shaping our data platform strategy.Responsibilities:Develop...


  • New York, New York, United States Memorial Sloan Kettering Cancer Center Full time

    Cloud Data Infrastructure EngineerJoin Memorial Sloan Kettering Cancer Center in driving its data modernization journey as a Cloud Data Infrastructure Engineer. This exciting opportunity involves designing, implementing, and maintaining data infrastructure solutions for a hybrid and multi-cloud data ecosystem.Key Responsibilities:Collaborate with technical...


  • New York, New York, United States Celonis GmbH Full time

    About CelonisCelonis is a global leader in Process Mining technology and one of the world's fastest-growing SaaS firms. Our mission is to unlock productivity by placing data and intelligence at the core of business processes.The RoleWe're seeking a Senior Cloud Platform Engineer to join our Platform Infrastructure team. As a key member of this team, you will...


  • New York, New York, United States Associated Banc-Corp Full time

    About the RoleAssociated Banc-Corp is seeking a highly skilled Senior Manager Data Platform Engineering to lead our data platform engineering team. As a key member of our organization, you will be responsible for developing and executing the data platform DataOps technical strategy and roadmap of capabilities, ensuring scalability, reliability, reusability,...

  • Cloud Data Engineer

    3 weeks ago


    New York, New York, United States Inizio Partners Full time

    About the JobCloud Data Engineer - GCPWe are seeking a highly skilled Cloud Data Engineer to join our team at Inizio Partners. As a Cloud Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing applications on Google Cloud Platform (GCP).Key ResponsibilitiesDesign and develop enterprise data processing...


  • New York, New York, United States Tech Tammina Full time

    Job Description**Senior Cloud Data Engineer**We are seeking a highly skilled Senior Cloud Data Engineer to join our team at Tech Tammina. As a Senior Cloud Data Engineer, you will be responsible for designing, developing, and maintaining data pipelines on Google Cloud Platform (GCP).The ideal candidate should have extensive experience in IT and data...