Cloud Data Platform Engineer

2 months ago


New York, United States Global Channel Management Full time

About the job Cloud Data Platform Engineer

Cloud Data Platform Engineer needs 5+ years implementing data applications or data platforms with BigData/Hadoop, Python/Java/Spark full stack, etc.

5+ year support experience of Big Cloud Data Platform Engineer requires:

  • 3 days a week, hybrid
  • Locations: Iselin, NJ, Charlotte, NC, N Y, NY
  • Data Engineering 60-70 %.
  • Infrastructure 30-40%. (Moving Data in & Out of cloud)
  • Snowflake exp is preferred
  • Masters or Bachelor's degree in computer science or related discipline
  • Manage and ensure delivery of project tasks as required
  • Excellent documentation skills to create and manage design, implementation and automation related documentation
  • Implementation experience for Hadoop distribution platforms like Cloudera or AWS EMR.
  • Extensive experience in designing, engineering and managing data lake ingestion, validation, transformation and consumption services leveraging cloud data tools like Hive, Spark, EMR, Glue ETL and Catalog, Snowflake etc.
  • Experience on implementing solutions with Worflow orchestration/scheduling tools such as Airflow, Autosys etc.
  • Experience building CI/CD pipelines for infrastructure implementations with Teraform, Gitlab etc.
  • Must be ability to multi-task and prioritize tasks for self
  • Must experience working in agile environment with multiple priorities
Preferred Skills:
  • 5+ years implementing data applications or data platforms with BigData/Hadoop, Python/Java/Spark full stack, etc.
  • 5+ year support experience of Big Data technologies in Hadoop ecosystem Hive, HDFS, MapReduce, Spark, Yarn, Kafka, Pig, HBase, Sqoop, Elastic Search, Kerberos.
  • 5+ years experience with ETL/ELT tools such as AWS Glue ETL, Talend, Datastage etc.
  • 5+ years experience with Orchestration tools such as Airflow, Autosys etc.
  • Experience with Jira and Agile methodology is a plus;
  • Experience with understanding DevOps or CI/CD process w.r.t to infrastructure management activities
Cloud Data Platform Engineer duties:
  • Design, develop and deliver cloud datastore solutions and develop automation pipelines to migrate data sets from On-prem to Cloud platforms. Practice Infrastructure as code to develop automation routines and integration flows to manage state of the datastore platform systems
  • Provision secures from start datastores and enable them with required security controls including encryption, masking, certificate/keys rotation etc.
  • Collaborates with developers, analysts, various system administrators to identify business requirements in designing efficient datastore solutions and interfaces.
  • Identifies and documents all system constraints, implications, and consequences of various proposed system changes.
  • Reviews technical documentation to guide system users and to assist with the ongoing operation, maintenance, and development of the system. Evaluates the efficiency and effectiveness of application operations and troubleshooting problems.
  • Provide expert level IT technical lead services, including the direction, evaluation, selection, configuration, implementation, and integration of new and existing technologies and tools in a cloud platform.


  • New York, New York, United States Hudson Data Full time

    Hudson Data is seeking a highly skilled Cloud Data Engineer Expert to join our team.We are looking for an experienced professional with hands-on knowledge of various Azure services, including but not limited to Azure Data Factory, Databricks, Data Lake, and Power BI. The ideal candidate should be able to design, build, and maintain ETL pipelines, manage data...


  • New York, New York, United States L'Oreal Full time

    About the Role:We are seeking an experienced Data Engineer to lead our data acquisition, standardization, and harmonization initiatives on Google Cloud Platform (GCP). The ideal candidate will have a deep understanding of data engineering principles and practices, as well as experience working with large-scale domain-specific datasets. As a Senior Data...

  • Cloud Data Engineer

    1 month ago


    New York, New York, United States HR Recruiting Services Full time

    Job Description:We are seeking an experienced Cloud Data Engineer to join our team at HR Recruiting Services. This is a challenging and rewarding opportunity for a skilled professional with a strong background in data engineering and cloud computing.About the Role:This role will be responsible for designing, implementing, and maintaining scalable data...

  • Cloud Data Engineer

    2 hours ago


    New York, New York, United States Lorven Technologies Full time

    Lorven Technologies is seeking a skilled Cloud Data Engineer to join our team in New York City, NY. As a Cloud Data Engineer, you will play a crucial role in the development of our data platform on Azure Cloud Platform. The estimated salary for this position is $120,000 - $180,000 per year.About the Role:We are looking for an experienced professional with a...


  • New York, New York, United States Prophecy Full time

    About ProphecyWe are a leading data copilot company, trusted by Fortune 500 enterprises to accelerate AI and analytics. Our mission is to deliver data that is clean, trusted, and timely.Prophecy enables all data users to be productive by helping develop, deploy, and observe data pipelines on cloud data platforms. With our expertise, organizations can focus...

  • Cloud Data Engineer

    7 days ago


    New York, New York, United States Futran Tech Solutions Pvt. Ltd. Full time

    Job Title: Cloud Data EngineerLocation: New York City, NY (Day one Onsite)About the Job:We are seeking an experienced Cloud Data Engineer to join our team at Futran Tech Solutions Pvt. Ltd. in New York City. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining scalable ETL pipelines to ensure...


  • New York, United States Hudson Data Full time

    Job Title: Sr. Azure Data Engineer Location: NYC, NY Duration: Long Term W2 Role Job Description: The candidate should have hands-on experience with various Azure services including but not limited to Azure Data Factory, Databricks, Data Lake, and Power BI. They should be able to design, build, and maintain ETL pipelines, manage data lakes, and...


  • New York, New York, United States Inizio Partners Full time

    About the JobWe are seeking a highly skilled Cloud Data Engineer to join our team at Inizio Partners. This role is focused on designing and developing enterprise data processing applications using Google Cloud Platform (GCP).As a Cloud Data Engineer, you will be responsible for building and maintaining scalable, secure, and efficient data pipelines using GCP...


  • New York, New York, United States Perennial Resources International Full time

    About the RoleWe are looking for a talented Senior Data and Cloud Engineer to join our team at Perennial Resources International. As a key member of our data engineering team, you will play a crucial role in designing, implementing, and maintaining our data infrastructure.The ideal candidate will have a deep understanding of data engineering principles,...


  • New York, New York, United States Inizio Partners Full time

    We are seeking a highly skilled Data Platform Specialist to join our team at Inizio Partners. As a Senior Data Engineer on Google Cloud Platform (GCP), you will play a key role in designing, building, and maintaining scalable data platforms that meet the needs of our clients.Your primary responsibilities will include:Platform Engineering: Design and...


  • New York, New York, United States LocalStack Full time

    Job DescriptionWe are seeking a highly skilled Lead Product Manager / DevX Engineer to join our team at LocalStack. This is an exciting opportunity for someone who wants to build on our strong foundation and take our developer platform to the next level.The ideal candidate will have a deep understanding of software product lifecycle, development processes,...


  • New York, New York, United States Diverse Lynx Full time

    Cloud Platform Solutions Engineer Job Overview:We are seeking a talented Cloud Platform Solutions Engineer to join our team at Diverse Lynx LLC. As a key member of our cloud engineering team, you will be responsible for designing, building, and maintaining scalable and secure cloud infrastructure solutions.Responsibilities:Design and implement cloud...


  • New York, New York, United States Vimeo Full time

    Job OverviewVimeo seeks a seasoned Data Platform Engineer to drive the reliability, performance, and scalability of our data platforms and pipelines. This critical leadership role will foster a culture of collaboration, continuous improvement, and technical excellence within the team.About the RoleAs Manager of Data Platform Engineering at Vimeo, you will...


  • New York, New York, United States Vimeo Full time

    Data Infrastructure Migration Lead:Vimeo is looking for an experienced Data Infrastructure Migration Lead to join our team. As a key member of our engineering team, you will be responsible for leading the migration of data infrastructure to modern, scalable solutions and ensuring the reliability, performance, and scalability of our data...


  • New York, New York, United States A-Line Staffing Solutions Full time

    **Job Summary**We are seeking an experienced Cloud Data Engineering Manager to lead our data engineering team in designing and developing complex data solutions.**Estimated Salary:** $180,000 - $280,000 per year.**Key Responsibilities:** Lead the design and development of complex data solutions, ensuring scalability and security. Develop and implement...


  • New York, United States Perennial Resources International Full time

    Lead Data Engineer Full-time/Permanent Onsite - NYCResponsibilities: Take ownership of the entire data engineering lifecycle, including design, implementation, performance tuning, and monitoring Manage and work with the firm's database managed service provider (MSP) to manage and monitor the firm's evolving database requirements Design, develop, and maintain...


  • New York, United States CV Library Full time

    Lead Data EngineerFull-time/PermanentOnsite - NYCResponsibilities:Take ownership of the entire data engineering lifecycle, including design, implementation, performance tuning, and monitoringManage and work with the firm's database managed service provider (MSP) to manage and monitor the firm's evolving database requirementsDesign, develop, and maintain...


  • New York, New York, United States HR Recruiting Services Full time

    **Job Title:** Cloud Data Engineering Lead**Job Type:** Full-time**Location:** Remote (USA)**Salary:** $150,000 - $200,000 per yearWe are seeking an experienced Cloud Data Engineering Lead to join our team at HR Recruiting Services. The ideal candidate will have a strong background in data engineering and cloud computing, with a proven track record of...


  • New York, New York, United States NextDoor Full time

    Job DescriptionThis role is responsible for developing and maintaining Nextdoor's cloud-based data infrastructure, which powers the development of our platform. As a Senior Data Engineer, you will design, build, and deploy scalable data systems that meet the needs of our users. Your expertise will be invaluable in driving the acceleration of product...


  • New York, New York, United States The Data Sherpas Full time

    Job Summary:We are seeking an experienced GCP Data Science Engineering Lead to join our team at The Data Sherpas. As a GCP Data Science Engineering Lead, you will be responsible for driving technology innovation by delivering world-class machine learning solutions on Google Cloud Platform (GCP).Key Responsibilities:Lead the design and deployment of...