GCP Cloud Data Engineer

2 weeks ago


New York, United States BPO Recruit Full time

We are recruiting for a Top Tier ICT organisation.


Note, THIS IS A PERMANENT ROLE ONLY, THE CLIENT IS NOT SPONSORING VISAS

The client is fine with the candidate location being anywhere in the US


Key Pointers that are mandatory

  1. Python
  2. SQL
  3. GCP

Good to Have

  • Healthcare Experience



Role and Responsibilities:

· Work closely with application development and data engineers on day-to-day tasks.

· Participate in project planning and implementation.

· Coordinate with Data Scientists, Product Managers and business leaders to understand data needs and deliver on those needs.

· Create and maintain optimal data pipeline architecture.

· Assemble large, complex data sets that meet functional / non-functional business requirements.

· Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.

· Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and other data sources.

· Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.

· Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.

· Improve, optimize and identify opportunities for efficient software development processes.

· Help achieve milestones as per sprint plan and prioritize to manage ad-hoc requests in parallel with ongoing sprints.


Candidate Profile:


Required Qualifications:

· 5+ years of hands-on experience in building Data pipeline (ETL/ELT) in a cloud platform

· GCP knowledge strongly preferred - other cloud experience such as AWS. AZURE is ok

· 5+ years of hands-on experience of building and operationalizing data processing systems

· Strong Python scripting experience is very important requirement

· 2+ years’ experience in NoSQL databases and close familiarity with technologies/languages such as Python/R, Scala, Java, Hive, Spark, Kafka

· 2+ years’ experience working with data platforms (Data warehouse, Data Lake, ODS)

· 2+ years’ experience working with tools to automate CI/CD pipelines (e.g., Jenkins, GIT, Control-M)

· Must have working experience with the clinical data


Preferred Qualifications:

· GCP (google cloud platform) experience

· 3+ years of experience working on healthcare / clinical data

· Data analysis / Data mapping skills

· Python

· Cloud Data flow/Data proc/Function



  • New York, United States Tech Tammina LLC Full time

    Job DescriptionJob DescriptionSenior GCP Data EngineersNew YorkSummary The ideal candidate should have extensive experience in IT and data engineering, particularly with GCP in the financial sector. They should be proficient in managing and optimizing data storage, ensuring data security, and using Python and SQL for data manipulation. They must also have a...

  • GCP Data Engineer

    3 days ago


    New York, United States Insight Global Full time

    Job Description An Insight Global client in the Financial Services industry is looking for GCP Data Engineers to join their team in Gurgaon, India or Bangalore, India. The client is looking for GCP Data Engineers who have experience in building data pipelines, as well as experience managing, transforming, and organizing big data. This role will also require...


  • New York, United States TEKsystems Full time

    Description: As an organization, Global Services provides a continuum of services ranging from Engagement Management to full functional Outsourcing including Offshore Centers in Canada and India. Our model provides the ability to engage customers beyond staffing when asked for more ownership, capabilities, or methodology while enhancing client/consultant...

  • GCP Network Engineer

    2 weeks ago


    New York, New York, United States Insight Global Full time

    Job Description We are seeking a talented and experienced GCP Network Engineer with strong DevOps skills to join our dynamic team. In this role, you will be responsible for designing, implementing, and maintaining the networking infrastructure within Google Cloud Platform (GCP) environments. Additionally, you will play a key role in automating infrastructure...

  • Cloud/Python Engineer

    3 weeks ago


    New York, United States Kenfill Techno Solutions Full time

    Job DescriptionJob DescriptionJob Description:We are looking for a Cloud/Python Engineers to join our dynamic team. The ideal candidates will have strong expertise in both cloud platforms (50%) and Python programming (50%). They will be involved in developing and maintaining data pipelines and existing API models.Skills:Strong proficiency in Python...


  • New York, United States Epsilon Solutions Full time

    **Job Role: Technical Advisor With GCP** **Location: New York, NY** **Duration: Long Term Contract** **Qualifications**: - **Bachelor's degree in Computer Science, Engineering, or related field.**: - **Experience in Infrastructure, Data Center Migration Onprem To cloud (GCP)**: - **Team Handling**: - **Architects Will be Reporting Directly to...

  • Control Engineers

    2 weeks ago


    New York, United States Photon Full time

    Job Description GCP Implementation and Integration Team Responsibilities: • Infrastructure as Code (IaC): oDesign, implement, and manage infrastructure as code using Terraform for GCP environments. oEnsure infrastructure configurations are scalable, reliable, and follow best practices. • GCP Platform Management: oArchitect and manage GCP environments,...


  • New York, United States Big Cloud Full time

    Do you have experience with the Azure Cloud stack and Azure Synapse? Are you interested in working with stakeholders to solve complex data pipeline and cloud problems? Are you open and able to work on a full-time/perm/W2 contract basis? A leading tech consulting company is seeing huge market success working with East Coast finance companies, Bay Area AI...

  • Senior Data Engineer

    4 weeks ago


    New York, United States Big Cloud Full time

    Do you have experience with the Azure Cloud stack and Azure Synapse?Are you interested in working with stakeholders to solve complex data pipeline and cloud problems?Are you open and able to work on a full-time/perm/W2 contract basis?A leading tech consulting company is seeing huge market success working with East Coast finance companies, Bay Area AI...


  • New York, United States Bank of America Full time

    Description : At Bank of America, we are guided by a common purpose to help make financial lives better through the power of every connection. Responsible Growth is how we run our company and how we deliver for our clients, teammates, communities and shareholders every day. One of the keys to driving Responsible Growth is being a great place to work...


  • New York, United States TEKsystems Full time

    Description:NYU Langone is looking for a Cloud Network engineer. This will be for their Multi Cloud Direct Connect project and it is crucial that they have used Aviatrix. They will need a Senior Cloud Network Engineer. This consultant will have extensive experience in designing and implementing native cloud services across Azure, AWS, and Google Cloud...


  • New York, United States tekHouse Full time

    100% Remote Contract 1099 or C2C 6 -9 month plus MUST be USC The primary role of the Data Architect is to support and expand the Data & Analytics platforms that process, store, organize the data critical for the data and analytics team. This role will have expertise in data movement and database technologies support data analytics and Machine Learning (ML) /...


  • New York, United States tekHouse Full time

    Job DescriptionJob Description100% Remote Contract 1099 or C2C 6 -9 month plusMUST be USCThe primary role of the Data Architect is to support and expand the Data & Analytics platforms that process, store, organize the data critical for the data and analytics team. This role will have expertise in data movement and database technologies support data analytics...


  • New York, United States tekHouse Full time

    Job DescriptionJob Description100% Remote Contract 1099 or C2C 6 -9 month plusMUST be USCThe primary role of the Data Architect is to support and expand the Data & Analytics platforms that process, store, organize the data critical for the data and analytics team. This role will have expertise in data movement and database technologies support data analytics...


  • New York, United States Big Cloud Full time

    Are you interested in revolutionary technology?Are you passionate about large-scale NLP and search?Would you like to help shape a world-class ML platform with proven results?I'm recruiting for one of the most advanced NLP start-ups in New York City. Their open-source content discovery platform uses NLP to extract research and connect data points across the...


  • New York, United States Big Cloud Full time

    Are you interested in revolutionary technology?Are you passionate about large-scale NLP and search?Would you like to help shape a world-class ML platform with proven results?I'm recruiting for one of the most advanced NLP start-ups in New York City. Their open-source content discovery platform uses NLP to extract research and connect data points across the...


  • New York, United States Skillsbay Limited Remote Work Freelance Full time $50 - $70

    On site - New York, NYC2C6 monthsJob Summary:We are seeking a skilled Cloud Security Engineer with a strong background in Go or Kotlin programming and expertise in identity and access management. As a Cloud Security Engineer, you will be responsible for designing, implementing, and managing cloud security solutions across our organization. You will work...

  • Data Engineer

    4 weeks ago


    New York, United States Strata Infosys Full time

    Requirements Must have 5 years minimum hands-on experience with the following • Writes complex SQL queries required to perform Data Acquisition and Ingestion required for Data pipelines • Builds Data pipelines and does data engineering activities using technologies like Python Hadoop Spark etc. • Ensures the upkeep of the Hadoop Data Lake Platform...


  • New York, United States Publicis Sapient Full time

    Job Description As an Incident response Engineer, you will be a part of a smart cross-functional team delivering digital business transformation solutions to our clients. You’ll have the unique opportunity to increase the engineering team productivity by developing and overseeing the database architecture, design, and operations within the products...


  • New York, United States MigrationIT Full time

    Requirements 3-6 years of experience in data engineering Gather requirements from stakeholders and translate them into technical specifications. Design and implement data pipelines to collect, transform, and load data into data warehouses and data lakes. Maintain and optimize data systems to ensure high availability and performance. Work with other...