GCP Data Engineer

2 weeks ago

Phoenix, United States Triunity Software Full time
Job DescriptionJob DescriptionNature: Day One On-site
Duration: 24 Months
Candidates Required: 04
Experience: 5 to 8 Years

Following is the Job description for the role of a Data Engineer,

Mandatory Skill Set: Apache Spark, Hive, Hadoop, BigQuery, BigTable, Cloud Composure, Dataflow, Google Cloud Storage, Python, SQL, Shell Scripting, Git.
Good to have Skill Set: CI/CD, Jenkins, Security and Networking, Scala, GCP Identity and Access Management (IAM).
Responsibilities:
1. Data Processing: Design, develop, and maintain scalable and efficient data processing pipelines using technologies such as Apache Spark, Hive, and Hadoop.
2. Programming Languages: Proficient in Python, Scala, SQL, and Shell Scripting for data processing, transformation, and automation.
3. Cloud Platform Expertise: Hands-on experience with Google Cloud Platform (GCP) services, including but not limited to BigQuery, BigTable, Cloud Composer, Dataflow, Google Cloud Storage, and Identity and Access Management (IAM).
4. Version Control and CI/CD: Implement and maintain version control using Git and establish continuous integration/continuous deployment (CI/CD) pipelines for data processing workflows.
5. Jenkins Integration: Experience with Jenkins for automating the building, testing, and deployment of data pipelines.
6. Data Modeling: Work on data modeling and database design to ensure optimal storage and retrieval of data.
7. Performance Optimization: Identify and implement performance optimization techniques for large-scale data processing.
8. Collaboration: Collaborate with cross-functional teams, including data scientists, analysts, and other engineers, to understand data requirements and deliver solutions.
9. Security and Networking: Possess basic knowledge of GCP Networking and GCP IAM to ensure secure and compliant data processing.
10. Documentation: Create and maintain comprehensive documentation for data engineering processes, workflows, and infrastructure.
Qualifications:
1. Proven experience with Apache Spark, Hive, and Hadoop.
2. Strong programming skills in Python, Scala, SQL, and Shell Scripting.
3. Hands-on experience with GCP services, including BigQuery, BigTable, Cloud Composer, Dataflow, Google Cloud Storage, and Identity and Access Management (IAM)
4. Familiarity with version control using Git and experience in implementing CI/CD pipelines.
5. Experience with Jenkins for automating data pipeline processes.
6. Basic understanding of GCP Networking.
7. Excellent problem-solving and analytical skills.
8. Strong communication and collaboration skills.

  • Big Data with GCP

    2 weeks ago

    Phoenix, United States Tata Consultancy Services Full time

    JobTitle Big data with GCP RelevantExperience(inyrs) 8yrs WorkLocation (State, City and Zip) Phoenix, New york Technical/FunctionalSkills Bigdata with GCP Roles& Responsibilities Big Data Engineer with ETL - Big Data / Data Warehousing "Expert in SQL and Data warehousing concepts. Hands-on experience with public cloud data warehouse (GCP,Azure, AWS). GCP...

  • Data Engineer

    2 weeks ago

    Phoenix, United States The IT Gigs Full time

    Job title: Data Engineer Location: Phoenix, AZ (Onsite) Job type: W2 Only VISA: USC and GC JD: Mandatory Skill Set: Apache Spark, Hive, Hadoop, BigQuery, BigTable, Cloud Composure, Dataflow, Google Cloud Storage, Python, SQL, Shell Scripting, Git. Good to have Skill Set: CI/CD, Jenkins, Security and Networking, Scala, GCP Identity and Access Management...

  • Data Engineer

    3 weeks ago

    Phoenix, United States The IT Gigs Full time

    Job title: Data EngineerLocation: Phoenix, AZ (Onsite)Job type: W2 OnlyVISA: USC and GCJD:Mandatory Skill Set: Apache Spark, Hive, Hadoop, BigQuery, BigTable, Cloud Composure, Dataflow, Google Cloud Storage, Python, SQL, Shell Scripting, Git.Good to have Skill Set: CI/CD, Jenkins, Security and Networking, Scala, GCP Identity and Access Management...

  • GCP Bigdata Engineer

    11 hours ago

    Phoenix, United States Centraprise Full time

    Company DescriptionCentraprise is providing traditional staffing services, professional and technical staffing and management services to some of the country's leading companies with highest quality of service. Due to our expertise across multi-platform technologies and skill-sets, Centraprise provides services to a wide spectrum of customers across...

  • GCP Bigdata Engineer

    2 weeks ago

    Phoenix, United States Centraprise Full time

    Job DescriptionJob DescriptionCompany DescriptionCentraprise is providing traditional staffing services, professional and technical staffing and management services to some of the country's leading companies with highest quality of service.  Due to our expertise across multi-platform technologies and skill-sets, Centraprise provides services to a...

  • Senior Data Engineer

    13 hours ago

    Phoenix, United States Diverse Lynx Full time

    Job Title: Senior Data Engineer Experience: 8+ Year Location: Phoenix, AZ Duration: 12+ Months Data Engineer: Big Data; ETL - Big Data / Data Warehousing; GCP; Hadoop / HDFS; Hive; PySpark; Python 3 to 7 years of experience within Data Engineering/ Data Warehousing using Big Data Hands-on experience with GCP, google composer, bigQuery and bigTable ...

  • Lead Data Engineer

    2 days ago

    Phoenix, United States JobRialto Full time

    Description 8-12 years of experience with Python, SQL, Databricks or Snowflake or Fabric. Spark tech stack is required. Azure preferred, but open to to GCP, AWS. Person is leading junior engineers who are all reporting to hiring manager. Additional Skills Certifications, 2+ years of data architecture, data engineering patterns, git repo, software engineering...

  • GCP Consultant

    3 weeks ago

    phoenix, United States TRINITY INFOTECH INC Full time

    Job Title: GCP Consultant Location: Phoenix, Arizona (hybrid / Day 1 onsite) Duration: Long term contract JOB SPECIFICATIONS: Desired Experiences: GCP certifications Minimum Required Experience: Bachelor’s degree or equivalent, Masters preferred in Computer Science. Cloud Infrastructure and Security - 5 yearsSkills & Qualifications: Experience...

  • GCP Consultant

    2 weeks ago

    Phoenix, United States Trinity Infotech Full time

    Job Title: GCP Consultant Location: Phoenix, Arizona (hybrid / Day 1 onsite) Duration: Long term contract JOB SPECIFICATIONS: Desired Experiences: GCP certifications Minimum Required Experience: Bachelor’s degree or equivalent, Masters preferred in Computer Science. Cloud Infrastructure and Security - 5 yearsSkills & Qualifications: Experience designing,...

  • Data Engineer

    2 weeks ago

    Phoenix, United States Tekdoors Full time

    Job DescriptionJob DescriptionJob Title: Data Engineer Location: Jacksonville, FL / Phoenix, AZ (Hybrid Work) Duration: 24+ Months Employment Type: Contract W2 Experience: 8+ YearsMust-Have: Bachelor's or Master's degree in Computer Science, Information Technology, or a related field. Proven experience as a Data Engineer with a minimum of 8 years in...

  • GCP Consultant

    2 weeks ago

    Phoenix, United States Trinity Infotech Full time

    Job Title: GCP Consultant Location: Phoenix, Arizona (hybrid / Day 1 onsite) Duration: Long term contract JOB SPECIFICATIONS: Desired Experiences: GCP certifications Minimum Required Experience: Bachelors degree or equivalent, Masters preferred in Computer Science. Cloud Infrastructure and Security - 5 yearsSkills & Qualifications: Experience designing,...

  • Data Engineer

    1 week ago

    Phoenix, United States Recurring Decimal Full time

    Data Analyst/ Engineer Location: Phoenix, AZ or Los Angeles, CAHybridCompliance in Banking Domain knowledge is a mustProven experience (5+ years) as a Business Analyst, Data Engineer, or similar role within the financial industry, with a strong focus on compliance and regulatory matters.Proficiency in writing complex SQL queries to extract, transform, and...

  • Data Engineer

    2 weeks ago

    Phoenix, United States Recurring Decimal Full time

    Data Analyst/ Engineer Location: Phoenix, AZ or Los Angeles, CAHybridCompliance in Banking Domain knowledge is a mustProven experience (5+ years) as a Business Analyst, Data Engineer, or similar role within the financial industry, with a strong focus on compliance and regulatory matters.Proficiency in writing complex SQL queries to extract, transform, and...

  • Data Engineer

    1 week ago

    Phoenix, United States Recurring Decimal Full time

    Data Analyst/ Engineer Location: Phoenix, AZ or Los Angeles, CAHybridCompliance in Banking Domain knowledge is a mustProven experience (5+ years) as a Business Analyst, Data Engineer, or similar role within the financial industry, with a strong focus on compliance and regulatory matters.Proficiency in writing complex SQL queries to extract, transform, and...

  • GCP Cloud Engineer

    1 day ago

    Phoenix, United States Tech Matrix INC Full time

    Experience with GCP – CloudFunction, GKE, BigQuery, CloudSQL, IAM, Looker, GCS, Firebaser etc is much desired. Terraform experience building cloud Infrastructure, ability to write modules, follow SMBC best practices, state files management etc Solid understanding of Linux fundamentals. Solid understanding of Linux fundamentals (Linux Inside...

  • GCP Cloud Engineer

    2 days ago

    Phoenix, United States TechMatrix Inc Full time

    Experience with GCP – CloudFunction, GKE, BigQuery, CloudSQL, IAM, Looker, GCS, Firebaser etc is much desired.Terraform experience building cloud Infrastructure, ability to write modules, follow SMBC best practices, state files management etc Solid understanding of Linux fundamentals.Solid understanding of Linux fundamentals (Linux Inside...

  • GCP Cloud Engineer

    1 day ago

    Phoenix, United States TechMatrix Inc Full time

    Experience with GCP – CloudFunction, GKE, BigQuery, CloudSQL, IAM, Looker, GCS, Firebaser etc is much desired.Terraform experience building cloud Infrastructure, ability to write modules, follow SMBC best practices, state files management etc Solid understanding of Linux fundamentals.Solid understanding of Linux fundamentals (Linux Inside...

  • GCP Cloud Engineer

    2 days ago

    Phoenix, United States TechMatrix Inc Full time

    Experience with GCP – CloudFunction, GKE, BigQuery, CloudSQL, IAM, Looker, GCS, Firebaser etc is much desired.Terraform experience building cloud Infrastructure, ability to write modules, follow SMBC best practices, state files management etc Solid understanding of Linux fundamentals.Solid understanding of Linux fundamentals (Linux Inside...

  • GCP Cloud Engineer

    1 day ago

    Phoenix, United States TechMatrix Inc Full time

    OB SPECIFICATIONS: Education: Bachelor's degree or equivalentMinimum Required Experience:· Bachelor’s degree or equivalent, Masters preferred in Computer Science.· Cloud Infrastructure and security - 5 yearsSkills & Qualifications:Experience with GCP – CloudFunction, GKE, BigQuery, CloudSQL, IAM, Looker, GCS, Firebaser etc is much desired.Terraform...

  • GCP Cloud Engineer

    2 days ago

    Phoenix, United States TechMatrix Inc Full time

    OB SPECIFICATIONS: Education: Bachelor's degree or equivalentMinimum Required Experience:· Bachelor’s degree or equivalent, Masters preferred in Computer Science.· Cloud Infrastructure and security - 5 yearsSkills & Qualifications:Experience with GCP – CloudFunction, GKE, BigQuery, CloudSQL, IAM, Looker, GCS, Firebaser etc is much desired.Terraform...