GCP Data engineer

2 weeks ago


Phoenix, Arizona, United States KASTECH Software Solutions Group Full time
Job Description

Years of experience: 6 to 9

Location: Phoenix

Role: GCP Data Engineer

Skills required:

  • GCP - Data flow, Data proc, Apache Beam skills

Focused Skills :

Focused skills: GCP Services including Big Query, Data flow, Data proc, Apache Beam, Pub Sub, Composer, Airflow

Mandatory Skills:

  • GCP Services including Big Query, Data flow, Data proc, Apache Beam, Pub Sub, Composer, Airflow Primary Skills

Job description
6-9 Years of hands-on experience with GCP - Data flow, Data proc, Apache Beam skills
Writing complex SQL queries to extract data from multiple tables

Experience in developing ELT/ETL processes using DataProc (Python or Java and Pyspark) & Dataflow Apache Beam using Java (for streaming)

Experience with Google BigQuery

Development of ETL orchestration using Google Composer or Airflow

Strong understanding of Data Ingestion, Data processing, Orchestration, Parallelization, Transformation, and ETL fundamentals

Good knowledge of data analysis using SQL tools

Understanding of Big Data technologies

Design, develop, automate, and support applications for data extraction, transformation, and loading

Knowledge of error handling and Performance tuning for Data pipelines

Excellent communication skills are essential


  • GCP Data Engineer

    2 weeks ago


    Phoenix, Arizona, United States Triunity Software Full time

    Position: Day One On-site at XYZ CompanyDuration: Long-term ContractOpen Positions: 04Experience: 5 to 8 Years Welcome to the exciting opportunity of a Data Engineer role at XYZ Company!Mandatory Skills: Apache Spark, Hive, Hadoop, BigQuery, BigTable, Cloud Composure, Dataflow, Google Cloud Storage, Python, SQL, Shell Scripting, Git.Desirable Skills: CI/CD,...

  • GCP Data Engineer

    2 weeks ago


    Phoenix, Arizona, United States Siri InfoSolutions Inc Full time

    Job DescriptionJob DescriptionTitle: GCP Data EngineeringLocation: Phoenix, AZ - OnsiteExperience: 6 - 8 years of experienceTechnical/Functional Skills: Google Cloud Platform, Big DataRoles & ResponsibilitiesGCP Data Engineer with hands on experience of 3+ years in Big Query, Data Proc, Airflow, Cloud Composer, GCP Hydra Services, Cloud Data Optimization ,...

  • GCP Data Engineer

    2 weeks ago


    Phoenix, Arizona, United States Genius Business Solutions Full time

    Job DescriptionAre you an enthusiastic IT pioneer – a problem solver with a growth mindset, eager to collaborate and innovate with other IT professionals, learn new abilities, develop fresh solutions, and advance your career to new heights? If that sounds like you, you'll thrive with our Sales Team – we're continuously innovating to provide cutting-edge...


  • Phoenix, Arizona, United States Siri InfoSolutions Inc Full time

    Job DescriptionBig Data Engineer with GCP in Phoenix, AZExpertise in mapreduce, spark, hive, and SQLStrong SQL and Data Warehousing skillsHands-on experience with public cloud data warehouses like GCP, Azure, AWSGCP certification is a plusMapR experience requiredProficiency in Python or Java programming languagesApplication design and software development in...

  • Data Engineer

    4 weeks ago


    Phoenix, Arizona, United States Motion Recruitment Full time

    Job DescriptionWe are currently seeking a talented and motivated Data Engineer with expertise in Google Cloud Platform (GCP). This financial tech company offers the opportunity for growth and advancement in a dynamic and innovative work environment.The #1 feature of this opportunity is the chance to work with GCP, designing and implementing data solutions...

  • Senior Data Engineer

    2 weeks ago


    Phoenix, Arizona, United States Diverse Lynx Full time

    Job Title: Senior Data Engineer Experience: 8+ Year Location: Phoenix, AZ Duration: 12+ Months Data Engineer: Big Data; ETL - Big Data / Data Warehousing; GCP; Hadoop / HDFS; Hive; PySpark; Python 3 to 7 years of experience within Data Engineering/ Data Warehousing using Big Data Hands-on experience with GCP, google composer, bigQuery and bigTable ...

  • data engineer

    4 weeks ago


    Phoenix, Arizona, United States Atos Full time

    Eviden, part of the Atos Group, with an annual revenue of circa € 5 billion is a global leader in data-driven, trusted and sustainable digital transformation. As a next generation digital business with worldwide leading positions in digital, cloud, data, advanced computing and security, it brings deep expertise for all industries in more than 47 countries....

  • data engineer

    2 weeks ago


    Phoenix, Arizona, United States Atos Full time

    Eviden, part of the Atos Group, with an annual revenue of circa € 5 billion is a global leader in data-driven, trusted and sustainable digital transformation. As a next generation digital business with worldwide leading positions in digital, cloud, data, advanced computing and security, it brings deep expertise for all industries in more than 47 countries....


  • Phoenix, Arizona, United States NucleusTeq Full time

    Required Skill Sets: Terraform, AWS Cloud transformation, Redshift, Airflow, DBT, CI/CD, Autosys and Control M, Github, Snowflake, AWS certification, SQL, Apache Airflow, Data Warehousing.Should have at least 15+ Years of overall IT experience in Designing, developing, and implementing Technology Solutions over a wide range of Industry domains such as...

  • Sr Data Engineer

    2 weeks ago


    Phoenix, Arizona, United States SMBC Full time

    ABOUT THE ORGANIZATION SMBC MANUBANK was formed by a group of banking entrepreneurs in June 1962. Our scope is to serve the specialized needs of California middle-market businesses, manufacturers, wholesalers, distributors, importers, exporters, and service companies, including small businesses and professionals. The anticipated salary range for this role is...


  • Phoenix, Arizona, United States Diamondpick Full time

    As a Engineer, you will leverage your expertise in Python, Large Language Models (LLM), Vector Databases, API, Data Architecture, and Enterprise Data Management to drive innovative solutions.With 6 to 10 years of experience, you will play a crucial role in developing and managing data systems that support our company's mission and impact society...


  • Phoenix, Arizona, United States Expert In Recruitment Solutions Full time

    Job Title: Site Reliability Engineer (SRE) Location: This is a hybrid onsite position, worker is required to work onsite 2-3 days per week in Phoenix, AZ.Hybrid Onsite: Worker is required to work onsite 3 days per week in Phoenix, AZ as they will be working cross functionally with 3 different teams.MAIN RESPONSIBILITIES" Experience in leading Observability...

  • Data Engineering

    2 weeks ago


    Phoenix, Arizona, United States Diverse Lynx Full time

    Data Engineer- Oracle Fusion cloud: Learning & Talent AZ-Phoenix-85054Relevant Experience(in yrs) = 5-8 yearsTechnical/Functional SkillsMust have 5-8 years of Data Engineering experience in a Big Data environment.Strong Data transformation/ETL skills using Spark, Python, PySpark, HiveQL Must have hands on experience building data ingestion pipelines from...


  • Phoenix, Arizona, United States The Judge Group Full time

    The Data & Analytics Architect influences the strategic use of data for one of the largest and most respected private companies in Arizona. This highly motivated, team-oriented data professional has a passion for building scalable and secure data solutions that empower self-service business intelligence, insight-driven analytics, and ai-powered decision...


  • Phoenix, Arizona, United States RIT Solutions, Inc. Full time

    Java Developer- Tech Lead Phoenix, AZ (onsite 3 days a week) 6 Months *experience with machine learning would be plus. GCP and GCP services are a big plus *Gen AI experience is a big plus Back-end server side no Front-end; building microservices and data related work. Current needs are around senior engineers- tech leads that would be comfortably...


  • Phoenix, Arizona, United States Nisum Full time

    Nisum is a leading global digital commerce firm headquartered in California, with services spanning digital strategy and transformation, insights and analytics, blockchain, business agility, and custom software development. Founded in 2000 with the customer-centric motto "Building Success Together," Nisum has grown to over 1,800 professionals across the...


  • Phoenix, Arizona, United States Nisum Full time

    Nisum is a leading global digital commerce firm headquartered in California, with services spanning digital strategy and transformation, insights and analytics, blockchain, business agility, and custom software development. Founded in 2000 with the customer-centric motto "Building Success Together," Nisum has grown to over 1,800 professionals across the...


  • Phoenix, Arizona, United States Nisum Full time

    Nisum is a leading global digital commerce firm headquartered in California, with services spanning digital strategy and transformation, insights and analytics, blockchain, business agility, and custom software development. Founded in 2000 with the customer-centric motto "Building Success Together," Nisum has grown to over 1,800 professionals across the...


  • Phoenix, Arizona, United States Cloud BC Labs Full time

    Job DescriptionJob DescriptionPOSITIONSite Reliability Engineer (SRE)LOCATIONHybrid Phoenix, AZDURATION6 MonthsINTERVIEW TYPEVideoVISA RESTRICTIONSNoneREQUIRED SKILLSExperience leading onshore/offshore teamsHands on building/troubleshooting experienceTransitioned from Prometheus to Mimir; Grafana is still a must-haveSite Reliability/Observability dev...

  • Cloud Test Engineer

    2 weeks ago


    Phoenix, Arizona, United States InterSources Full time

    Job Title: Cloud Test Engineer Duration: Long-Term Location: Phoenix, ArizonaJOB SUMMARY:The test Specialist will perform the role of a technical lead in the project. Key objectives will focus on quality, effort variance, and schedule adherence. Reviewing the deliverable of test engineers will be one key responsibility that the role will have. The role...