Senior data engineer

23 hours ago

Phoenix, AZ, United States United IT Solutions Full-time
ole : Senior Data Engineer - GCP, Scala, Spark & Python

Location: Phoenix , AZ (Hybrid)

Mandatory Skills: ANSI-SQL, GCP Big Query, Scala

Job description

Role Focus: Hands-on data engineering with Spark, Scala, Python, and cloud platforms such as GCP; AWS knowledge is an advantage.

Position Overview

We are seeking a Specialist with 5 to 7 years of experience in GCP data analytics to design, build, and optimise scalable data solutions on Google Cloud Platform. The ideal candidate will bring strong expertise in GCP BigQuery, Scala, ANSI SQL, and modern data engineering practices, along with the ability to support reliable, secure, and high-performing analytics workflows.

Key Responsibilities:
  • Design, develop, and maintain scalable data processing and analytics pipelines using GCP BigQuery and Scala.
  • Write, optimise, and maintain complex ANSI SQL queries for data extraction, transformation, validation, and reporting.
  • Implement data processing workflows and automation scripts to improve pipeline efficiency and reliability.
  • Collaborate with data engineers, analysts, and business stakeholders to gather requirements and deliver effective cloud-based data solutions.
  • Ensure data quality, integrity, governance, and security across analytics workflows and pipelines.
  • Monitor and optimise the performance and cost of data processing jobs running on GCP.
  • Diagnose and resolve data discrepancies and pipeline issues to maintain high availability and operational stability.
  • Maintain clear documentation for data workflows, processes, standards, and best practices.
  • Stay current with emerging GCP data analytics technologies and recommend continuous improvements to existing solutions.
  • Participate in code reviews and mentor junior team members on GCP data analytics tools, methods, and engineering practices.
  • Design develop and maintain scalable data analytics pipelines using GCP BigQuery and Scala Write efficient ANSISQL queries to extract transform and analyze data from diverse sources Implement data processing and automation scripts to enhance pipeline efficiency Collaborate with data engineers analysts and stakeholders to troubleshoot data discrepancies and optimize workflows Ensure compliance with data governance security policies and quality standards throughout data operations Proactively monitor data pipelines diagnose issues and implement timely resolutions to maintain high availability Participate in code reviews and contribute to continuous improvement of data engineering practices Mentor junior team members and share knowledge on GCP data analytics tools and methodologies