GCP Data Engineer

3 days ago

Houston, Texas, United States Zeus Solutions Inc Full time $120,000 - $180,000 per year

Job description

We are seeking a skilled GCP Data Engineer based in Houston (onsite), with 8+ years of overall data engineering experience and at least 4 years of hands-on expertise in Google Cloud Platform (GCP).

Responsibilities

  • Develop, construct, test, and maintain data acquisition pipelines for large volumes of structured and unstructured data. This includes batch and real-time processing (in Google Cloud).
  • Build large and complex datasets based on business requirements.
  • Construct 'big data' pipeline architecture.
  • Identify opportunities for data acquisition via working with stakeholders and business clients.
  • Translate business needs to technical requirements.
  • Leverage a variety of tools in the Google Cloud Ecosystem such as Python, Dataflow, DataStream, CDC (Change Data Capture), Cloud Functions, Cloud Run, Pub/Sub, BigQuery, Cloud Storage to integrate systems and data pipelines.
  • Use logs & alerts to effectively monitor pipelines.
  • Use SAP SLT to replicate SAP tables to Google Cloud using SLT.
  • Develop JSON messaging structure for integrating with various applications.
  • Leverage DevOps and CI/CD practices (GitHub, Terraform) to ensure the reliability and scalability of data pipelines.
  • Partition/Cluster and retrieve content in BigQuery and use IAM roles & Policy Tags to secure the data.
  • Use roles to secure access to datasets, authorized views to share data between projects.
  • Design and build an ingestion pipeline using REST API.
  • Recommend ways to improve data quality, reliability, and efficiency.

Required

  • 7+ years of experience in a GCP data engineering role (if onsite/nearshore)

  • Atleast 2 years of hands on experience in GCP tools highlighted(Python, SQL, Data Flow, DataStream, CDC (Change Data Capture), Cloud Functions, Cloud Run, Pub Sub, BigQuery, Cloud Storage)

  • Great communication, work independently and manage small projects.

Job Types: Full-time, Contract, Temporary, Permanent

Work Location: In person

  • GCP Data Engineer

    2 days ago

    Houston, Texas, United States eNcloud Services LLC Full time $120,000 - $180,000 per year

    eNcloud Services Immediate RequirementTitle: GCP Data EngineerLocation: Houston, Texas (Must be willing to work 4 days a week onsite in downtown, Houston)Type of Hire: ContractWork Authorization: AnyGCP Data Engineer:The client's Data Analytics team operates under a product platform operating model and functions as a product team composed of multiple...

  • GCP Data Engineer

    2 weeks ago

    Houston, Texas, United States Unicorn Technologies LLC Full time $120,000 - $180,000 per year

    Job Title: GCP Data EngineerLocation: Dallas TX, (Day 1 onsite)Duration: 6+ MonthsJob DescriptionStrong experience in building RESTful APIs using PythonHands-on unit testing using Python's inbuilt librariesExperience with Kafka for messaging, including Kafka Connect and streaming applicationsIntegration of Kafka with GCP using managed servicesProficiency in...

  • GCP Architect

    3 days ago

    Houston, Texas, United States Jade Business Services (JBS) Full time $120,000 - $250,000 per year

    Design, implement and manage cloud architecture with appropriate services and AI solutions on GCP .Collaborate with cross-functional teams to define and execute cloud data strategies and roadmaps.Engage in pre-sales activities, including client presentations, technical solutioning, and proposal development.Work directly with clients and stakeholders to...

  • Principal Engineer, Data Analytics

    15 hours ago

    Houston, Texas, United States Genesys Full time $128,000 - $238,600 per year

    Genesys empowers organizations of all sizes to improve loyalty and business outcomes by creating the best experiences for their customers and employees. Through Genesys Cloud, the AI-powered Experience Orchestration platform, organizations can accelerate growth by delivering empathetic, personalized experiences at scale to drive customer loyalty, workforce...

  • Snowflake Data Architect with 14+ exp

    3 days ago

    Houston, Texas, United States TestingXperts Full time $120,000 - $200,000 per year

    Job Title: Snowflake Data ArchitectLocation: Houston, TX (Hybrid)Employment Type: ContractStart Date: ImmediateJob DescriptionWe are looking for a highly skilledSnowflake Data Engineer with strong expertise inSQL, Data Warehousing, Data Modeling, and Python. The ideal candidate should be based in Houston, TX, and available to join immediately. This role...

  • Data Engineer

    21 hours ago

    Houston, Texas, United States Addison Group Full time $120,000 - $180,000 per year

    Position SummaryThePI System Developer / Data Integration Engineerwill play a pivotal role in supporting operational data systems during a period of rapid growth. This position will help with ongoing day-to-day responsibilities while ensuring data pipelines remain reliable, secure, and optimized for plant performance and analytics.Key ResponsibilitiesDesign,...

  • Snowflake Engineer

    3 days ago

    Houston, Texas, United States Global Technology Partners Full time $120,000 - $180,000 per year

    We are seeking an experienced "Data Engineer" with strong expertise in Snowflake. The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines and ensuring efficient data flow across multiple systems. This role is perfect for someone who thrives in a fast-paced environment and enjoys solving complex data...

  • Data Engineer

    3 days ago

    Houston, Texas, United States Templeton & Partners - Innovative & Inclusive Hiring Solutions Full time $120,000 - $180,000 per year

    About the RoleWe are seeking aSenior Data Engineerto design and build robust, scalable data foundations and end-to-end solutions that unlock business value through data-driven insights. In this strategic role, you'll help shape and embed a data-driven culture across both IT and business functions, supporting global energy and trading operations.As a...

  • Data Analytics Engineer

    3 days ago

    Houston, Texas, United States Compunnel Inc. Full time $120,000 - $180,000 per year

    Goal/PurposeMove all data across the various project stewardship applications into a single cloud database (SQL to Snowflake). aka create a hub for project data across IT.TeamAgile teamData Engineers, Visualization Developers, Data Modelers - will be converting everyone into Analytics EngineersMUST HAVE:Snowflake/DBT - everything is done with DBT, this is...

  • Lead Data Platform Engineer

    2 days ago

    Houston, Texas, United States INSPYR Solutions Full time $120,000 - $240,000 per year

    Title: Lead Data Platform EngineerLocation:RemoteDuration: 9+ months contractCompensation:$ /hrWork Requirements:US Citizen, GC Holders or Authorized to Work in the U.S.Lead Data Platform EngineerSummary:Are you passionate about building and supporting modern, cloud-based data platforms? We're seeking a Sr. Data Platform Engineer to scale our DataOps...