GCP Lead Engineer

4 weeks ago

Davidson, United States Compunnel Inc. Full time

Role – GCP Technical Lead

Location: Davidson, NC (Hybrid - 3 Days in a week)

Yrs. of experience: 10+ Yrs.

Mode of employment: Full-Time


Skills: Google BigQuery, DataProc, Data fusion, Apache Airflow, Google Cloud Platform, Python, SQL, CI/CD pipelines

Responsibilities:

Support Data ingestion pipelines, data processing workflows, and data storage solutions using GCP services such as Cloud Storage, Big Query, Dataflow, Composer etc.

Work with other DEs to integrate data solutions into applications.

Manage & configure data integration processes to extract data from various sources, transform and cleanse it, and load it into appropriate data storage systems.

Maintain and support ETL processes to ensure data quality and consistency.

Support efficient data retrieval and analysis.

Monitor data pipelines and processes for data quality issues.

Troubleshoot and resolve data-related problems in a timely manner.

Perform regular data backups and implement disaster recovery procedures.

Collaborate with cross-functional teams to understand data requirements and provide technical guidance and support.

Document data infrastructure, processes, and workflows to ensure knowledge sharing and maintainability.

Optimize data structures and queries for performance and scalability as problem management for long running jobs

Deployments on BigQuery, BigQuery object provision automation, BigQuery capacity management (Proactive/Reactive)

Optimizing and tuning Big Queries, Changes to DDL statements

Admin activities e.g., Create/Drop/Alter table/view, Data loads and fixes.

Provide configuration details to terraform team

  • GCP Lead Engineer

    4 weeks ago

    Davidson, United States Compunnel Inc. Full time

    Role – GCP Technical LeadLocation: Davidson, NC (Hybrid - 3 Days in a week)Yrs. of experience: 10+ Yrs.Mode of employment: Full-TimeSkills: Google BigQuery, DataProc, Data fusion, Apache Airflow, Google Cloud Platform, Python, SQL, CI/CD pipelines Responsibilities:Support Data ingestion pipelines, data processing workflows, and data storage solutions using...

  • GCP Technical Lead

    2 weeks ago

    Davidson, United States United Software Group Full time

    Role - GCP Technical LeadLocation: Davidson, NC (Hybrid - 3 Days in a week)Yrs. of experience: 10+ Yrs.Mode of employment: Full-TimeJob Description: Skills: Google BigQuery, DataProc, Data fusion, Apache Airflow, Google Cloud Platform, Python, SQL, CI/CD pipelines.Responsibilities:Support Data ingestion pipelines, data processing workflows, and data storage...

  • GCP Technical Lead

    3 weeks ago

    Davidson, United States United Software Group Full time

    Role - GCP Technical LeadLocation: Davidson, NC (Hybrid - 3 Days in a week)Yrs. of experience: 10+ Yrs.Mode of employment: Full-TimeJob Description: Skills: Google BigQuery, DataProc, Data fusion, Apache Airflow, Google Cloud Platform, Python, SQL, CI/CD pipelines.Responsibilities:Support Data ingestion pipelines, data processing workflows, and data storage...

  • GCP Technical Lead

    3 weeks ago

    Davidson, United States United Software Group Inc Full time

    Role – GCP Technical LeadLocation: Davidson, NC (Hybrid - 3 Days in a week)Yrs. of experience: 10+ Yrs.Mode of employment: Full-Time Job Description: Skills: Google BigQuery, DataProc, Data fusion, Apache Airflow, Google Cloud Platform, Python, SQL, CI/CD pipelines. Responsibilities:Support Data ingestion pipelines, data processing workflows, and data...

  • GCP Technical Lead

    3 weeks ago

    Davidson, United States United Software Group Inc Full time

    Role – GCP Technical LeadLocation: Davidson, NC (Hybrid - 3 Days in a week)Yrs. of experience: 10+ Yrs.Mode of employment: Full-Time Job Description: Skills: Google BigQuery, DataProc, Data fusion, Apache Airflow, Google Cloud Platform, Python, SQL, CI/CD pipelines. Responsibilities:Support Data ingestion pipelines, data processing workflows, and data...

  • GCP Lead Consultant

    2 months ago

    Davidson, United States CareerBuilder Full time

    Job Title: GCP Lead Consultant Location: Davidson at NC (Day 1 onsite) Duration: (Contract) Essential Responsibilities: Support Data ingestion pipelines, data processing workflows, and data storage solutions using GCP services such as Cloud Storage, Big Query, Dataflow, Composer etc. Work with other DEs to integrate data solutions into applications. Manage &...

  • GCP Technical Lead

    4 weeks ago

    Davidson, United States Diverse Lynx Full time

    Role - GCP Technical Lead Location: Davidson, NC (Hybrid - 3 Days in a week) Yrs. of experience: 10+ Yrs. Mode of employment: Full-TimeJob Description: Skills: Google BigQuery, DataProc, Data fusion, Apache Airflow, Google Cloud Platform, Python, SQL, CI/CD pipelines Responsibilities: Support Data ingestion pipelines, data processing workflows, and data...

  • GCP Technical Lead

    3 weeks ago

    Davidson, United States Diverse Lynx Full time

    Role - GCP Technical Lead Location: Davidson, NC (Hybrid - 3 Days in a week) Yrs. of experience: 10+ Yrs. Mode of employment: Full-TimeJob Description: Skills: Google BigQuery, DataProc, Data fusion, Apache Airflow, Google Cloud Platform, Python, SQL, CI/CD pipelines Responsibilities: Support Data ingestion pipelines, data processing workflows, and data...

  • GCP Lead Consultant

    4 days ago

    Davidson, United States Diverse Lynx Full time

    Job Title: GCP Lead Consultant Location: Davidson at NC (Day 1 onsite) Duration: (Contract)Essential Responsibilities:Support Data ingestion pipelines, data processing workflows, and data storage solutions using GCP services such as Cloud Storage, Big Query, Dataflow, Composer etc. Work with other DEs to integrate data solutions into applications. Manage &...

  • GCP Technical Lead

    2 weeks ago

    Davidson, United States Diverse Lynx Full time

    Role - GCP Technical Lead Location: Davidson, NC (Hybrid - 3 Days in a week) Yrs. of experience: 10+ Yrs. Mode of employment: Full-TimeJob Description: Skills: Google BigQuery, DataProc, Data fusion, Apache Airflow, Google Cloud Platform, Python, SQL, CI/CD pipelines Responsibilities: Support Data ingestion pipelines, data processing workflows, and data...

  • GCP Technical Lead

    5 days ago

    Davidson, United States Diverse Lynx Full time

    Role - GCP Technical Lead Location: Davidson, NC (Hybrid - 3 Days in a week) Yrs. of experience: 10+ Yrs. Mode of employment: Full-TimeJob Description: Skills: Google BigQuery, DataProc, Data fusion, Apache Airflow, Google Cloud Platform, Python, SQL, CI/CD pipelines Responsibilities: Support Data ingestion pipelines, data processing workflows, and data...

  • GCP Technical Lead

    4 weeks ago

    Davidson, United States Tekshapers Inc Full time

    Job DescriptionJob DescriptionRole GCP Technical LeadLocation: Davidson, NC (Hybrid - 3 Days in a week)Yrs. of experience: 10+ Yrs.Mode of employment: Full-TimeJob Description: Skills: Google BigQuery, DataProc, Data fusion, Apache Airflow, Google Cloud Platform, Python, SQL, CI/CD pipelinesResponsibilities:Support Data ingestion pipelines, data processing...

  • GCP Lead Consultant

    1 month ago

    Davidson, United States Diverse Lynx Full time

    Job Title: GCP Lead Consultant Location: Davidson at NC (Day 1 onsite) Duration: (Contract)Essential Responsibilities: Support Data ingestion pipelines, data processing workflows, and data storage solutions using GCP services such as Cloud Storage, Big Query, Dataflow, Composer etc. Work with other DEs to integrate data solutions into applications. Manage &...

  • GCP Technical Lead

    3 weeks ago

    Davidson, United States Tekshapers Inc Full time

    Job DescriptionJob DescriptionRole GCP Technical LeadLocation: Davidson, NC (Hybrid - 3 Days in a week)Yrs. of experience: 10+ Yrs.Mode of employment: Full-TimeJob Description: Skills: Google BigQuery, DataProc, Data fusion, Apache Airflow, Google Cloud Platform, Python, SQL, CI/CD pipelinesResponsibilities:Support Data ingestion pipelines, data processing...

  • GCP Technical Lead

    3 weeks ago

    Davidson, United States Tekshapers Inc Full time

    Job DescriptionJob DescriptionRole GCP Technical LeadLocation: Davidson, NC (Hybrid - 3 Days in a week)Yrs. of experience: 10+ Yrs.Mode of employment: Full-TimeJob Description: Skills: Google BigQuery, DataProc, Data fusion, Apache Airflow, Google Cloud Platform, Python, SQL, CI/CD pipelinesResponsibilities:Support Data ingestion pipelines, data processing...

  • GCP Technical Lead

    4 weeks ago

    Davidson, NC, United States American CyberSystems, Inc. Full time

    Innova Solutions is immediately hiring a GCP Technical Lead Position type: Full Time. Duration: Full time Location: Davidson, NC (Hybrid - 3 Days in a week) As a GCP Technical Lead, you will: Responsibilities Job Description: Skills: Google BigQuery, DataProc, Data fusion, Apache Airflow, Google Cloud Platform, Python, SQL, CI/CD...

  • GCP Technical Lead

    4 weeks ago

    Davidson, NC, United States American CyberSystems, Inc. Full time

    Innova Solutions is immediately hiring a GCP Technical Lead Full Time. Duration: Full time Davidson, NC (Hybrid - 3 Days in a week) Skills: Google BigQuery, DataProc, Data fusion, Apache Airflow, Google Cloud Platform, Python, SQL, CI/CD pipelines Support Data ingestion pipelines, data processing workflows, and data storage solutions using GCP services...

  • GCP Tech Lead

    1 month ago

    Davidson, United States ApTask Full time

    About Client: Client is a company that helps other businesses with technology and consulting services. They offer various services like developing software, managing computer systems, and providing advice on how to improve business processes. Client works with different industries like healthcare, finance, retail, and more. They help these businesses by...

  • GCP Tech Lead

    4 weeks ago

    Davidson, United States ApTask Full time

    About Client: Client is a company that helps other businesses with technology and consulting services. They offer various services like developing software, managing computer systems, and providing advice on how to improve business processes. Client works with different industries like healthcare, finance, retail, and more. They help these businesses by...

  • GCP Tech Lead

    3 weeks ago

    Davidson, United States ApTask Full time

    About Client: Client is a company that helps other businesses with technology and consulting services. They offer various services like developing software, managing computer systems, and providing advice on how to improve business processes. Client works with different industries like healthcare, finance, retail, and more. They help these businesses by...