GCP Sr. Data Lead

3 days ago

San Jose, CA, United States E-Solutions Full time
Title: GCP Data Engineer

Location: San Jose, CA

Duration: 12+ Month

Job Description

We are seeking a highly skilled and experienced Data Engineer with a strong background in AI/ML to design, build, and optimize robust data pipelines and infrastructure on the Google Cloud Platform (GCP). The ideal candidate will be passionate about leveraging data to power machine learning initiatives, ensuring data quality, accessibility, and scalability for advanced analytics and AI applications.

MINIMUM 10 YEARS OF EXPERIENCE

Responsibilities:
Data Pipeline Development: Design, build, and maintain scalable, efficient, and reliable ETL/ELT data pipelines for batch and real-time processing using GCP services (e.g., Dataflow, Dataproc, Cloud Composer, Pub/Sub).
AI/ML Data Preparation: Collaborate closely with Data Scientists and Machine Learning Engineers to understand data requirements for model training, evaluation, and serving. Prepare, transform, and curate large, diverse datasets (structured, unstructured, streaming) to optimize them for AI/ML workloads.
GCP Ecosystem Expertise: Leverage a wide range of GCP data and AI/ML services, including:
Data Warehousing & Storage: BigQuery (for analytics and BigQuery ML), Cloud Storage, Cloud SQL, Cloud Bigtable.
Data Processing: Dataflow, Dataproc (Spark, Hadoop), Cloud Composer (Apache Airflow), Data Fusion.
AI/ML Services: Vertex AI (for model training, deployment, MLOps, Pipelines, Workbench, AutoML), AI Platform, TensorFlow Enterprise, Keras, PyTorch.
Data Governance & Quality: Implement and enforce data quality, security, and governance standards throughout the data lifecycle, ensuring data accuracy, consistency, and compliance with regulations.
Performance Optimization: Monitor, troubleshoot, and optimize the performance and cost-effectiveness of data pipelines and AI/ML infrastructure.
Automation & MLOps: Automate data processes, develop CI/CD pipelines for data and ML models, and contribute to MLOps best practices for seamless deployment and monitoring of AI/ML solutions.
Collaboration & Communication: Work effectively with cross-functional teams, including Data Scientists, Analysts, Software Engineers, and Product Managers, to understand data needs and deliver impactful solutions.
Innovation & Research: Stay up-to-date with the latest advancements in data engineering, AI/ML, and GCP technologies, continuously exploring and recommending new tools and approaches.

Qualifications:
Bachelor's or Master's degree in Computer Science, Data Engineering, or a related quantitative field.

Proven experience as a Data Engineer, with a strong focus on building data solutions for AI/ML applications.

In-depth knowledge and hands-on experience with Google Cloud Platform (GCP) data services (BigQuery, Dataflow, Dataproc, Cloud Storage, Cloud Composer, etc.).

Strong proficiency in programming languages such as Python (essential), and experience with Scala or Java is a plus.
Expertise in SQL and experience with various database technologies (relational, NoSQL, data warehouses).
Familiarity with machine learning concepts, algorithms, and workflows (e.g., feature engineering, model training, evaluation, deployment).
Experience with machine learning frameworks like TensorFlow or PyTorch.
Understanding of distributed systems, big data technologies, and real-time data processing.
Experience with version control systems (e.g., Git) and CI/CD practices.
Excellent problem-solving, analytical, and communication skills.
Google Cloud Professional Data Engineer certification is a strong plus.

  • Technical Lead

    5 days ago

    San Jose, CA, United States Tekfortune Inc Full time

    Tekfortune is a fast-growing consulting firm specialized in permanent, contract & project-based staffing services for world's leading organizations in a broad range of industries. In this quickly changing economic landscape, virtual recruiting and remote work are critical for the future of work. To support the active project demands and skills gaps, our...

  • Technical Lead

    3 days ago

    San Jose, CA, United States Tekfortune Inc Full time

    Tekfortune is a fast-growing consulting firm specialized in permanent, contract & project-based staffing services for world's leading organizations in a broad range of industries. In this quickly changing economic landscape, virtual recruiting and remote work are critical for the future of work. To support the active project demands and skills gaps, our...

  • Technical Lead

    1 week ago

    San Jose, CA, United States Tekfortune Inc Full time

    Tekfortune is a fast-growing consulting firm specialized in permanent, contract & project-based staffing services for world's leading organizations in a broad range of industries. In this quickly changing economic landscape, virtual recruiting and remote work are critical for the future of work. To support the active project demands and skills gaps, our...

  • GCP Data Engineer

    6 days ago

    San Jose, CA, United States Cynet Systems Full time

    Job Description: Pay Range: $55hr - $60hr Require 5-7 + years of experience Data Engineers GCP Strong knowledge in writing and interpreting complex SQL queries Experience in GCP is plusStrong ability to design, develop, test and maintain ETL solution in Google Cloud Platform especially in BigQueyExperience in discovering the raw information from...

  • GCP Data Engineer

    2 days ago

    San Jose, CA, United States Cynet Systems Full time

    Job Description: Pay Range: $55hr - $60hr Require 5-7 + years of experience Data Engineers GCP Strong knowledge in writing and interpreting complex SQL queries Experience in GCP is plusStrong ability to design, develop, test and maintain ETL solution in Google Cloud Platform especially in BigQueyExperience in discovering the raw information from...

  • GCP Data Engineer

    1 hour ago

    San Jose, CA, United States Cynet Systems Full time

    Job Description: Pay Range: $55hr - $60hr Require 5-7 + years of experience Data Engineers GCP Strong knowledge in writing and interpreting complex SQL queries Experience in GCP is plusStrong ability to design, develop, test and maintain ETL solution in Google Cloud Platform especially in BigQueyExperience in discovering the raw information from...

  • Sr Data Scientist with Strong Python

    7 days ago

    San Jose, CA, United States Sparktek Full time

    Role: Sr Data Scientist with Strong Python Location: Seattle/Dallas/Kansas preferred [Remote also considered] JD: Bachelor's or Master's degree in Computer Science, Data Science, AI, or a related field. 5-10 years of professional experience in Python, NLP, AI, or Data Science roles. Hands on experience in Python 3 Libraries, UI frameworks, PHP, HTML5, AJAX,...

  • Sr Data Scientist with Strong Python

    3 days ago

    San Jose, CA, United States Sparktek Full time

    Role: Sr Data Scientist with Strong Python Location: Seattle/Dallas/Kansas preferred [Remote also considered] JD: Bachelor's or Master's degree in Computer Science, Data Science, AI, or a related field. 5-10 years of professional experience in Python, NLP, AI, or Data Science roles. Hands on experience in Python 3 Libraries, UI frameworks, PHP, HTML5, AJAX,...

  • Sr Data Scientist with Strong Python

    1 week ago

    San Jose, CA, United States Sparktek Full time

    Role: Sr Data Scientist with Strong Python Location: Seattle/Dallas/Kansas preferred [Remote also considered] JD: Bachelor's or Master's degree in Computer Science, Data Science, AI, or a related field. 5-10 years of professional experience in Python, NLP, AI, or Data Science roles. Hands on experience in Python 3 Libraries, UI frameworks, PHP, HTML5, AJAX,...

  • Sr Data Scientist with Strong Python

    1 week ago

    San Jose, CA, United States Sparktek Full time

    Role: Sr Data Scientist with Strong Python Location: Seattle/Dallas/Kansas preferred [Remote also considered] JD: Bachelor's or Master's degree in Computer Science, Data Science, AI, or a related field. 5-10 years of professional experience in Python, NLP, AI, or Data Science roles. Hands on experience in Python 3 Libraries, UI frameworks, PHP, HTML5, AJAX,...