Senior Data Engineer

4 days ago

Pleasanton, CA, United States Right Skale, Inc. Full time
Senior Data Engineer (AI/ML, Cloud) - Full Time - Bay Area, CA

We are seeking a Senior Data Engineer to design and implement AI/ML-driven data solutions for enterprise cloud environments. You'll leverage modern data engineering, data warehousing, and data lake technologies on platforms like AWS, Azure, and GCP to optimize multi-cloud data workflows in a fast-paced, innovative setting.

Responsibilities
  • Design and develop data pipelines, data lakes, and data warehouses using cloud platforms (AWS, Azure, GCP, Databricks) with a preference for Azure expertise.
  • Experience with SQL, schema design, and dimensional data modeling to build scalable data solutions.
  • Implement ETL/ELT processes using tools like Azure Data Factory (ADF), Informatica, Talend, and data warehousing technologies (Azure Synapse, Amazon Redshift, Snowflake, Google BigQuery).
  • Utilize big data tools (Databricks, Spark) and programming skills in PySpark and Spark SQL to support AI/ML-driven data analytics.
  • Collaborate with cross-functional teams to ensure data warehouse best practices, development standards, and methodologies are met.
Required Skills
  • Minimum 5 years in modern data engineering, data warehousing, or data lake technologies on cloud platforms (AWS, Azure, GCP, Databricks)
  • 10+ years with SQL, schema design, and dimensional data modeling.
  • Bachelor's degree in Computer Science, Engineering, or related field (or equivalent experience).
  • Hands-on experience with Azure (preferred), AWS, GCP, and Databricks for data solutions.
  • Proficiency with ADF, Informatica, Talend, and technologies like Azure Synapse, Amazon Redshift, Snowflake, or Google Big Query.
  • Strong experience with Databricks, Spark, PySpark, and Spark SQL for big data processing.
  • Solid knowledge of data warehouse best practices, development standards, and Agile methodologies.
  • Excellent communication, teamwork, and self-learning abilities in a fast-paced environment.
Preferred Skills
  • Knowledge of Event Hub, IoT Hub, Azure Stream Analytics, Azure Analysis Services, or Cosmos DB for advanced data streaming and storage.
  • Experience with SAP ECC, S/4, or Hana for enterprise data integration.
  • Intermediate proficiency in data visualization tools (e.g., Power BI) for actionable insights.
  • Expertise in Azure DevOps, CI/CD deployments, and cloud migration methodologies.
  • Proven track record of delivering scalable, AI/ML-enhanced data solutions in IT services environments.

  • Senior Data Engineer

    2 weeks ago

    Pleasanton, CA, United States Concord IT Systems Full time

    Title: Senior Data Engineer Location: Pleasanton, California (hybrid work) Rate : $80/Hr on W2 Client : Critical River | Meeru AI Role Overview: As a Senior/Lead Data Engineer, you will lead the design, development, and ownership of core data infrastructure-from pipelines to storage to data products. You'll be a strategic partner across teams, ensuring that...

  • Senior Data Engineer

    1 week ago

    Pleasanton, CA, United States Concord IT Systems Full time

    Title: Senior Data Engineer Location: Pleasanton, California (hybrid work) Rate : $80/Hr on W2 Client : Critical River | Meeru AI Role Overview: As a Senior/Lead Data Engineer, you will lead the design, development, and ownership of core data infrastructure-from pipelines to storage to data products. You'll be a strategic partner across teams, ensuring that...

  • DATA ENGINEER

    6 days ago

    Pleasanton, CA, United States Purple Drive Full time

    Job Summary: The Senior Data Engineer will be responsible for designing, building, and maintaining robust data pipelines and architectures on AWS to support scalable data processing, storage, and analytics. The ideal candidate will possess deep expertise in AWS services, PySpark, and data modeling, with proven experience in developing data-driven solutions...

  • Data Engineer

    7 days ago

    Pleasanton, CA, United States Apex Informatics Full time

    Bachelor's degree or equivalent experience in computer science, applied math, physics, engineering, statistics, economics or related field. 3+ years of industry experience in Data Engineering 3+ years of work experience including hands-on technical experience with SQL, Python, PySpark, Jupyter Notebook, database design, and ETL processes The ideal candidate...

  • Data Engineer

    5 days ago

    Pleasanton, CA, United States Apex Informatics Full time

    Bachelor's degree or equivalent experience in computer science, applied math, physics, engineering, statistics, economics or related field. 3+ years of industry experience in Data Engineering 3+ years of work experience including hands-on technical experience with SQL, Python, PySpark, Jupyter Notebook, database design, and ETL processes The ideal candidate...

  • Data Engineer

    2 weeks ago

    Pleasanton, CA, United States CData Software Full time

    BA Rate:$ 57/hr. Day 1 Onsite (Hybrid) and Location we can consider /Pleasanton. Job Title Data Engineer Relevant Experience (in Yrs) 8+ Yrs Technical/Functional Skills Snowflakes, Azure /SQL/ETL /ADF pipelines/GCP/BQ Experience Required 8+ Yrs Roles & Responsibilities Domain expertise - 5+ years proven experience in developing and deploying data...

  • Senior Software Engineer

    5 days ago

    Pleasanton, CA, United States Right Skale, Inc. Full time

    Senior Software Engineer - Contract - Onsite (Bay Area) As a Senior Software Development Engineer, you will be collaborating with engineers and QA to design, build, and test backend APIs. This is an Onsite role in Pleasanton, CA. You'll be going on site 3-4 days/week. Qualifications: BS and/or master's in computer science, Engineering, or related field...

  • Senior Software Engineer

    7 days ago

    Pleasanton, CA, United States Right Skale, Inc. Full time

    Senior Software Engineer - Contract - Onsite (Bay Area) As a Senior Software Development Engineer, you will be collaborating with engineers and QA to design, build, and test backend APIs. This is an Onsite role in Pleasanton, CA. You'll be going on site 3-4 days/week. Qualifications: BS and/or master's in computer science, Engineering, or related field...

  • Senior Software Engineer

    11 hours ago

    Pleasanton, CA, United States Right Skale, Inc. Full time

    Senior Software Engineer - Contract - Onsite (Bay Area) As a Senior Software Development Engineer, you will be collaborating with engineers and QA to design, build, and test backend APIs. This is an Onsite role in Pleasanton, CA. You'll be going on site 3-4 days/week. Qualifications: BS and/or master's in computer science, Engineering, or related field...

  • Senior Systems Engineer

    2 weeks ago

    Pleasanton, CA, United States Blue Star Partners, LLC Full time

    Job Title: Sr. Systems Engineer Location: Pleasanton, CA – 100% onsite – Local candidates only Period: 11/25/2024 to 11/28/2025 –  Strong potential for extension/direct hire Hours/Week: 40 hours – Hours over 40 will be paid at Time and a Half Rate: $73 - $77/hr Contract Type: W-2 only Scope of Services: The Senior Systems Engineer (Contract)...