Senior Data Engineer

1 day ago


Sunnyvale, United States JobRialto Full time
Job Summary:

We are looking for a skilled data professional to join our team and work on data engineering and processing tasks. This role will focus on querying and managing large datasets, automating data workflows, and building data models to enhance our analytics capabilities. The ideal candidate will have a strong background in Python programming, SQL, and cloud platforms like GCP, with hands-on experience in ETL/ELT processes.

Key Responsibilities:
  • Data Management & Querying: Proficiency in SQL to manage and query large datasets for insights and reporting.
  • Data Processing & Automation: Utilize Python to process and automate data workflows, ensuring efficient data handling and transformation.
  • Big Data Technologies: Work with Pyspark to process large-scale datasets and enhance data pipeline performance.
  • Cloud Platform Integration: Leverage GCP services like BigQuery, Dataflow, Dataproc, Pub/Sub, and Cloud Storage for managing cloud-based data systems.
  • Data Modeling & Architecture: Design and model data structures to ensure efficient data storage and accessibility.
  • ETL/ELT Processes: Implement best practices in ETL/ELT processes to ensure seamless data integration, transformation, and loading into target systems.
  • Problem Solving: Tackle complex data challenges and deliver actionable solutions to improve data processing efficiency and effectiveness.
  • Collaboration: Work closely with business and technical teams to understand data requirements and ensure that technical solutions align with business goals.
  • Communication: Effectively communicate technical information to both technical and non-technical stakeholders.
Required Qualifications:

Technical Skills:
  • SQL: Proficient in querying and managing large datasets.
  • Python: Strong programming skills for data processing and automation tasks.
  • Pyspark: Experience in working with Pyspark to process large data sets efficiently.
  • Cloud Platforms: Experience with GCP services (BigQuery, Dataflow, Dataproc, Pub/Sub, Cloud Storage).
  • Data Modeling: Expertise in data modeling and designing data architectures for large-scale systems.
  • ETL/ELT: In-depth knowledge of ETL/ELT processes and best practices.
  • Problem-Solving Skills: Proven ability to tackle complex data-related problems and implement effective solutions.
  • Communication: Strong verbal and written communication skills with the ability to explain technical concepts to non-technical audiences.


Preferred Qualifications (if any):

Experience with other cloud platforms like Azure is a plus.

Familiarity with data visualization tools (e.g., Looker, Power BI) is advantageous.

Certifications (if any):

Relevant certifications in Data Engineering, Cloud Platforms, or Big Data technologies are a plus (e.g., Google Cloud Professional Data Engineer or AWS Certified Big Data - Specialty).

Education: Bachelors Degree
  • Senior Data Engineer

    6 months ago


    Sunnyvale, United States TWO95 International Full time

    Title: Senior Data Engineer Location: Sunnyvale, CA Position: 2 Month (Contract) Summary Provide business insights, while leveraging internal tools and systems, databases and industry data Roles & Responsibilities Ability to document requirements, data lineage, subject matter in both business and technical terminology. Guide and learn from other team...


  • Sunnyvale, United States Inficare Full time

    Job Title: Senior Data Engineer Location: Sunnyvale, CA (Day 1 Onsite) Duration: 12-Month Contract Job Description: seeking a highly skilled and collaborative Senior Data Engineer to design and develop big data applications using the latest open-source technologies. The ideal candidate will have a proven track record in building data pipelines, working with...


  • Sunnyvale, California, United States LinkedIn Full time

    OverviewData center engineering is a critical field that involves the design, construction, and maintenance of data centers. As a Senior Data Center Infrastructure Engineer at LinkedIn, you will play a vital role in ensuring the stability, reliability, and security of our data center infrastructure.Job DescriptionThis role will be based in Manassas, VA, and...

  • Senior Data Engineer

    6 months ago


    Sunnyvale, United States Saxon Global Full time

    Sam's Cash Core Team is looking for a savvy Data Engineer to join our growing team of analytics experts. The role will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. The ideal candidate is an experienced data pipeline builder and data wrangler who...


  • Sunnyvale, United States A CUBED Full time

    WAYFINDER Our Wayfinder team is building scalable, certifiable autonomy systems to power the next generation of commercial aircraft. Our team of experts is driving the maturation of machine learning and other core technologies for autonomous flight; we are creating a reference architecture that includes hardware, software, and a data-driven development...


  • Sunnyvale, California, United States Walmart Full time

    Unlock the Power of Data at WalmartAre you a software engineering expert looking to leverage your skills in data pipelines and analytics to drive business growth? We're seeking a Senior Software Engineer - Data Pipelines and Analytics Lead to join our team at Walmart Global Tech.About the RoleAs a Senior Software Engineer - Data Pipelines and Analytics Lead,...

  • Senior Data Engineer

    1 month ago


    Sunnyvale, United States Big Cloud Full time

    Do you want to build a cutting-edge computer vision platform at an innovative pre-seed startup? Are you passionate about shaping the film industry with 3D generative video tech?Is this the type of standout role you've been looking for? This startup are transforming video production using AI-driven virtual environments. Their small but dynamic team of 8...

  • Senior Data Engineer

    4 weeks ago


    sunnyvale, United States Big Cloud Full time

    Would you like to shape a computer vision platform at an exciting start-up?Are you interested in a cross-functional team working across AI and 3D generative video?This start-up is revolutionizing video through AI-powered virtual environments. The team are architecting early-stage cutting-edge generative computer vision technology for iOS and web platforms...

  • Senior Data Engineer

    4 weeks ago


    sunnyvale, United States Big Cloud Full time

    Would you like to shape a computer vision platform at an exciting start-up?Are you interested in a cross-functional team working across AI and 3D generative video?This start-up is revolutionizing video through AI-powered virtual environments. The team are architecting early-stage cutting-edge generative computer vision technology for iOS and web platforms...

  • Senior Data Engineer

    1 month ago


    Sunnyvale, United States Big Cloud Full time

    Would you like to shape a computer vision platform at an exciting start-up?Are you interested in a cross-functional team working across AI and 3D generative video?This start-up is revolutionizing video through AI-powered virtual environments. The team are architecting early-stage cutting-edge generative computer vision technology for iOS and web platforms...

  • GCP Data Engineer

    1 day ago


    Sunnyvale, United States Maintec Technologies Full time

    Senior DataEngineer JD Rate:- $65 UST GLOBAL H1-b,USC,GC H4 12Yrs exp needed Proven experience as a data engineer, with at least 5 years of experience in a similar role. Design, implement, and optimize data pipelines using Spark with Scala, Airflow, and other relevant technologies. Work with GCP services, including Google Cloud Storage (GCS), BigQuery...


  • Sunnyvale, California, United States ApTask Full time

    About the RoleWe are seeking an experienced Senior Backend Engineer to join our team as a Data Pipeline Specialist. The ideal candidate will have a strong background in Python and data analysis, with experience in maintaining and upgrading complex data pipelines.The successful candidate will be responsible for understanding and improving our existing data...

  • Senior Data Engineer

    2 months ago


    sunnyvale, United States Walmart Global Tech Full time

    Data Ventures exists to unlock the full value of Walmart’s data by developing and productizing B2B data initiatives that empower merchants and suppliers to make better, faster decisions for the business. As part of this transformation, we’re seeking entrepreneurial individuals to help drive data productization from concept to deployment.What you'll...

  • Senior Data Engineer

    1 month ago


    sunnyvale, United States Walmart Global Tech Full time

    Data Ventures exists to unlock the full value of Walmart’s data by developing and productizing B2B data initiatives that empower merchants and suppliers to make better, faster decisions for the business. As part of this transformation, we’re seeking entrepreneurial individuals to help drive data productization from concept to deployment.What you'll...

  • Senior Data Engineer

    2 months ago


    Sunnyvale, United States Walmart Global Tech Full time

    Data Ventures exists to unlock the full value of Walmart’s data by developing and productizing B2B data initiatives that empower merchants and suppliers to make better, faster decisions for the business. As part of this transformation, we’re seeking entrepreneurial individuals to help drive data productization from concept to deployment.What you'll...


  • Sunnyvale, United States Apple Full time

    Senior Database Engineer, IS Data Services Sunnyvale, California, United States Software and Services Apple is where individual imaginations gather together, committing to the values that lead to great work. Every new product we build, service we create, or Apple Store experience we deliver is the result of us making each other’s ideas stronger. It’s the...

  • Senior Data Scientist

    3 weeks ago


    Sunnyvale, United States LanceSoft Full time

    Position Title Senior Data Scientist/ Business Analyst-III Location Sunnyvale, CA - Remote Role Duration 3+ months (possibilities of extension) Pay Rate $85 to $88/hr. on W2Description We are looking for a Senior Data Scientist who will work as a "floater" for the analytics team, moving from team to team, focusing on the highest priority projects. Some...

  • GCP Data Engineer

    1 week ago


    Sunnyvale, United States Droisys Full time

    About Company,Droisys is an innovation technology company focused on helping companies accelerate their digital initiatives from strategy and planning through execution. We leverage deep technical expertise, Agile methodologies, and data-driven intelligence to modernize systems of engagement and simplify human/tech interaction.Amazing things happen when we...

  • Senior Data Scientist

    3 weeks ago


    Sunnyvale, United States Walmart Full time

    What you'll do... Position: Senior Data Scientist Job Location: 640 W. California Avenue, Sunnyvale, CA 94086 Duties: Support the priority order of requirements and service level agreements. Help identify the most suitable source for data that is fit for purpose. Perform initial data quality checks on extracted data. Understand, articulate, and apply...


  • Sunnyvale, United States Apple Inc. Full time

    Apple is where exceptional people gather to create groundbreaking products. If you’re driven by the opportunity to make an impact and passionate about advancing technology, a career with Apple may be your ideal path. Here, we combine cutting-edge software engineering with the power of machine learning to build systems that shape the future. We're seeking a...