Sr. Data Engineer

4 days ago


Mountain View, United States Cypress HCM Full time
Job DescriptionJob Description
Sr. Data Engineer Overview:
  • We are looking for an experienced Data Engineer to support the Marketing Solutions (LMS) execution of complex data development and database efficiency, with a deep focus on improving the data quality, accuracy and timeliness for marketing related products.
  • This role will interact directly with Engineering teams to optimize data operations for product metrics to surface insights at terabyte scale, globally. As our data and business needs increase, we continue to iterate and evolve our processes, best-practice documentation, and deep-dive retrospectives to inform our go/no go decision making. Ultimately to be successful, the individual should feel comfortable advising a team of data professionals, navigating our tech stack, and recommending solutions to complex data problems.
  • Our team is highly collaborative, open and honest, and brings a low-ego, high impact mindset to work
  • Location –SF Bay Area or Remote
Responsibilities:
  • Design, develop, and manage data pipelines and workflows to enable efficient and accurate data processing using Trino SQL/Spark SQL warehoused in HDFS datasets.
  • Effectively performs code designs and reviews/approves test cases.
  • Implement data quality checks and audits to maintain high data accuracy and integrity.
  • Produces elegant and efficient designs, high performance, and scalable code that allows for easy extension to future needs.
  • Collaborate with cross-functional teams, especially data engineering, to understand data requirements and implement robust data solutions.
  • Work closely with data domain experts to gather data requirements, translate business needs into technical specifications, and communicate data insights effectively for sales representative workflow efficiency.
  • Optimize data storage for performance and scalability, ensuring efficient data Extraction, Transformation and Load (ETL).
  • Develop and maintain documentation related to data pipelines, QA, metrics, and data policy as it relates to best practice, compliance and GDPR.
  • Stay up to date with industry best practices and emerging trends in data engineering and analytics, including Generative AI as it impacts our data operations.
Basic Qualifications:
  • 2+ years in using SQL and experience optimizing SQL databases for performance (Trino SQL, or Spark).
  • Demonstrated experience in managing data pipelines (like HDFS), data repository (like GitHub), workflows (like Apache Airflow), and ETL (best practice coding).
  • Ability to communicate complex technical concepts to both technical and non-technical individuals.
  • Experience working with multiple stakeholders, setting project priorities and delivering on Objectives and Key Results (OKRs).
  • Experience automating script changes in Python
Preferred Qualifications:
  • BA/BS in engineering, computer science, or related technical field (such as statistics, or data science).
  • Excellent analytical skills, designing data workflows and analyzing data for anomalies, or setting data quality thresholds via automated solutions.
  • Familiarity with data governance principles
  • Program Manager experience
  • Demonstrated experience in managing data pipelines in HDFS
  • Experience running a scrum team and using Jira.
  • Spark SQL
Suggested Skills:
  • Data Analysis
  • Project Management
  • Data Engineering
Compensation:
  • $82.50 - $115.38/hour (W2/Non-Exempt)
  • Rate Dependent on Location***
Req# 14806/14807

  • Mountain View, California, United States Cypress HCM Full time

    Job OverviewSr. Data Engineer is needed to support the Marketing Solutions (LMS) execution of complex data development and database efficiency, with a focus on improving data quality, accuracy, and timeliness for marketing related products.The role will interact directly with engineering teams to optimize data operations for product metrics to surface...

  • Sr. Data Scientist

    1 week ago


    Mountain View, United States Nuro Full time

    Who We Are Nuro exists to better everyday life through robotics. Founded in 2016, Nuro has spent eight years developing autonomous driving (AD) technology and commercializing AD applications. The Nuro Driver is our world-class autonomous driving system that combines AD hardware with our generalized AI-first self-driving software. Built to learn and improve...

  • Sr. Data Scientist

    3 days ago


    Mountain View, United States Nuro Full time

    Who We Are Nuro exists to better everyday life through robotics. Founded in 2016, Nuro has spent eight years developing autonomous driving (AD) technology and commercializing AD applications. The Nuro Driver is our world-class autonomous driving system that combines AD hardware with our generalized AI-first self-driving software. Built to learn and improve...


  • Mountain View, United States Databricks Full time

    RDQ126R97Job Description Databricks is looking for a Senior Manager, Product Data Science to grow the product data science team and lead the development of Data and AI products. You will lead a team of data scientists and work directly in partnership with product managers and engineering leaders to empower them with data-driven insights and solutions. You,...


  • Mountain View, United States Reliable Robotics Full time

    We're building safety-enhancing technology for aviation that will save lives. Automated aviation systems will enable a future where air transportation is safer, more convenient and fundamentally transformative to the way goods — and eventually people — move around the planet. We are a team of mission-driven engineers with experience across aerospace,...


  • Mountain View, United States Treasure Data Full time

    Job DescriptionJob DescriptionSalary: $235,000 - $265,000Treasure Data:At Treasure Data, were on a mission to radically simplify how companies use data to create connected customer experiences. Our sophisticated cloud-based customer data platform drives operational efficiency across the enterprise to deliver powerful business outcomes in a way thats safe,...


  • Mountain View, United States Arm Treasure Data Full time

    Treasure Data: At Treasure Data, we’re on a mission to radically simplify how companies use data to create connected customer experiences. Our sophisticated cloud-based customer data platform drives operational efficiency across the enterprise to deliver powerful business outcomes in a way that’s safe, flexible, and secure. We are thrilled that Gartner...


  • Mountain View, United States Reliable Robotics Full time

    Mountain View, CAMechanical Engineering /Full Time /On-siteWe're building safety-enhancing technology for aviation that will save lives. Automated aviation systems will enable a future where air transportation is safer, more convenient and fundamentally transformative to the way goods — and eventually people — move around the planet. We are a team of...


  • Mountain View, United States Reliable Robotics Full time

    Mountain View, CAVehicle Design and Integration /Full Time /On-siteWe're building safety-enhancing technology for aviation that will save lives. Automated aviation systems will enable a future where air transportation is safer, more convenient and fundamentally transformative to the way goods — and eventually people — move around the planet. We are a...


  • Mountain View, United States Data Masked Full time

    Join to apply for the Senior Data Scientist role at Waymo.Waymo is an autonomous driving technology company with the mission to be the most trusted driver. Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on building the Waymo Driver—The World's Most Experienced Driver—to improve access to mobility while saving thousands...


  • Mountain View, United States Capgemini Full time

    Job description: ● Frameworks: Hibernate, Microservices, Web Services ● Databases: SQL, PL/SQL, Redis, Memcache, Cloud Spanner, Google BigQuery, ● Cloud Technologies: Google Cloud, gRPC, Protobuf ● Development Tools: GitHub, Jira, Airflow, Splunk KEY RESPONSIBILITIES: ● Frameworks: Hibernate, Microservices, Web Services ● Databases: SQL, PL/SQL,...


  • Mountain View, California, United States Yellowbrick Data Full time

    Data Engineer Job Description


  • Mountain View, United States Qualified Technical Services Full time

    Work Location: NASA Ames Research Center - Mountain View, CA Minimum Citizenship: U.S. Citizen (This position requires access to ITAR and/or EAR protected data) Clearance: US Government  JOB DESCRIPTION - Sr Software Architecture Engineer - Edge and Cloud Autonomous Vehicles   We are at the cusp of an aviation revolution whereby flying...


  • Mountain View, United States Reliable Robotics Full time

    Mountain View, CAFlight Test and Integration /Full Time /On-siteWe're building safety-enhancing technology for aviation that will save lives. Automated aviation systems will enable a future where air transportation is safer, more convenient and fundamentally transformative to the way goods — and eventually people — move around the planet. We are a team...


  • Mountain View, United States Reliable Robotics Corporation Full time

    We're building safety-enhancing technology for aviation that will save lives. Automated aviation systems will enable a future where air transportation is safer, more convenient and fundamentally transformative to the way goods - and eventually people - move around the planet. We are a team of mission-driven engineers with experience across aerospace,...


  • Mountain View, California, United States ZipRecruiter Full time

    About the Role: We're seeking a seasoned Data Infrastructure Engineer to lead our data engineering teams and drive the development of our data insights product. This position involves providing technical vision and oversight for a team of data engineers, ensuring they make the best technical decisions for the data platform and stakeholders. As a...


  • Mountain View, United States Yellowbrick Data Full time

    Yellowbrick Data is a Silicon Valley based startup that invented a Kubernetes based cloud-native data platform for the hybrid multi-cloud world. Yellowbrick's innovative platform can run in customer's cloud accounts or on-premises private clouds, offering flexibility while ensuring data residency, localization, and sovereignty, all with significant...

  • Data Engineer

    4 days ago


    Mountain View, United States Kumo Full time

    Come and change the world of AI with the Kumo team! Companies spend millions of dollars to store terabytes of data in data lakehouses, but only leverage a fraction of it for predictive tasks. This is because traditional machine learning is slow and time consuming, taking months to perform feature engineering, build training pipelines, and achieve acceptable...


  • Mountain View, California, United States Nuro Full time

    Nuro is a leader in autonomous driving technology, and we're seeking a talented system engineer to join our team. As a senior software engineer on our data platform, you will play a crucial role in the advancement of our autonomous driving systems by creating scalable and reliable data infrastructure.About the RoleWe take a machine-learning-first approach to...


  • Mountain View, United States Red Oak Technologies Full time

    Data Platform EngineerMountain View, CA, Hybrid - 3 days a week (Flexible days/hours)Job SummaryWe are looking for a junior to mid level backend engineer who loves to build cloud services — a systems engineer who is comfortable in every stage of the design, implementation, testing, and deployment process. In particular, we are hiring an engineer who can...