Senior Data Engineer

3 weeks ago

Sunnyvale, California, United States Saxon Global Full time
Data Engineer Role

Sam's Cash Core Team is seeking a skilled Data Engineer to enhance our analytics capabilities. The ideal candidate will design and implement efficient data pipelines, ensuring seamless data flow across teams.

Key Responsibilities
  • Create and maintain optimal data pipeline architecture for data-intensive applications.
  • Assemble large, complex data sets that meet functional/non-functional business requirements.
  • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
  • Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using Azure SQL, Cosmos DB, Databricks, and other legacy databases.
  • Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency, and other key business performance metrics.
  • Work with stakeholders, including the Executive, Product, Data, and Design teams, to assist with data-related technical issues and support their data infrastructure needs.
  • Keep our data separated and secure across national boundaries through multiple data centers and Azure regions.
  • Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.
  • Work with data and analytics experts to strive for greater functionality in our data systems.

Requirements
  • Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
  • Extensive experience on Databricks on Azure Cloud platform, deep understanding on Delta lake, Lake House Architecture.
  • Programming experience on Python, Shell scripting, PySpark, and other data programming languages.
  • Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
  • Strong analytic skills related to working with Data Visualization Dashboard, Metrics, and etc.
  • Build processes supporting data transformation, data structures, metadata, dependency, and workload management.
  • A successful history of manipulating, processing, and extracting value from large disconnected datasets.
  • Working knowledge of message queuing, stream processing, and highly scalable 'big data' data stores.
  • Familiar with Deployment tool like Docker and building CI/CD pipelines.
  • Experience supporting and working with cross-functional teams in a dynamic environment.
  • 8+ years' experience in software development, Data engineering, and
  • Bachelor's degree in computer science, Statistics, Informatics, Information Systems, or another quantitative field. Postgraduate/master's degree is preferred.
  • Experience in Machine Learning and Data Modeling is a plus.

Preferred Skills
  • High-level Databricks experience
  • Python, bash, or shell scripting
  • Experience architecting data pipelines and providing strategy/guidance on how to build from scratch
  • SQL queries and building dashboards and reports (Databricks visualization preferred but okay with Tableau or PowerBI)

Location
2 days/week on site in Sunnyvale, CA or San Bruno, CA

  • Data Engineer Senior

    4 weeks ago

    Sunnyvale, California, United States Lockheed Martin Corporation Full time

    Job Title: Data Engineer SeniorWe are seeking a highly skilled Data Engineer Senior to join our team at Lockheed Martin's Enterprise Business and Digital Transformation (EBDT) organization. As a Data Engineer Senior, you will play a critical role in supporting Data Engineering development efforts in the Missiles & Fire Control business area.The data platform...

  • Senior Data Engineer

    4 weeks ago

    Sunnyvale, California, United States Walmart Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at Walmart Global Tech. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data pipelines and architectures to support our business needs.Key Responsibilities:Design and implement data pipelines using Hadoop, Hive, Apache...

  • Senior Data Engineer

    3 weeks ago

    Sunnyvale, California, United States Inabia Software & Consulting Inc. Full time

    Job OverviewWe are seeking a highly skilled Senior Data Engineer to join our team at Inabia Software & Consulting Inc. The ideal candidate will have a strong background in designing and developing big data applications using the latest open source technologies.Key ResponsibilitiesDesign and develop big data applications using Hadoop, Spark, and other open...

  • Senior Data Engineer

    4 weeks ago

    Sunnyvale, California, United States Walmart Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at Walmart Global Tech. As a Senior Data Engineer, you will be responsible for designing, developing, and deploying large-scale data systems and architectures that support our business needs.Key Responsibilities:Design and develop data pipelines and architectures that meet...

  • Senior Data Engineer for Big Data Solutions

    4 weeks ago

    Sunnyvale, California, United States Walmart Full time

    About the JobWe are seeking a highly skilled Senior Data Engineer to join our team at Walmart. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems and pipelines that process and serve big data.Your primary focus will be on building and maintaining data pipelines that support our business...

  • Senior Data Center Engineer

    4 weeks ago

    Sunnyvale, California, United States LinkedIn Full time

    Job Title: Senior Data Center EngineerAt LinkedIn, we're committed to creating economic opportunities for every member of the global workforce. As a Senior Data Center Engineer, you'll play a critical role in designing, building, and maintaining our data centers, ensuring the stability, reliability, and security of our critical IT infrastructure.Key...

  • Senior Data Engineer

    4 weeks ago

    Sunnyvale, California, United States Walmart Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Walmart Global Tech. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data pipelines and systems to support our business needs.Key ResponsibilitiesDesign and implement data pipelines using various technologies such as Apache Spark,...

  • Senior Software Engineer

    3 weeks ago

    Sunnyvale, California, United States Walmart Full time

    About the RoleWalmart Global Tech is seeking a highly skilled Senior Software Engineer - Data Pipelines to join our team. As a key member of our Sponsored Search Data team, you will be responsible for designing, implementing, and maintaining data pipelines, databases, and ETL processes for Walmart's Sponsored Search Advertising platform.Key Responsibilities...

  • Senior Data Engineer with Cloud Expertise

    4 weeks ago

    Sunnyvale, California, United States InterSources Full time

    About the Role:We are seeking a highly skilled Senior Data Engineer with expertise in cloud technologies to join our team at InterSources Inc. As a Senior Data Engineer, you will be responsible for designing and developing big data applications using the latest open source technologies, including Apache Airflow, Apache Hive, and Apache Spark.Key...

  • Senior Software Engineer

    4 weeks ago

    Sunnyvale, California, United States Apple Full time

    Job DescriptionApple's Manufacturing Systems & Infrastructure (MSI) team is seeking a Senior Software Engineer to develop extraordinary products with a deep appreciation for user experience. As a key member of our team, you will be responsible for defining and developing ML Platform and frameworks for generative AI powered applications at Apple Product...

  • Senior Software Engineer

    3 weeks ago

    Sunnyvale, California, United States Walmart Full time

    Unlock the Power of Data at WalmartAre you a software engineering expert looking to leverage your skills in data pipelines and analytics to drive business growth? We're seeking a Senior Software Engineer - Data Pipelines and Analytics Lead to join our team at Walmart Global Tech.About the RoleAs a Senior Software Engineer - Data Pipelines and Analytics Lead,...

  • Senior Data Engineer

    4 weeks ago

    Sunnyvale, California, United States BayOne Solutions Full time

    We are seeking a highly skilled and motivated Data Systems Engineer to join our team at BayOne Solutions in Sunnyvale, CA (Hybrid). The ideal candidate will have a strong background in data engineering, cloud computing, and big data technologies.Key Responsibilities:Analyze competing requirements and articulate tradeoffs and lead discussions with business...

  • Senior Data Engineer

    4 weeks ago

    Sunnyvale, California, United States Big Cloud Full time

    Are you passionate about building cutting-edge computer vision platforms and shaping the film industry with 3D generative video tech?This innovative pre-seed startup is transforming video production using AI-driven virtual environments. Their dynamic team of 8 brings a wealth of experience from both large tech companies and startups alike.With $2.8M in...

  • Senior Data Architect

    4 weeks ago

    Sunnyvale, California, United States Walmart Global Tech Full time

    About the RoleWe're seeking a highly skilled Senior Data Engineer to join our team at Walmart Global Tech. As a key member of our data engineering team, you will be responsible for designing and implementing scalable data architectures, developing high-quality software solutions, and collaborating with cross-functional teams to drive business outcomes.Key...

  • Senior Data Center Engineer

    3 weeks ago

    Sunnyvale, California, United States LinkedIn Full time

    Data Center Engineer Job DescriptionAt LinkedIn, we're committed to creating economic opportunities for our members. As a Data Center Engineer, you'll play a critical role in designing, building, and maintaining our data centers, ensuring the stability, reliability, and security of our critical IT infrastructure.Key Responsibilities:Review new sites and site...

  • Senior Data Architect

    4 weeks ago

    Sunnyvale, California, United States Diverse Lynx Full time

    Data Processing and ManagementAs a Senior Data Architect at Diverse Lynx LLC, you will be responsible for designing and implementing data processing and management systems, with a focus on ETL and data discovery. You will work closely with the team to generate dashboards and ensure data security, governance, and high availability. Key competencies include...

  • Senior Snowflake Data Engineer with Python Expertise

    3 weeks ago

    Sunnyvale, California, United States Diverse Lynx Full time

    Job Summary: We are seeking a highly skilled Senior Snowflake Data Engineer with expertise in Python to lead our data architecture team. The ideal candidate will have a strong background in designing and implementing full-scale data warehouse solutions based on Snowflake, as well as experience in developing production-ready data ingestion and processing...

  • Senior Backend Engineer

    19 hours ago

    Sunnyvale, California, United States ApTask Full time

    About the RoleWe are seeking an experienced Senior Backend Engineer to join our team as a Data Pipeline Specialist. The ideal candidate will have a strong background in Python and data analysis, with experience in maintaining and upgrading complex data pipelines.The successful candidate will be responsible for understanding and improving our existing data...

  • Senior Software Development Engineer in Test

    3 weeks ago

    Sunnyvale, California, United States ASCENDING LLC Full time

    Job Title:Senior Software Development Engineer in Test - Data Out FunctionsLocation:RemoteProject Overview:At ASCENDING LLC, we are seeking a skilled Senior Software Development Engineer in Test to support the development teams responsible for Data Out functions. These functions provide essential data for dynamic reporting to external firms and internal...

  • Senior Data Engineer: Infrastructure Automation Expert

    4 weeks ago

    Sunnyvale, California, United States Akraya Full time

    Job Summary:Our client's Infrastructure Automation team is seeking a Senior Data Engineer to support our expanding data warehouse environment and contribute to the development of our infrastructure software.This role offers the opportunity to work on large-scale data projects and develop analytic technologies to provide structured data access.The ideal...