Senior Data Engineer

2 weeks ago

Sunnyvale, United States Saxon Global Full time

Sam's Cash Core Team is looking for a savvy Data Engineer to join our growing team of analytics experts. The role will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up. The Data Engineer will support our software developers, database architects, data analysts and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. They must be self-directed and comfortable supporting the data needs of multiple teams, systems and products. The right candidate will be excited by the prospect of optimizing or even re-designing our data architecture to support our next generation of products and data initiatives.

Responsibilities for Data Engineer

• Create and maintain optimal data pipeline architecture for data intensive applications.

• Assemble large, complex data sets that meet functional / non-functional business requirements.

• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.

• Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using Azure SQL, Cosmo DB, Databricks and other legacy databases.

• Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.

• Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.

• Keep our data separated and secure across national boundaries through multiple data centers and Azure regions.

• Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.

• Work with data and analytics experts to strive for greater functionality in our data systems.

Qualifications for Data Engineer

• Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.

• Extensive Experience on Databricks on Azure Cloud platform, deep understanding on Delta lake, Lake House Architecture.

• Programming experience on Python, Shell scripting, PySpark, and other data programming language.

• Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.

• Strong analytic skills related to working with Data Visualization Dashboard, Metrics and etc.

• Build processes supporting data transformation, data structures, metadata, dependency and workload management.

• A successful history of manipulating, processing and extracting value from large disconnected datasets.

• Working knowledge of message queuing, stream processing, and highly scalable 'big data' data stores.

• Familiar with Deployment tool like Docker and building CI/CD pipelines.

• Experience supporting and working with cross-functional teams in a dynamic environment.

• 8+ years' experience in software development, Data engineering, and

• Bachelor's degree in computer science, Statistics, Informatics, Information Systems or another quantitative field. Postgraduate/master's degree is preferred.

• Experience in Machine Learning and Data Modeling is a plus.

Required Skills : Tech stack requirements: • High level Databricks experience • Python, bash, or shell scripting • Experience architecting data pipelines and providing strategy/guidance on how to build from scratch • SQL queries and building dashboards and reports (Databricks visualization preferred but ok with Tableau or PowerBI) Location: 2 days/week on site in Sunnyvale, CA or San Bruno, CA
Basic Qualification :
Additional Skills :
Background Check :Yes
Drug Screen :Yes
Notes :
Selling points for candidate :
Project Verification Info :
Candidate must be your W2 Employee :Yes
Exclusive to Apex :Yes
Face to face interview required :No
Candidate must be local :No
Candidate must be authorized to work without sponsorship ::No
Interview times set : :No
Type of project :Development/Engineering
Master Job Title :Data Analyst
Branch Code :San Francisco

  • Senior Data Engineer

    4 days ago

    Sunnyvale, United States TWO95 International Full time

    Title: Senior Data Engineer Location: Sunnyvale, CA Position: 2 Month (Contract) Summary Provide business insights, while leveraging internal tools and systems, databases and industry data Roles & Responsibilities Ability to document requirements, data lineage, subject matter in both business and technical terminology. Guide and learn from...

  • Senior Data Engineer

    2 weeks ago

    Sunnyvale, United States TWO95 International Full time

    Title: Senior Data Engineer Location: Sunnyvale, CA Position: 2 Month (Contract) Summary Provide business insights, while leveraging internal tools and systems, databases and industry data Roles & Responsibilities Ability to document requirements, data lineage, subject matter in both business and technical terminology. Guide and learn from other team...

  • Senior Data Engineer

    2 weeks ago

    Sunnyvale, United States Illumio Full time

    On-site work model with 5 days in office/week in Sunnyvale, CA  Targeted hire date of February 1, 2024 About the Team: Illumio's new Machine Learning (ML) team embodies a culture of thought leadership, independence, and responsibility, holding a significant and highly visible role within our Engineering division. This dynamic team is tasked with developing...

  • Senior Data Engineer

    4 days ago

    Sunnyvale, California, United States Walmart Global Tech Full time

    What you'll do...As a Walmart Data Engineer, you will dig into our mammoth scale of data to help unleash the power of retail data science by imagining, developing, and maintaining data pipelines that our Data Scientists and Analysts can rely on. You will be responsible for contributing to an orchestration layer of complex data transformations, refining raw...

  • Senior GCP Data Engineer

    3 weeks ago

    Sunnyvale, United States Wilco Source Full time

    1. Bachelor's or Master's degree in Computer Science, Engineering, or related field.2. 10+ years of experience in data engineering, with a focus on GCP technologies.3. Strong proficiency in SQL, Scala, and Python for data manipulation and analysis.4. Hands-on experience with GCP services, including BigQuery, Cloud Storage, andDataflow.5. Solid understanding...

  • Senior GCP Data Engineer

    1 month ago

    Sunnyvale, United States Wilco Source Full time

    1. Bachelor's or Master's degree in Computer Science, Engineering, or related field.2. 10+ years of experience in data engineering, with a focus on GCP technologies.3. Strong proficiency in SQL, Scala, and Python for data manipulation and analysis.4. Hands-on experience with GCP services, including BigQuery, Cloud Storage, andDataflow.5. Solid understanding...

  • Senior GCP Data Engineer

    3 weeks ago

    Sunnyvale, United States Wilco Source Full time

    1. Bachelor's or Master's degree in Computer Science, Engineering, or related field.2. 10+ years of experience in data engineering, with a focus on GCP technologies.3. Strong proficiency in SQL, Scala, and Python for data manipulation and analysis.4. Hands-on experience with GCP services, including BigQuery, Cloud Storage, andDataflow.5. Solid understanding...

  • Senior GCP Data Engineer

    1 week ago

    Sunnyvale, United States Wilco Source Full time

    1. Bachelor's or Master's degree in Computer Science, Engineering, or related field.2. 10+ years of experience in data engineering, with a focus on GCP technologies.3. Strong proficiency in SQL, Scala, and Python for data manipulation and analysis.4. Hands-on experience with GCP services, including BigQuery, Cloud Storage, andDataflow.5. Solid understanding...

  • Senior GCP Data Engineer

    1 month ago

    Sunnyvale, United States Wilco Source Full time

    1. Bachelor's or Master's degree in Computer Science, Engineering, or related field.2. 10+ years of experience in data engineering, with a focus on GCP technologies.3. Strong proficiency in SQL, Scala, and Python for data manipulation and analysis.4. Hands-on experience with GCP services, including BigQuery, Cloud Storage, andDataflow.5. Solid understanding...

  • Senior GCP Data Engineer

    4 days ago

    Sunnyvale, United States Wilco Source Full time

    1. Bachelor's or Master's degree in Computer Science, Engineering, or related field. 2. 10+ years of experience in data engineering, with a focus on GCP technologies. 3. Strong proficiency in SQL, Scala, and Python for data manipulation and analysis. 4. Hands-on experience with GCP services, including BigQuery, Cloud Storage, and Dataflow. 5. Solid...

  • Senior Data Analyst

    2 days ago

    Sunnyvale, United States ID.me Full time

    Role Overview ID.me is a digital identity network with a mission to make the world a more trusted place by facilitating transparent and efficient interactions between people and organizations. We are looking for a Senior Data Analyst to join our growing data team and support our company-wide initiatives by quickly delivering insights, reviewing and...

  • Big Data Engineer

    2 weeks ago

    Sunnyvale, United States Artmac Soft LLC Full time

    Job DescriptionJob DescriptionWho we areArtmac Soft is a technology consulting and service-oriented IT company dedicated to providing innovative technology solutions and services to Customers.Job Description: Job Title : Big Data EngineerJob Type : W2 Experience : 5-15 Years Location : Sunnyvale, CaliforniaWe are looking for a Senior Data Engineer who will...

  • Senior Environmental Engineer

    3 weeks ago

    Sunnyvale, United States City of Sunnyvale, CA Full time

    ESSENTIAL JOB FUNCTIONS:(May include, but are not limited to, the following):Conducts a variety of studies and analyses of engineering projects or problems. Assists in the preparation Division's budget. Compiles engineering data, tabulates field data Environmental Engineer, Engineer, Environmental, Operations, Wastewater, Senior, Technology

  • Senior Business Data Architect

    1 day ago

    Sunnyvale, United States Red Oak Technologies Full time

    NOTE: If selected for this position, you are required to perform ALL work within a commutable distance of your assigned Worksite Location. Three days a week onsite, Tues, Wed, Thurs, with Monday and Friday being remote Red Oak Technologies is looking for a Senior Business Data Architect for our client located in Sunnyvale, CA or Austin, TX for a 6-month...

  • Senior Data Scientist, Region Flexibility

    4 weeks ago

    Sunnyvale, California, United States tapwage Full time

    The Region Flexibility Engineering (RFE) team builds and leverages foundational infrastructure capabilities, tools, and datasets needed to support the rapid global expansion of Amazon's SOA infrastructure. Our team focuses on robust and scalable architecture patterns and engineering best practices, driving adoption of ever-evolving and cutting-edge AWS...

  • Senior Data Scientist, Region Flexibility

    3 weeks ago

    Sunnyvale, California, United States tapwage Full time

    The Region Flexibility Engineering (RFE) team builds and leverages foundational infrastructure capabilities, tools, and datasets needed to support the rapid global expansion of Amazon's SOA infrastructure. Our team focuses on robust and scalable architecture patterns and engineering best practices, driving adoption of ever-evolving and cutting-edge AWS...

  • Data Engineer

    1 month ago

    Sunnyvale, United States Achmea Full time

    De afdeling Je bent werkzaam binnen het chapter Data Engineering & Science, onderdeel van de afdeling Customer Center of Data (ongeveer 40 collega’s). Het chapter bestaat uit 12 collega’s (data engineers en data scientists). De afdeling Customer Center of Data werkt primair voor het merk Zilveren Kruis, maar bedient ook de andere zorgmerken van Achmea:...

  • Data Engineer

    3 weeks ago

    Sunnyvale, United States Achmea Full time

    De afdeling Je bent werkzaam binnen het chapter Data Engineering & Science, onderdeel van de afdeling Customer Center of Data (ongeveer 40 collega’s). Het chapter bestaat uit 12 collega’s (data engineers en data scientists). De afdeling Customer Center of Data werkt primair voor het merk Zilveren Kruis, maar bedient ook de andere zorgmerken van Achmea:...

  • Senior Business Data Architect

    4 days ago

    Sunnyvale, United States Red Oak Technologies Full time

    “NOTE: If selected for this position, you are required to perform ALL work within a commutable distance of your assigned Worksite Location. Three days a week onsite, Tues, Wed, Thurs, with Monday and Friday being remote”Red Oak Technologies is looking for a Senior Business Data Architect for our client located in Sunnyvale, CA or Austin, TX for a 6-month...

  • Senior Business Data Architect

    4 days ago

    Sunnyvale, United States Red Oak Technologies Full time

    “NOTE: If selected for this position, you are required to perform ALL work within a commutable distance of your assigned Worksite Location. Three days a week onsite, Tues, Wed, Thurs, with Monday and Friday being remote”Red Oak Technologies is looking for a Senior Business Data Architect for our client located in Sunnyvale, CA or Austin, TX for a 6-month...