Senior Data Engineer
6 months ago
Sam's Cash Core Team is looking for a savvy Data Engineer to join our growing team of analytics experts. The role will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up. The Data Engineer will support our software developers, database architects, data analysts and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. They must be self-directed and comfortable supporting the data needs of multiple teams, systems and products. The right candidate will be excited by the prospect of optimizing or even re-designing our data architecture to support our next generation of products and data initiatives.
Responsibilities for Data Engineer
• Create and maintain optimal data pipeline architecture for data intensive applications.
• Assemble large, complex data sets that meet functional / non-functional business requirements.
• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
• Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using Azure SQL, Cosmo DB, Databricks and other legacy databases.
• Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.
• Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.
• Keep our data separated and secure across national boundaries through multiple data centers and Azure regions.
• Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.
• Work with data and analytics experts to strive for greater functionality in our data systems.
Qualifications for Data Engineer
• Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
• Extensive Experience on Databricks on Azure Cloud platform, deep understanding on Delta lake, Lake House Architecture.
• Programming experience on Python, Shell scripting, PySpark, and other data programming language.
• Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
• Strong analytic skills related to working with Data Visualization Dashboard, Metrics and etc.
• Build processes supporting data transformation, data structures, metadata, dependency and workload management.
• A successful history of manipulating, processing and extracting value from large disconnected datasets.
• Working knowledge of message queuing, stream processing, and highly scalable 'big data' data stores.
• Familiar with Deployment tool like Docker and building CI/CD pipelines.
• Experience supporting and working with cross-functional teams in a dynamic environment.
• 8+ years' experience in software development, Data engineering, and
• Bachelor's degree in computer science, Statistics, Informatics, Information Systems or another quantitative field. Postgraduate/master's degree is preferred.
• Experience in Machine Learning and Data Modeling is a plus.
Required Skills : Tech stack requirements: • High level Databricks experience • Python, bash, or shell scripting • Experience architecting data pipelines and providing strategy/guidance on how to build from scratch • SQL queries and building dashboards and reports (Databricks visualization preferred but ok with Tableau or PowerBI) Location: 2 days/week on site in Sunnyvale, CA or San Bruno, CA
Basic Qualification :
Additional Skills :
Background Check :Yes
Drug Screen :Yes
Notes :
Selling points for candidate :
Project Verification Info :
Candidate must be your W2 Employee :Yes
Exclusive to Apex :Yes
Face to face interview required :No
Candidate must be local :No
Candidate must be authorized to work without sponsorship ::No
Interview times set : :No
Type of project :Development/Engineering
Master Job Title :Data Analyst
Branch Code :San Francisco
-
Senior AI Data Engineer
6 days ago
Sunnyvale, California, United States A CUBED Full timeA CUBED's Visionary: Senior AI Data EngineerWe are seeking a visionary Senior AI Data Engineer to helm our Wayfinder team, pioneers in certifiable autonomy systems for commercial aircraft. This role demands a master strategist to optimize data pipelines, auto-labeling, and AI-driven development processes.Key Responsibilities:Develop and refine AI and...
-
Senior Data Engineer, Catalog Data Works
6 days ago
Sunnyvale, California, United States Amazon Full timeAbout the RoleWe are seeking a highly skilled Senior Data Engineer to join our Catalog Data Works team at Amazon. As a key member of our team, you will be responsible for designing, developing, and maintaining large-scale data pipelines and data solutions that provide highly available datasets for our stakeholders.Key Responsibilities:Define and optimize...
-
Senior Data Engineer
6 months ago
Sunnyvale, United States TWO95 International Full timeTitle: Senior Data Engineer Location: Sunnyvale, CA Position: 2 Month (Contract) Summary Provide business insights, while leveraging internal tools and systems, databases and industry data Roles & Responsibilities Ability to document requirements, data lineage, subject matter in both business and technical terminology. Guide and learn from other team...
-
Senior Data Engineering Lead
6 days ago
Sunnyvale, California, United States Walmart Global Tech Full timeAbout the RoleWe are seeking an experienced Senior Data Engineering Lead to join our Global Marketplace Engineering team. This role requires exceptional leadership skills, a passion for technology and engineering excellence, and the ability to guide and mentor a team of engineers.
-
Senior Data Engineer With GCP
1 week ago
Sunnyvale, United States Inficare Full timeJob Title: Senior Data Engineer Location: Sunnyvale, CA (Day 1 Onsite) Duration: 12-Month Contract Job Description: seeking a highly skilled and collaborative Senior Data Engineer to design and develop big data applications using the latest open-source technologies. The ideal candidate will have a proven track record in building data pipelines, working with...
-
Senior Data Center Infrastructure Engineer
2 weeks ago
Sunnyvale, California, United States LinkedIn Full timeOverviewData center engineering is a critical field that involves the design, construction, and maintenance of data centers. As a Senior Data Center Infrastructure Engineer at LinkedIn, you will play a vital role in ensuring the stability, reliability, and security of our data center infrastructure.Job DescriptionThis role will be based in Manassas, VA, and...
-
Senior AI Data Engineer
1 week ago
Sunnyvale, United States A CUBED Full timeWAYFINDER Our Wayfinder team is building scalable, certifiable autonomy systems to power the next generation of commercial aircraft. Our team of experts is driving the maturation of machine learning and other core technologies for autonomous flight; we are creating a reference architecture that includes hardware, software, and a data-driven development...
-
Senior Data Engineer
3 days ago
Sunnyvale, United States Wal-Mart Full timeTECHNOLOGY Have you got what it takes to succeed The following information should be read carefully by all candidates. Senior Data Engineer professional opening available at Wal-Mart in Sunnyvale, CA.Master's or equiv in CS, Eng'g (Any), or rel.fld & 2 yrs of exp in lrg scale enterprise SW dvlpmt environ; OR Bachelor's or equiv in CS, Eng'g (Any), or rel.fld...
-
Senior Data Engineer
2 months ago
Sunnyvale, United States Big Cloud Full timeDo you want to build a cutting-edge computer vision platform at an innovative pre-seed startup? Are you passionate about shaping the film industry with 3D generative video tech?Is this the type of standout role you've been looking for? This startup are transforming video production using AI-driven virtual environments. Their small but dynamic team of 8...
-
Senior AI Data Engineer
2 days ago
Sunnyvale, United States A CUBED Full timeWAYFINDER Our Wayfinder team is building scalable, certifiable autonomy systems to power the next generation of commercial aircraft. Our team of experts is driving the maturation of machine learning and other core technologies for autonomous flight; we are creating a reference architecture that includes hardware, software, and a data-driven development...
-
Data Engineer
3 days ago
Sunnyvale, United States AAPRO Consulting Full timeContract To Hire Is your CV ready If so, and you are confident this is the role for you, make sure to apply asap.Visa Restriction: USC & GC OnlyOnly W2 Contract Job DescriptionWe are seeking a highly skilled Senior Data Engineer to join our team. The ideal candidate will have a strong background in big data technologies, including Apache Spark, Scala, and...
-
Senior Data Engineer
1 week ago
Sunnyvale, United States JobRialto Full timeJob Summary: We are looking for a skilled data professional to join our team and work on data engineering and processing tasks. This role will focus on querying and managing large datasets, automating data workflows, and building data models to enhance our analytics capabilities. The ideal candidate will have a strong background in Python programming, SQL,...
-
Senior Data Engineer
1 month ago
sunnyvale, United States Big Cloud Full timeWould you like to shape a computer vision platform at an exciting start-up?Are you interested in a cross-functional team working across AI and 3D generative video?This start-up is revolutionizing video through AI-powered virtual environments. The team are architecting early-stage cutting-edge generative computer vision technology for iOS and web platforms...
-
Senior Data Engineer
1 month ago
sunnyvale, United States Big Cloud Full timeWould you like to shape a computer vision platform at an exciting start-up?Are you interested in a cross-functional team working across AI and 3D generative video?This start-up is revolutionizing video through AI-powered virtual environments. The team are architecting early-stage cutting-edge generative computer vision technology for iOS and web platforms...
-
Senior Data Engineer
2 months ago
Sunnyvale, United States Big Cloud Full timeWould you like to shape a computer vision platform at an exciting start-up?Are you interested in a cross-functional team working across AI and 3D generative video?This start-up is revolutionizing video through AI-powered virtual environments. The team are architecting early-stage cutting-edge generative computer vision technology for iOS and web platforms...
-
Senior AI Data Engineer
1 day ago
Sunnyvale, United States A CUBED Full timeWAYFINDER Our Wayfinder team is building scalable, certifiable autonomy systems to power the next generation of commercial aircraft. Our team of experts is driving the maturation of machine learning and other core technologies for autonomous flight; we are creating a reference architecture that includes hardware, software, and a data-driven development...
-
GCP Data Engineer
1 week ago
Sunnyvale, United States Maintec Technologies Full timeSenior DataEngineer JD Rate:- $65 UST GLOBAL H1-b,USC,GC H4 12Yrs exp needed Proven experience as a data engineer, with at least 5 years of experience in a similar role. Design, implement, and optimize data pipelines using Spark with Scala, Airflow, and other relevant technologies. Work with GCP services, including Google Cloud Storage (GCS), BigQuery...
-
Senior Java Engineer
6 days ago
Sunnyvale, California, United States Saxon Global Full timeNo H1B. As a Senior Java Engineer at Saxon Global, you will design and build ground-up transformational tools, integrating data across sources and collaborating with cross-functional teams in Sunnyvale, CA or Virginia.Backend Engineering: You will develop scalable solutions using Java, SQL and NoSQL, Service Oriented architecture, Spring Boot, and...
-
Senior Data Engineer
6 days ago
Sunnyvale, California, United States Saxon Global Full timeSaxon Global is seeking a highly skilled Data Engineer to join our team.The ideal candidate will have experience with data pipelines and architectures, and will be responsible for designing and implementing efficient data systems.Below are the key responsibilities and qualifications for this role:Responsibilities:Create and maintain optimal data pipeline...
-
Sunnyvale, California, United States CV Library Full timeJob OverviewWe are seeking a highly skilled Senior Data Engineer to join our team at Diverse Lynx LLC in Sunnyvale, CA. As a key member of our data engineering team, you will be responsible for designing and implementing full-scale data warehouse solutions based on Snowflake.About the RoleThis is a Full Time and Contract (W2 Only) position that requires 10+...