Data Engineer III
4 weeks ago
At Walmart, our goal is to assist individuals in saving money, enabling them to enhance their lives. This objective is the basis for all our choices and motivates us to revolutionize the retail industry. Achieving this requires the most exceptional talent individuals who are innovative, curious, and motivated to provide extraordinary experiences for our customers.
Are you filled with endless enthusiasm and dedication towards engineering data to tackle ever-changing challenges that will shape the future of retail? Walmart's extensive operations come with vast and complex sets of data, presenting unparalleled opportunities for analysis and insights.
About the Data and Customer Analytics (DCA) Organization:
Our organization focuses on managing and delivering world-class data assets, including creating and maintaining data standards, driving policy compliance, creating partnerships, and developing pipelines and self-service tools. We empower our business to leverage data to fuel growth, driving revenue in our core and building new business model opportunities.
About Team:
Everyone has data, but the sheer volume of data at Walmart can be limitless. In the Data Engineering team, we help Walmart manage this data by building pipelines and data lakes to prepare big data for analysis and unlocking actionable insights in real-time. We also use cross-departmental data and machine learning to build a holistic view of true profitability, saving millions of dollars across item categories and geographies while assisting our leadership in making better decisions faster.
What you'll do:
Your primary responsibility will be to oversee and manage data pipeline processes that utilize cutting-edge data engineering techniques to generate critical datasets for Walmart.
You will be responsible for promptly addressing any issues or failures in data streaming and batch applications, ensuring adherence to SLAs.
Your role will involve acting as a gatekeeper to maintain the integrity and reliability of production data systems.
You will develop automation tools to monitor and alert platform components and data pipelines.
You will contribute to the ongoing design, implementation, and maintenance of systems and tools within our data platform.
You will assess and provide recommendations for optimizing resource usage in data pipelines built on a big data stack.
You will collaborate closely with engineering teams to contribute to their roadmap and assist in capacity planning for our big data stack.
You will implement data quality checks, data validation, and data cleaning processes to ensure the accuracy and high quality of ingested and processed data.
You will participate in a 12/7 on-call rotation and act as the initial responder for any issues with the data pipelines.
You will lead root cause analysis (RCA) and incident management efforts.
You will support and uphold company policies, procedures, mission, values, and ethical standards.
What you'll bring:
At least 4+ years of experience development of big data technologies/data pipelines
Experience with big data technologies like Hadoop, Apache Spark (Scala preferred), Apache Hive, or similar frameworks on the cloud ( GCP preferred , AWS, Azure etc.) to build batch data pipelines with strong focus on optimization, SLA adherence and fault tolerance.
Experience in programming languages like Java or Python
Experience in managing Spark Streaming, Kafka, Apache Storm, Flume etc.
Experience in writing SQL to analyze, optimize, profile data preferably in BigQuery or SPARK SQL
Strong troubleshooting skills to analyze Spark Event logs and provide recommendations on Spark container optimization, Cluster configurations etc.
Ability to move at a rapid pace with quality and start delivering with minimal ramp up time will be crucial to succeed in this initiative.
Effective communication and collaboration skills are necessary for working in a team environment and coordinating efforts between different stakeholders involved in the project.
Nice to have from you:
Good understanding of REST APIs working knowledge on Apache Druid, Redis, Elastic search, GraphQL or similar technologies. Understanding of API contracts, building telemetry, stress testing etc.
Exposure in UI development using React .
Exposure in developing reports/dashboards using Looker/Tableau
About Walmart Global Tech
Imagine working in an environment where one line of code can make life easier for hundreds of millions of people. Thats what we do at Walmart Global Tech. Were a team of software engineers, data scientists, cybersecurity expert's and service professionals within the worlds leading retailer who make an epic impact and are at the forefront of the next retail disruption. People are why we innovate, and people power our innovations. We are people-led and tech-empowered. We train our team in the skillsets of the future and bring in experts like you to help us grow. We have roles for those chasing their first opportunity as well as those looking for the opportunity that will define their career. Here, you can kickstart a great career in tech, gain new skills and experience for virtually every industry, or leverage your expertise to innovate at scale, impact millions and reimagine the future of retail.
Flexible, hybrid work:
We use a hybrid way of working that is primarily in office coupled with virtual when not onsite. Our campuses serve as a hub to enhance collaboration, bring us together for purpose and deliver on business needs. This approach helps us make quicker decisions, remove location barriers across our global team and be more flexible in our personal lives.
Benefits:
Benefits: Beyond our great compensation package, you can receive incentive awards for your performance. Other great perks include 401(k) match, stock purchase plan, paid maternity and parental leave, PTO, multiple health plans, and much more.
Equal Opportunity Employer:
Walmart, Inc. is an Equal Opportunity Employer By Choice. We believe we are best equipped to help our associates, customers and the communities we serve live better when we really know them. That means understanding, respecting and valuing diversity- unique styles, experiences, identities, ideas and opinions while being inclusive of all people.
The above information has been designed to indicate the general nature and level of work performed in the role. It is not designed to contain or be interpreted as a comprehensive inventory of all responsibilities and qualifications required of employees assigned to this job. The full Job Description can be made available as part of the hiring process.
#J-18808-Ljbffr
We have other current jobs related to this field that you can find below
-
Quality Engineer III
1 week ago
Sunnyvale, United States Walmart Full timeWhat you'll do... Position: Quality Engineer III Job Location: 860 W. California Avenue, Sunnyvale, CA 94086 Duties: Develop and execute software test plans and test cases to identify software problems and their causes. Perform manual testing and test automation for microservices using Cart, Checkout, and Pricing Engine, including test environment...
-
Data Engineer III: 24-01769
1 month ago
Sunnyvale, United States Akraya Inc. Full timePrimary Skills: SQL, Redshift, Data ModelingDuration: 11 + Months (Possible Extension)Contract Type: W2 OnlyLocation: Sunnyvale, CA (#LI-Hybrid)Pay Range:$68 - $75 per hour“Grow your skills by working with industry leaders”JOB RESPONSIBILITIES: Design and execute a platform that enables ad hoc access to extensive datasets. Employ best practices in data...
-
Data Engineer III: 24-01769
3 weeks ago
Sunnyvale, United States Akraya Inc. Full timePrimary Skills: SQL, ETL, Python, AWS, DashboardingDuration: 11 + Months (Possible Extension)Contract Type: W2 OnlyLocation: Sunnyvale, CA (#LI-Hybrid)Pay Range:$68 - $75 per hour“Grow your skills by working with industry leaders”JOB RESPONSIBILITIES: Design and execute a platform that enables ad hoc access to extensive datasets. Employ best practices in...
-
Quality Engineer III
4 days ago
Sunnyvale, United States Walmart Full timeWhat you'll do at What you'll do... Position: Quality Engineer III Job Location: 860 W. California Avenue, Sunnyvale, CA 94086 Duties: Develop and execute software test plans and Test cases in order to identify software problems and their causes. Perform manual testing and test automation for Micro services using Cart, Checkout and Pricing Engine, test...
-
Data Engineer
3 weeks ago
Sunnyvale, United States AMISEQ Full timeData EngineerSunnyvale, CA - Hybrid 12 Months Contract • Bachelor's degree in computer science, Data Engineering, Mathematics, or a related field and 5-7 years of proven experience as a Data Engineer or similar role in data management. Data Engineer with a minimum of 5 years.• Experience with big data tools: Hadoop, Spark, PySpark, Kafka, Hive, NoSql Dbs...
-
Data Engineer
3 weeks ago
Sunnyvale, United States AMISEQ Full timeData EngineerSunnyvale, CA - Hybrid 12 Months Contract • Bachelor's degree in computer science, Data Engineering, Mathematics, or a related field and 5-7 years of proven experience as a Data Engineer or similar role in data management. Data Engineer with a minimum of 5 years.• Experience with big data tools: Hadoop, Spark, PySpark, Kafka, Hive, NoSql Dbs...
-
Quality Engineer III
2 weeks ago
Sunnyvale, United States Walmart Full timeTECHNOLOGY Quality Engineer III professional opening available at Wal-Mart in Sunnyvale, CA. Master's or equiv in IT, CS, SW Eng'g, or rel. fld. Position does not req specific yrs of exp but reqs listed skills. Walmart will accept any amount of exp w/req'd skills. Salary Range: $141,107/yr to $202,000/yr. Add'l compensation incls ann/qrtly. perf....
-
Data Engineer
2 months ago
Sunnyvale, United States Achmea Full timeDe afdeling Je bent werkzaam binnen het chapter Data Engineering & Science, onderdeel van de afdeling Customer Center of Data (ongeveer 40 collega’s). Het chapter bestaat uit 12 collega’s (data engineers en data scientists). De afdeling Customer Center of Data werkt primair voor het merk Zilveren Kruis, maar bedient ook de andere zorgmerken van Achmea:...
-
Embedded Software Engineer Level III
3 weeks ago
Sunnyvale, United States Cloudious LLC Full timeJob DescriptionJob DescriptionEmbedded Software Engineer Level III Max Supplier Pay Rate: $70 Location: 100% onsite in either Redmond, WA / Sunnyvale, CA / Austin, TX JD: Meta Reality Labs focuses on building technology to help people connect through Augmented Reality (AR) and Virtual Reality (VR). Our embedded software will enable AR and VR devices where...
-
Senior Data Engineer
4 weeks ago
Sunnyvale, United States Airbus Group Inc. Full timeSenior Data Engineer About Acubed Founded in 2015, Acubed is the Silicon Valley innovation center of Airbus. As a global leader in aerospace, Airbus aims to make things fly. Our mission is to provide a lens into the future for the industry, transforming risk into opportunity to build the future of flight now. At Acubed, we strive to propel innovation to...
-
Senior Data Engineer
4 weeks ago
Sunnyvale, United States A CUBED Full timeSenior Data Engineer About Acubed Founded in 2015, Acubed is the Silicon Valley innovation center of Airbus. As a global leader in aerospace, Airbus aims to make things fly. Our mission is to provide a lens into the future for the industry, transforming risk into opportunity to build the future of flight now. At Acubed, we strive to propel innovation to...
-
Data Engineer
7 days ago
Sunnyvale, California, United States People Integra LLC Full timeAdditional Details:Candidates must have 5+ years of data experience, 2+ years of experience with Google Cloud platform, and hands on experience process large scale distributed dataDescription :Designs, develops, and implements Hadoop eco-system based applications to support business requirements. Follows approved life cycle methodologies, creates design...
-
Senior Data Engineer
2 months ago
Sunnyvale, United States Saxon Global Full timeSam's Cash Core Team is looking for a savvy Data Engineer to join our growing team of analytics experts. The role will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. The ideal candidate is an experienced data pipeline builder and data wrangler who...
-
Senior Data Engineer
2 months ago
Sunnyvale, United States TWO95 International Full timeTitle: Senior Data Engineer Location: Sunnyvale, CA Position: 2 Month (Contract) Summary Provide business insights, while leveraging internal tools and systems, databases and industry data Roles & Responsibilities Ability to document requirements, data lineage, subject matter in both business and technical terminology. Guide and learn from other team...
-
Sr. Data Engineer
3 weeks ago
Sunnyvale, United States Ismile Technologies Full timeJob DescriptionJob DescriptionJob Title: Senior Data EngineerLocation: Sunnyville, CA Hybrid (2 days a week remote)Duration: 6 - 18+ monthsStart Date: Within 3 weeksRate: $65/hr Max on 1099Interview Process: 1 StepOpportunity Overview: Ismile Technologies is seeking a skilled Senior Data Engineer to join our team for a contract position lasting from 6 to 18...
-
Test Engineer III
1 month ago
Sunnyvale, United States Raise Full timeWe’re Hiring! Our key client in the medical device industry is looking for additional members for their team. We have a Test Engineer III on the team.Pay Rate: $50.00-$60.00/hour on W2Work Type: Onsite – Sunnyvale, CA 94086Duration: 6-month contract (with possible extension)Job Overview:This position will play a technical role in developing a surgical...
-
Test Engineer III
1 month ago
Sunnyvale, United States Raise Full timeWe’re Hiring! Our key client in the medical device industry is looking for additional members for their team. We have a Test Engineer III on the team.Pay Rate: $50.00-$60.00/hour on W2Work Type: Onsite – Sunnyvale, CA 94086Duration: 6-month contract (with possible extension)Job Overview:This position will play a technical role in developing a surgical...
-
Data Engineer
1 month ago
Sunnyvale, United States Vakulatech Full timeJob DescriptionJob DescriptionJob Title: Data Engineer (Streaming, Scala, Java, GCP) Locaion: Hybrid - Sunnyvale, CA.Job description :-Candidates must have 5+ years of data experience, 2+ years of experience with Google Cloud platform, and hands on experienceDescriptionDesigns, develops, and implements Hadoop eco-system based applications to support business...
-
Senior Data Engineer
4 weeks ago
Sunnyvale, United States Illumio Full timeOn-site work model with 5 days in office/week in Sunnyvale, CA Targeted hire date of February 1, 2024 About the Team: Illumio's new Machine Learning (ML) team embodies a culture of thought leadership, independence, and responsibility, holding a significant and highly visible role within our Engineering division. This dynamic team is tasked with developing...
-
Senior Data Engineer
4 weeks ago
Sunnyvale, United States Illumio Full timeOn-site work model with 5 days in office/week in Sunnyvale, CA Targeted hire date of February 1, 2024 About the Team: Illumio's new Machine Learning (ML) team embodies a culture of thought leadership, independence, and responsibility, holding a significant and highly visible role within our Engineering division. This dynamic team is tasked with developing...
