Big Data Engineer-Assurance
2 weeks ago
Architect and design solution, including hands work to build Develop scripts and Manage Big Data Stack to support Platform And Application Development.
- HDFS deep expertise - Must
- Apache Spark deep expertise - Must
- Python / Scala - One of them required
Responsibilities:
• Manage the data lake, help prepare the data (including lot of video and image data) for all applications.
• Enable application performance, Optimization of data storage, Fast retrieval
• Metadata management
• Data Structures how to use, Programming Skills, Fundamentals ( for ex. indexing) - key requirement
• Write Spark programs. Spark Context, Refactoring - key requirement
Qualifications:
• Bachelor Engg . Comp Sc. ( preferred)
1) Years of experience required for position (In Big data 5 yrs, Overall around 10+years)
2) Location for the position
San Jose, CA
-
Lead Big Data Engineer
2 weeks ago
san francisco, United States Unreal Gigs Full timeDescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to leveraging the power of big data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge big data solutions that enable advanced analytics, machine learning, and business intelligence. Join...
-
Big Data Engineer
5 days ago
San Francisco, United States ZipRecruiter Full timeJob DescriptionAre you passionate about handling massive datasets and building the infrastructure that enables complex data analysis and machine learning at scale? Do you excel in creating robust, scalable data pipelines that fuel data-driven decision-making? If you’re ready to tackle the challenges of big data, our client has the perfect role for you....
-
Big Data Engineer
3 weeks ago
San Francisco, United States Unreal Gigs Full timeAre you passionate about handling massive datasets and building the infrastructure that enables complex data analysis and machine learning at scale? Do you excel in creating robust, scalable data pipelines that fuel data-driven decision-making? If you’re ready to tackle the challenges of big data, our client has the perfect role for you. We’re seeking a...
-
Senior Software Development Engineer
5 days ago
San Francisco, United States CV Library Full timeTeam IntroductionThe Data Platform team works on building data infrastructures and data products to support business engineering teams.As a Software Development Engineer in the data platform team, you will have the opportunity to build, optimize and grow one of the largest data platforms in the world. You'll gain hands-on experience on all kinds of systems...
-
Senior Software Development Engineer
5 days ago
San Francisco, United States ZipRecruiter Full timeJob DescriptionTeam IntroductionThe Data Platform team works on building data infrastructures and data products to support business engineering teams.As a Software Development Engineer in the data platform team, you will have the opportunity to build, optimize and grow one of the largest data platforms in the world. You'll gain hands-on experience on various...
-
Big Data Developer
4 months ago
San Francisco, United States Sigmaways Inc Full timeIn this role, you can contribute to several high-quality data solutions and enhance your technical skills across many disciplines.Key ResponsibilitiesDesign, develop, and maintain end-to-end data solutions using open source, modern data lake, and enterprise data warehouse technologies (Hadoop, Spark, Cloud, etc.)Contribute to multiple data solutions...
-
Senior Data Engineer/ Data Engineering Architect
1 month ago
San Jose, United States DESIGNLIBRO INC Full timeJob DescriptionJob DescriptionResponsibilitiesDesign robust and scalable data system architecture to collect, process, and store large volumes of data from IoT devices.Design and build data systems that support real-time, customer facing data applications, ensuring data integrity and efficient retrieval processes.Design and build a data validation framework...
-
Big Data Developer
1 month ago
san jose, United States Intelliswift Software Full timeTitle-Senior Data Developer Location-San Jose, CA Hybrid Pay rate-$98.59 per hour on W2 Duration-5 MonthsIntelliswift Software Inc. conceptualizes, builds, and supports the world's most amazing technology products and solutions. Our team of rich experts from diverse backgrounds contributes to making Intelliswift one of the most reliable partners in IT and...
-
Big Data Developer
1 month ago
san jose, United States Intelliswift Software Full timeTitle-Senior Data Developer Location-San Jose, CA Hybrid Pay rate-$98.59 per hour on W2 Duration-5 MonthsIntelliswift Software Inc. conceptualizes, builds, and supports the world's most amazing technology products and solutions. Our team of rich experts from diverse backgrounds contributes to making Intelliswift one of the most reliable partners in IT and...
-
Big Data Developer
1 month ago
San Jose, United States Intelliswift Software Full timeTitle-Senior Data Developer Location-San Jose, CA Hybrid Pay rate-$98.59 per hour on W2 Duration-5 MonthsIntelliswift Software Inc. conceptualizes, builds, and supports the world's most amazing technology products and solutions. Our team of rich experts from diverse backgrounds contributes to making Intelliswift one of the most reliable partners in IT and...
-
Software Engineer
4 weeks ago
San Jose, United States Tik Tok Full timeResponsibilities TikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy. TikTok has global offices including Los Angeles, New York, London, Paris, Berlin, Dubai, Singapore, Jakarta, Seoul and Tokyo. Why Join Us Creation is the core of TikTok's purpose. Our platform is built to help imaginations...
-
Tech Lead Software Engineer for Data Platform
4 weeks ago
San Jose, California, United States Hireio, Inc. Full timeJob Title: Tech Lead Software Engineer for Data PlatformJob Description:We are seeking a highly skilled Tech Lead Software Engineer for Data Platform to join our experimentation and evaluation team at Hireio, Inc. As a key member of our team, you will be responsible for designing and building data transformations efficiently and reliably for different...
-
Data Infrastructure Engineer
4 weeks ago
San Jose, California, United States Western Digital Full timeJob DescriptionAt Western Digital, we're pushing the boundaries of technology to make the impossible possible. Our company is built on a foundation of problem solvers who achieve extraordinary things with the right technology.We're a key partner to some of the world's largest and highest growth organizations, enabling systems to make cities safer, cars...
-
Tech Lead Software Engineer for Data Platform
4 months ago
San Jose, United States HireIO Inc Full timeTeam Introduction: Our mission in experimentation and evaluation team is to build the next-gen A/B testing platform, that empowers the company to make data-driven decision for the products. The supported scenarios include recommendation, push, ads, search, mobile app, UI interaction and service upgrades etc. Our platform's capabilities cover the entire...
-
Big Data Developer
1 month ago
san francisco, United States Sigmaways Inc Full timeWe are looking for a Big Data Developer who will contribute to high-quality technology solutions that address business needs by developing data applications for the customer business lines. You will contribute to the development and ongoing maintenance of a number of strategic data initiatives and data and analytic applications.Responsibilities:Hands-on...
-
Big Data Developer
3 months ago
San Francisco, United States Sigmaways Inc Full timeWe are looking for a Big Data Developer who will contribute to high-quality technology solutions that address business needs by developing data applications for the customer business lines. You will contribute to the development and ongoing maintenance of a number of strategic data initiatives and data and analytic applications.Responsibilities:Hands-on...
-
Big Data Developer
2 months ago
san francisco, United States Sigmaways Inc Full timeWe are looking for a Big Data Developer who will contribute to high-quality technology solutions that address business needs by developing data applications for the customer business lines. You will contribute to the development and ongoing maintenance of a number of strategic data initiatives and data and analytic applications.Responsibilities:Hands-on...
-
Principal Platform Engineer
3 weeks ago
San Francisco, United States Autodesk Full timeJob Requisition ID # 24WD77185Autodesk's Platform Services and Emerging Technology (PSET) team is hiring a Principal Platform Engineer with experience automating large-scale cloud infrastructure services. In this exciting role, you will help us automate a robust and scalable data platform used by numerous teams across the company. Reporting to our Software...
-
Data Engineer with Generative AI Expertise
3 weeks ago
san jose, United States CDRP Technologies Full timeW2 role.Job Title: Data Engineer with Generative AI ExpertiseLocation: San Jose, CA - RemoteDuration: Long TermTechnical Skills:Looking for minimum 12-15 years of experience. -- Proficiency in data pipeline and Big Data / ETL tools-- Strong programming skills in Python, SQL, and experience with cloud services (e.g., AWS, Google Cloud, Azure).-- Familiarity...
-
Data Engineer with Generative AI Expertise
3 weeks ago
San Jose, United States CDRP Technologies Full timeW2 role.Job Title: Data Engineer with Generative AI ExpertiseLocation: San Jose, CA - RemoteDuration: Long TermTechnical Skills:Looking for minimum 12-15 years of experience. -- Proficiency in data pipeline and Big Data / ETL tools-- Strong programming skills in Python, SQL, and experience with cloud services (e.g., AWS, Google Cloud, Azure).-- Familiarity...