Big Data Engineer-Assurance

2 weeks ago


San Jose, United States TEPHRA Full time
Description:

Architect and design solution, including hands work to build Develop scripts and Manage Big Data Stack to support Platform And Application Development.

- HDFS deep expertise - Must

- Apache Spark deep expertise - Must

- Python / Scala - One of them required

Responsibilities:

• Manage the data lake, help prepare the data (including lot of video and image data) for all applications.

• Enable application performance, Optimization of data storage, Fast retrieval

• Metadata management

• Data Structures how to use, Programming Skills, Fundamentals ( for ex. indexing) - key requirement

• Write Spark programs. Spark Context, Refactoring - key requirement

Qualifications:

• Bachelor Engg . Comp Sc. ( preferred)

1) Years of experience required for position (In Big data 5 yrs, Overall around 10+years)

2) Location for the position

San Jose, CA

  • san francisco, United States Unreal Gigs Full time

    DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to leveraging the power of big data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge big data solutions that enable advanced analytics, machine learning, and business intelligence. Join...

  • Big Data Engineer

    5 days ago


    San Francisco, United States ZipRecruiter Full time

    Job DescriptionAre you passionate about handling massive datasets and building the infrastructure that enables complex data analysis and machine learning at scale? Do you excel in creating robust, scalable data pipelines that fuel data-driven decision-making? If you’re ready to tackle the challenges of big data, our client has the perfect role for you....

  • Big Data Engineer

    3 weeks ago


    San Francisco, United States Unreal Gigs Full time

    Are you passionate about handling massive datasets and building the infrastructure that enables complex data analysis and machine learning at scale? Do you excel in creating robust, scalable data pipelines that fuel data-driven decision-making? If you’re ready to tackle the challenges of big data, our client has the perfect role for you. We’re seeking a...


  • San Francisco, United States CV Library Full time

    Team IntroductionThe Data Platform team works on building data infrastructures and data products to support business engineering teams.As a Software Development Engineer in the data platform team, you will have the opportunity to build, optimize and grow one of the largest data platforms in the world. You'll gain hands-on experience on all kinds of systems...


  • San Francisco, United States ZipRecruiter Full time

    Job DescriptionTeam IntroductionThe Data Platform team works on building data infrastructures and data products to support business engineering teams.As a Software Development Engineer in the data platform team, you will have the opportunity to build, optimize and grow one of the largest data platforms in the world. You'll gain hands-on experience on various...

  • Big Data Developer

    4 months ago


    San Francisco, United States Sigmaways Inc Full time

    In this role, you can contribute to several high-quality data solutions and enhance your technical skills across many disciplines.Key ResponsibilitiesDesign, develop, and maintain end-to-end data solutions using open source, modern data lake, and enterprise data warehouse technologies (Hadoop, Spark, Cloud, etc.)Contribute to multiple data solutions...


  • San Jose, United States DESIGNLIBRO INC Full time

    Job DescriptionJob DescriptionResponsibilitiesDesign robust and scalable data system architecture to collect, process, and store large volumes of data from IoT devices.Design and build data systems that support real-time, customer facing data applications, ensuring data integrity and efficient retrieval processes.Design and build a data validation framework...

  • Big Data Developer

    1 month ago


    san jose, United States Intelliswift Software Full time

    Title-Senior Data Developer Location-San Jose, CA Hybrid Pay rate-$98.59 per hour on W2 Duration-5 MonthsIntelliswift Software Inc. conceptualizes, builds, and supports the world's most amazing technology products and solutions. Our team of rich experts from diverse backgrounds contributes to making Intelliswift one of the most reliable partners in IT and...

  • Big Data Developer

    1 month ago


    san jose, United States Intelliswift Software Full time

    Title-Senior Data Developer Location-San Jose, CA Hybrid Pay rate-$98.59 per hour on W2 Duration-5 MonthsIntelliswift Software Inc. conceptualizes, builds, and supports the world's most amazing technology products and solutions. Our team of rich experts from diverse backgrounds contributes to making Intelliswift one of the most reliable partners in IT and...

  • Big Data Developer

    1 month ago


    San Jose, United States Intelliswift Software Full time

    Title-Senior Data Developer Location-San Jose, CA Hybrid Pay rate-$98.59 per hour on W2 Duration-5 MonthsIntelliswift Software Inc. conceptualizes, builds, and supports the world's most amazing technology products and solutions. Our team of rich experts from diverse backgrounds contributes to making Intelliswift one of the most reliable partners in IT and...

  • Software Engineer

    4 weeks ago


    San Jose, United States Tik Tok Full time

    Responsibilities TikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy. TikTok has global offices including Los Angeles, New York, London, Paris, Berlin, Dubai, Singapore, Jakarta, Seoul and Tokyo. Why Join Us Creation is the core of TikTok's purpose. Our platform is built to help imaginations...


  • San Jose, California, United States Hireio, Inc. Full time

    Job Title: Tech Lead Software Engineer for Data PlatformJob Description:We are seeking a highly skilled Tech Lead Software Engineer for Data Platform to join our experimentation and evaluation team at Hireio, Inc. As a key member of our team, you will be responsible for designing and building data transformations efficiently and reliably for different...


  • San Jose, California, United States Western Digital Full time

    Job DescriptionAt Western Digital, we're pushing the boundaries of technology to make the impossible possible. Our company is built on a foundation of problem solvers who achieve extraordinary things with the right technology.We're a key partner to some of the world's largest and highest growth organizations, enabling systems to make cities safer, cars...


  • San Jose, United States HireIO Inc Full time

    Team Introduction: Our mission in experimentation and evaluation team is to build the next-gen A/B testing platform, that empowers the company to make data-driven decision for the products. The supported scenarios include recommendation, push, ads, search, mobile app, UI interaction and service upgrades etc. Our platform's capabilities cover the entire...

  • Big Data Developer

    1 month ago


    san francisco, United States Sigmaways Inc Full time

    We are looking for a Big Data Developer who will contribute to high-quality technology solutions that address business needs by developing data applications for the customer business lines. You will contribute to the development and ongoing maintenance of a number of strategic data initiatives and data and analytic applications.Responsibilities:Hands-on...

  • Big Data Developer

    3 months ago


    San Francisco, United States Sigmaways Inc Full time

    We are looking for a Big Data Developer who will contribute to high-quality technology solutions that address business needs by developing data applications for the customer business lines. You will contribute to the development and ongoing maintenance of a number of strategic data initiatives and data and analytic applications.Responsibilities:Hands-on...

  • Big Data Developer

    2 months ago


    san francisco, United States Sigmaways Inc Full time

    We are looking for a Big Data Developer who will contribute to high-quality technology solutions that address business needs by developing data applications for the customer business lines. You will contribute to the development and ongoing maintenance of a number of strategic data initiatives and data and analytic applications.Responsibilities:Hands-on...


  • San Francisco, United States Autodesk Full time

    Job Requisition ID # 24WD77185Autodesk's Platform Services and Emerging Technology (PSET) team is hiring a Principal Platform Engineer with experience automating large-scale cloud infrastructure services. In this exciting role, you will help us automate a robust and scalable data platform used by numerous teams across the company. Reporting to our Software...


  • san jose, United States CDRP Technologies Full time

    W2 role.Job Title: Data Engineer with Generative AI ExpertiseLocation: San Jose, CA - RemoteDuration: Long TermTechnical Skills:Looking for minimum 12-15 years of experience. -- Proficiency in data pipeline and Big Data / ETL tools-- Strong programming skills in Python, SQL, and experience with cloud services (e.g., AWS, Google Cloud, Azure).-- Familiarity...


  • San Jose, United States CDRP Technologies Full time

    W2 role.Job Title: Data Engineer with Generative AI ExpertiseLocation: San Jose, CA - RemoteDuration: Long TermTechnical Skills:Looking for minimum 12-15 years of experience. -- Proficiency in data pipeline and Big Data / ETL tools-- Strong programming skills in Python, SQL, and experience with cloud services (e.g., AWS, Google Cloud, Azure).-- Familiarity...