Big Data Engineer

3 weeks ago


San Jose, California, United States Apollose Full time
Responsibilities Design develop and implement scalable data pipelines and ETL processes using Java Python and Spark. Collaborate with data scientists analysts and other stakeholders to understand data requirements and design efficient solutions. Perform data exploration data cleaning and data transformation tasks to prepare data for analysis and modeling. Develop and maintain data models and schemas to support data integration and analysis. Implement data quality and validation checks to ensure accuracy and consistency of data. Utilize REST API development skills to create and integrate data services and endpoints for seamless data access and consumption. Monitor and troubleshoot data pipeline performance identifying and resolving bottlenecks and issues. Mentor and guide junior team members providing technical leadership and sharing best practices.
Qualifications Master's degree in Computer Science Data Science or a related field. Minimum of 3 years of professional experience in data engineering working with Java Python Spark and big data technologies. Strong programming skills in Java and Python with expertise in building scalable and maintainable code. Proven experience in Spark cluster management optimization and performance tuning. Solid understanding of data science concepts and experience working with

  • San Jose, California, United States QData Full time

    HiHope you are doing good...We have an urgent requirement below please go through Job description and send your updated profile and expected rate ASAP.Please reach me at .comJob Title GCP Architect with Big Data / Big Query MigrationLocation RemotePlease note Must have Google PSO Experience.Certifications GCP Cloud Certification is Must Google Cloud...

  • Sr Data Engineer

    1 month ago


    San Jose, California, United States Apollose Full time

    Responsibilities Engage in scrum ceremonies including Daily Standups Sprint Planning Retrospectives and Demos. Collaborate daily with your development team sharing progress and offering support to one another. Design develop and maintain highly scalable and extensible data pipelines from internal and external sources. Test and validate models developed by...

  • Senior Data Engineer

    1 month ago


    San Jose, California, United States TikTok Full time

    Senior Data Engineer (Multiple Positions)San JoseRegularR&DJob ID: A02372ResponsibilitiesAbout TikTokTikTok is the leading destination for short-form mobile video. At TikTok, our mission is to inspire creativity and bring joy. TikTok's global headquarters are in Los Angeles and Singapore, and its offices include New York, London, Dublin, Paris, Berlin,...


  • San Jose, California, United States Advanced Micro Devices Full time

    WHAT YOU DO AT AMD CHANGES EVERYTHINGWe care deeply about transforming lives with AMD technology to enrich our industry, our communities, and the world. Our mission is to build great products that accelerate next-generation computing experiences - the building blocks for the data center, artificial intelligence, PCs, gaming and embedded. Underpinning our...

  • Sr. Data Engineer

    3 weeks ago


    San Jose, California, United States bioMérieux Full time

    DescriptionWe are seeking an experienced and highly skilled Sr Data Engineer to join us. This role requires a seasoned professional with a deep understanding of automated data pipelines, cloud infrastructure, databases, and workflow engines. The ideal candidate will have a minimum of 5 years of technical lead experience in the medical device field and at...

  • Staff Data Engineer

    5 days ago


    San Francisco, California, United States SoFi Full time

    Employee Applicant Privacy Notice Who we are:Shape a brighter financial future with us.Together with our members, we're changing the way people think about and interact with personal finance.We're a next-generation financial services company and national bank using innovative, mobile-first technology to help our millions of members reach their goals. The...

  • Senior Data Engineer

    1 month ago


    San Francisco, California, United States Samba TV Full time

    At Samba TV, we are on a mission to fundamentally change television viewing for everyone. We are doing this by leveraging our data to enable advertisers to engage and measure TV viewers across all their devices. We have an amazing story with a unique perspective formed by innovative technology.Samba TV is uniquely positioned at the forefront of the TV...


  • San Jose, California, United States Western Digital Full time

    Staff Engineer, Software Development Engineering (Apps)San Jose, CA, United StatesFull-timeJob Type (exemption status): Exempt position - Please see related compensation & benefits details belowSalary Range: 112, ,800.00Business Function: Software Development Engineering (Apps)Work Location: San Jose Great Oaks Headquarters--LOC_WDT_USCA23Location...


  • San Jose, California, United States QData Full time

    Responsibilities All extract transform and load (ETL) processes and the creation of applications that can connect to remote APIs. Preferably including streaming data into environments such as BigQuery Management of multiple processes and applications performance reporting and error checking Management of all data created within client applications the...


  • San Jose, California, United States QData Full time

    HiHope you are doing good...We have an urgent requirement below please go through Job description and send your updated profile and expected rate ASAP.Please reach me at .comJob Title Data engineer with Strong Scala ExperienceLocation Anywhere in US & CanadaJob Description hard code coder coding and debugging data flow pipelines implemented in Scala...


  • San Francisco, California, United States Robust Intelligence Full time

    Robust Intelligence's mission is to eliminate AI Risk. As the world increasingly adopts AI into automated decision processes, we inherit great risk. Our flagship product is built to be integrated with existing AI systems to enumerate and eliminate risks caused by unintentional and intentional (adversarial) failure modes. With Generative AI becoming...


  • San Jose, California, United States Western Digital Full time

    Senior Engineer, Software Development Engineering (Apps)San Jose, CAFull-timeJob Type (exemption status): Exempt position - Please see related compensation & benefits details belowBusiness Function: Software Development Engineering (Apps)Work Location: San Jose Great Oaks Headquarters--LOC_WDT_USCA23Location (Secondary): Irvine Office--LOC_WDT_USCA01Company...


  • San Francisco, California, United States Fintool Full time

    Apply hereAboutFintool is a AI Equity Research Copilot for institutional investors. It's a LLM on top of financial documents, starting with SEC filings. Fintool is engineered to discover financial insights beyond the reach of timely human analysis or search software. You can try Fintool on our website.Fintool is backed by Y Combinator as well as...

  • Staff Data Engineer

    2 weeks ago


    San Francisco, California, United States Faire Full time

    About FaireFaire is an online wholesale marketplace built on the belief that the future is local — independent retailers around the globe are doing more revenue than Walmart and Amazon combined. At Faire, we're using the power of tech, data, and machine learning to connect this thriving community of entrepreneurs across the globe. Picture your favorite...


  • San Mateo, California, United States Slickdeals Full time

    About Slickdeals:On a mission to bring the joy of discovering a great deal to shoppers, Slickdeals thrives on the active participation of its 12-million-strong community. Users share, upvote, and uncover the best prices on popular products from trustworthy brands.With a robust track record of 24 years in business, marked by profitability and a thriving...

  • Sr Data Analyst

    2 weeks ago


    San Jose, California, United States VISART Full time

    Job Description At client client runs a world-class Engineering organization and as a part of the Engineering Program Office that manages large capital programs using state of the art analytics seek to improve the capital planning and management processes enhancing systems realigning the organization and adding opportunities for personal skill-building and...


  • San Jose, California, United States Zscaler Full time

    Our Engineering team built the world's largest cloud security platform from the ground up, and we keep building. With more than 100 patents and big plans for enhancing services and increasing our global footprint, the team has made us and our multitenant architecture today's cloud security leader, with more than 15 million users in 185 countries. Bring your...

  • Senior Data Engineer

    2 weeks ago


    San Francisco, California, United States Unreal Gigs Full time

    Join us and be part of a dynamic team shaping the future of data engineering.If you're a seasoned engineer with expertise in data engineering technologies and a passion for building robust data systems, we want you on our team.Data Governance: Establish and enforce data governance policies and best practices to ensure data quality, security, and compliance...


  • San Jose, California, United States InnoPhase IoT Full time

    About InnoPhase IoTIf you are keen to work with a bunch of brilliant people with various backgrounds, if you share the same value of working smart and celebrating successes, if you have enthusiasm for big technology in a small company, if your goals are to learn and experience different aspects of work--not just singing the same song every day, you'll find...

  • Data Engineer

    2 months ago


    San Francisco, California, United States Nimble Robotics Full time

    About NimbleNimble is a robotics and AI startup founded from the AI labs at Stanford and Carnegie Mellon. We're pioneering the way robots learn to grasp and manipulate any object.Our ultimate goal is to enable the dark warehouse, a fully automated eCommerce fulfillment center with swarms of intelligent, cloud-connected robots to enable affordable same-day...