Big Data Systems Lead Developer

1 day ago


San Jose, California, United States ZipRecruiter Full time

**About the Role**

We are looking for a skilled Big Data Systems Lead Developer to lead the development of our data platform. The successful candidate will have experience in building large-scale distributed systems in a product environment.

In this role, you will be responsible for designing and implementing reliable, scalable, robust, and extensible big data systems that support core products and businesses.

Key Responsibilities:

  • Design and build data transformations efficiently and reliably for different purposes (e.g., reporting, growth analysis, multi-dimensional analysis).
  • Establish solid design and best engineering practices for engineers as well as non-technical people.

Requirements:

  • Bachelor's or Master's degree in Computer Science or related technical field or equivalent practical experience.
  • Experience in big data technologies (Hadoop, M/R, Hive, Spark, Metastore, Presto, Flume, Kafka, ClickHouse, Flink, etc.).
  • Experience with performing data analysis, data ingestion, and data integration.

Estimated Salary Range: $140,000 - $200,000 per year



  • San Jose, California, United States HireIO Inc Full time

    At HireIO Inc, we're looking for a talented Big Data Systems Architect to lead the development of our next-gen A/B testing platform. This platform will empower our company to make data-driven decisions for our products. The supported scenarios include recommendation, push, ads, search, mobile app, UI interaction, and service upgrades.As a software engineer...


  • San Jose, California, United States HireIO Inc Full time

    Unlock the Power of Data with Our TeamHireIO Inc is seeking a highly skilled Data Engineering Lead for Big Data Platforms to join our Experimentation and Evaluation team.Estimated Salary: $250,000 - $350,000 per yearAbout UsWe're building the next-gen A/B testing platform that empowers our company to make data-driven decisions. Our mission is to create a...


  • San Francisco, California, United States USM Business Systems Full time

    Job Title: Senior Data Engineer + Big Data/HadoopJob Summary:The Data Architect and Engineer will be an integral member of the team within Data Services. This is a highly technical and hands-on role with responsibility to lead design, implement and support data architecture deliverables for multiple data integration, data management, data warehousing,...


  • San Jose, California, United States Tik Tok Full time

    TikTok is seeking a highly skilled Big Data Streaming Solutions Developer to join its team. In this role, you will design and develop scalable and efficient data processing systems that enable real-time analytics and drive business growth.RequirementsDeep understanding of computer principles, data structures, and algorithmsExperience with streaming computing...

  • Big Data Developer

    6 days ago


    San Francisco, California, United States Omega Solutions Inc Full time

    Job DescriptionWe are seeking a highly skilled Big Data Developer to join our team at Omega Solutions Inc.Key Responsibilities:Design and develop large-scale data processing systems using Hadoop, Spark, and Hive technologies.Maintain and optimize existing data pipelines on AWS cloud infrastructure.Develop and implement data science solutions using Python and...

  • Big Data Specialist

    3 hours ago


    San Jose, California, United States Tik Tok Full time

    About the JobWe are seeking talented individuals to join our Global live Data BP team as Data Engineers. Your primary responsibility will be to construct offline and real-time data warehouses for TikTok Live business. You will handle large-scale data processing, providing services for the entire lifecycle of big data, covering data generation, transmission,...

  • Big Data Architect

    3 weeks ago


    San Jose, California, United States RAMPS International Inc. Full time

    Job OverviewHiring for a Big Data Architect at RAMPS International, Inc. in San Jose, CA.Estimated Salary: $120,000 - $180,000 per yearJob Responsibilities:The ideal candidate will be responsible for the implementation and ongoing administration of Hadoop infrastructure, including designing, deploying, monitoring, tuning, and troubleshooting.Design and...


  • San Francisco, California, United States USM Business Systems Full time

    USM Business SystemsSenior Data Modeler/Data Architect + Big Data/Hadoop OpportunityLocation: Nationwide (Remote)Contract Length: 6+ MonthsEstimated Salary Range: $120,000 - $180,000 per yearAbout the Role:The Senior Data Modeler/Data Architect will be an integral member of the Digital Insights & Architecture team within USM Business Systems. This highly...


  • San Francisco, California, United States Diverse Lynx Full time

    Job Summary:Diverse Lynx LLC is seeking a highly skilled Big Data Platform Developer to join our team. As a key member of our big data engineering team, you will be responsible for designing, building, and maintaining scalable and efficient big data platforms using various big data engineering technologies such as Hadoop, Spark, HBase, Flume, and Storm. Your...


  • San Francisco, California, United States Eppo, Inc Full time

    About Eppo, Inc.We are revolutionizing the way companies make decisions by harnessing the power of experimentation. Our innovative platform combines the modern data stack with high-velocity experimentation, empowering customers to unlock new insights and drive growth.Job OverviewThis role is ideal for a seasoned software engineer who is passionate about...


  • San Jose, California, United States RAMPS International Inc. Full time

    About the Role:RAMPS International Inc. is seeking an experienced Big Data Architect and Engineer to join our team in San Jose, CA.Job Description:We are looking for a skilled professional with hands-on experience in designing, deploying, monitoring, tuning, and troubleshooting Hadoop infrastructure. The ideal candidate will have strong...

  • Big Data Architect

    1 day ago


    San Jose, California, United States TEPHRA Full time

    Job Title: Big Data ArchitectWe are seeking an experienced Big Data Architect to join our team at TEPHRA. The successful candidate will design and implement scalable big data solutions to support our business growth.About the Role:- Design, develop, and deploy large-scale big data architectures.- Collaborate with cross-functional teams to define and...


  • San Jose, California, United States Tik Tok Full time

    Secure the Future of TikTok's DataTikTok, a global leader in short-form mobile video, is seeking a skilled Data Security Engineer to join its Data Management Suite team. Located in various global offices, including Los Angeles, New York, London, and Singapore, this role presents an opportunity to work on one of the largest data platforms in the world.About...


  • San Jose, California, United States Tik Tok Full time

    Job DescriptionTikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy. We are looking for talented individuals to join our Data Platform team as a Big Data Engineer Intern.Responsibilities:Translate business requirements into technical implementations and build batch and real-time data...


  • San Jose, California, United States Tik Tok Full time

    Data Warehouse Developer RoleWe are seeking highly skilled and motivated software engineers to join our Global live Data BP team as interns in 2025. As a data warehouse developer, you will play a critical role in designing, implementing, and maintaining our data warehouse infrastructure. You will work closely with experienced engineers to develop scalable...


  • San Jose, California, United States TEPHRA Full time

    We are TEPHRA, a dynamic organization committed to excellence in big data engineering. We are now seeking a seasoned Big Data Technology Specialist to enhance our team's capabilities. In this pivotal role, you will play a crucial part in architecting and implementing robust big data solutions using advanced technologies such as HDFS, Apache Spark, and...


  • San Jose, California, United States TEPHRA Full time

    Data Engineering Lead: We are searching for an experienced Data Engineering Lead to oversee the development and implementation of our big data platform. The successful candidate will have a strong background in big data engineering and leadership.About the Role:- Lead a team of big data engineers and developers in designing, developing, and deploying...


  • San Jose, California, United States TEPHRA Full time

    At TEPHRA, we are seeking a highly skilled Big Data Engineer-Assurance to join our team. This individual will be responsible for architecting and designing solutions, including hands-on work to build and manage Big Data Stack to support Platform And Application Development.The ideal candidate must have deep expertise in HDFS and Apache Spark. Additionally,...


  • San Jose, California, United States ACL Digital Full time

    Job Summary: Big Data Analytics ExpertAFL Digital is seeking a highly skilled Big Data Analytics Expert to join our team. As a key member of our team, you will play a crucial role in developing and maintaining client/stats models, working closely with the data engineering team to build client models on security data.Salary Range: $150,000 - $190,000 per year...


  • San Francisco, California, United States Databricks Inc. Full time

    At Databricks, our customers face complex data challenges. As a Solutions Architect, you will lead the adoption of our Unified Analytics Platform. This role requires expertise in open-source projects like Apache Spark, MLflow, and Delta Lake to advocate for the Lakehouse paradigm on public cloud providers.You will develop architectures and solutions using...