Senior Big Data Engineer

3 weeks ago


Santa Monica, California, United States ZipRecruiter Full time
About the Role

We are seeking a highly skilled Senior Software Engineer to join our Big Data team at ZipRecruiter. The ideal candidate will have a strong background in big data technologies and a passion for building scalable and efficient data processing systems.

As a Senior Software Engineer on our Big Data team, you will be responsible for designing and implementing data processing pipelines, developing machine learning infrastructure, and collaborating with cross-functional teams to drive business growth.

Key Responsibilities:

  • Design and implement data processing pipelines using Spark, Flink, and other big data technologies
  • Develop and maintain machine learning infrastructure to power our intelligence
  • Collaborate with data scientists and engineers to drive business growth and improve our data-driven applications
  • Participate in code reviews and contribute to the development of high-quality software

Requirements:

  • 3+ years of professional software development experience with a focus on big data technologies
  • Experience with Hadoop, Spark, Hive, and/or other big data technologies
  • Comprehensive computer science fundamentals in coding, object-oriented programming, data structures, and algorithms
  • Experience with containerization technologies like Docker and/or Kubernetes

Preferred Qualifications:

  • 5+ years of professional software development experience, with a focus on big data technologies
  • BS/MS/PhD in Mathematics, Computer Science, Physics, related technical field or equivalent practical experience
  • Experience with data integration tools like Apache Kafka, Flume, and NiFi
  • Familiarity with data storage technologies such as Delta Lake, HBase, Cassandra, and MongoDB

What We Offer:

  • Competitive compensation
  • Exceptional benefits package
  • Flexible vacation & paid time off
  • Employer-matched 401(k) plan

#LI-Remote

The US base salary range for this full-time position is $105,000-$145,000. Our salary ranges are determined by role, level, and location, and the range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position across all US locations. Within the range, individual pay is determined by work location, role-related knowledge and skills, depth of experience, relevant education or training, and additional role-related considerations.

Depending on the position offered, equity, bonuses, commission, or other forms of compensation may also be provided as part of a total compensation package, in addition to a full range of medical, financial, and other benefits.

ZipRecruiter is proud to be an equal opportunity employer and provides equal employment opportunities (EEO) to all employees and applicants without regard to race, color, religion, sex, national origin, age, disability, veteran status, sexual orientation, gender identity or genetics.

Privacy Notice: For information about ZipRecruiter's collection and processing of job applicant personal data for this job, please see our Privacy Notice at:



  • Santa Clara, California, United States MapR Technologies Full time

    MapR Technologies is a leading provider of data platforms for AI and analytics. We're seeking a senior product manager to lead our big data analytics products. As a key member of our team, you'll be responsible for defining and driving the product strategy, roadmap, and features for our next-generation interactive big data analytics products.Key...


  • Santa Clara, California, United States Telenav Full time

    We are seeking a highly motivated Senior Data Platform Engineer to join our growing Auto team at Telenav. Our team is responsible for building and maintaining the data infrastructure that powers our connected car and location-based platform services.The ideal candidate will have experience in Java development, Hadoop, Hive, Spark, and other big data...


  • Santa Monica, California, United States Autodesk Full time

    Job Title: Director PPL Insights Data Science EngineeringWe are seeking a visionary leader to join our People Insights & Solution Design (PI&SD) team as the Director of Data Science and Engineering. This new role will report directly to the Senior Director of People Insights & Solution Design, and will provide technical thought leadership and guidance to the...


  • Santa Clara, California, United States Akraya Full time

    Job Summary:We are seeking a highly skilled Principal Big Data Engineer to lead the development of our data ingestion and processing platform. This pivotal role requires expertise in handling vast datasets and crafting innovative data processing architectures.Key Responsibilities: Lead the architecture, design, and development of our data ingestion and...


  • Santa Clara, California, United States Palo Alto Networks Full time

    PALO ALTO NETWORKS is the fastest-growing security company in history, leading the way in ending breaches and protecting our digital way of life.We are looking for a motivated, intelligent, and creative Big Data Engineer to join our team and contribute to the development of our all-new application framework, which provides security disruption through...


  • Santa Monica, California, United States Autodesk Full time

    Position OverviewWe are seeking a talented leader to join our People Insights & Solution Design team as the Director of Data Science and Engineering. This new role will report directly to the Senior Director of People Insights & Solution Design, and will provide technical thought leadership and guidance to the team. The right candidate will play a critical...

  • Senior Data Engineer

    4 weeks ago


    Santa Clara, California, United States Cynet Systems Full time

    Job Description:Responsibilities:As a Principal Big Data Engineer at Cynet Systems, you will be an integral member of our data ingestion and processing platform team. Your responsibilities will include architecture, design, and development of scalable data processing and storage solutions. You will work closely with research and development teams and data...


  • Santa Clara, California, United States VDart Full time

    Job Title:Senior Data Engineering ManagerJob Description:As a Senior Data Engineering Manager at VDart, you will be responsible for leading our data ingestion and processing platform team. This includes architecture, design, and development of scalable data processing and storage solutions. You will work closely with research and development teams and data...

  • Data Engineer

    4 weeks ago


    Santa Monica, California, United States Ampcus Full time

    At Ampcus, we are seeking a skilled Data Engineer to develop tools for data extraction, analysis, ingestion, transformation, monitoring, and auditing of data archive activities using standard development tools and languages such as SSIS, T-SQL, Python, XQuery, and other standard ETL processes.The ideal candidate will provide documentation for the tools and...


  • Santa Clara, California, United States NVIDIA Full time

    Job DescriptionWe are seeking a highly skilled Sr. Data Engineer, SRE to join our team at NVIDIA. As a key member of our data science and reporting team, you will be responsible for designing and delivering high-performance services and libraries, building streaming data pipelines, and partnering with other engineering and business teams to integrate your...


  • Santa Clara, California, United States MapR Technologies Full time

    Unlock the Power of Big Data with MapR TechnologiesAs a Senior Product Manager, you will play a critical role in driving the strategy, roadmap, and product features of next-generation interactive big data analytics products on MapR.Key Responsibilities:Develop and execute product plans to meet customer needs and market demandsCollaborate with...

  • Senior Data Engineer

    4 weeks ago


    Santa Ana, California, United States Slalom Full time

    About the RoleAs a Senior Data Engineer at Slalom, you will be part of a team that designs and develops data platform solutions. You will use leading data engineering practices to architect, design, and develop data/analytic platforms that are used to produce analytic products, including reports, dashboards, ML models, among others.Key...


  • Santa Clara, California, United States Palo Alto Networks Full time

    About the RoleWe are seeking a highly skilled Senior Principal Software Engineer to join our team at Palo Alto Networks. As a key member of our engineering team, you will be responsible for designing, building, and optimizing data models and queries for speed and scale, using data storage technologies like MySQL and BigQuery.Your ImpactDrive projects from...


  • Santa Barbara, California, United States AppFolio Full time

    We're innovators, changemakers, and collaborators at AppFolio, and we're looking for a Senior Data Science Engineer to join our Data Science & Analytics Department.You'll be expected to communicate cross-functionally to support strategic priorities while extracting deep context on who our customers are, what drives their behavior, decision-making, and...


  • Santa Clara, California, United States SoundHound Full time

    About the Role:We're seeking a highly skilled Data Insights Engineer to join our team at SoundHound. As a key member of our data analytics team, you'll play a crucial role in unlocking the full potential of our vast user data. With hundreds of millions of users across our music app, Hound app, and Houndify platform, we have a treasure trove of insights...


  • Santa Monica, California, United States Amazon Full time

    About the RoleWe are seeking an experienced Senior Software Development Engineer to join our team at Amazon. As a key member of our team, you will be responsible for designing, developing, and deploying scalable and reliable software systems that meet the needs of our customers.Key Responsibilities:Solve complex problems and apply appropriate technologies...

  • Senior Data Engineer

    4 weeks ago


    Santa Clarita, California, United States Capgemini Full time

    Job DescriptionAs a Senior Data Engineer at Capgemini, you will play a key role in building distributed data processing solutions and highly loaded database solutions for various business cases, including reporting, product analytics, marketing optimization, and financial reporting. You will contribute to a self-organized team of experienced data engineers...


  • Santa Monica, California, United States Akraya Full time

    Job Summary:We are seeking a highly skilled Senior Machine Learning Engineer to join our Ad Intelligence team within the Disney Entertainment and ESPN Technology's Ad Platforms organization. As a key member of our team, you will play a pivotal role in transforming advertising by developing leading-edge AI and data-driven solutions.Our mission is to optimize...


  • Santa Monica, California, United States INSPYR Solutions Full time

    Job Title: Senior Software EngineerWe are seeking a highly skilled Senior Software Engineer to join our team at INSPYR Solutions. As a key member of our team, you will be responsible for designing, developing, and deploying software applications using REACT.Key Responsibilities:Craft web application software using REACT, with strong software development...


  • Santa Monica, California, United States Amazon Full time

    The Rewarded Ads team at Amazon is revolutionizing the advertising landscape by enabling advertisers to offer rewards to consumers when they shop on Amazon. As a seasoned data engineer, you will play a crucial role in shaping the technology direction of this young and growing organization.This position offers a unique opportunity to work on a cutting-edge...