Big Data Engineer

5 days ago

Santa Monica, CA, United States KellyMitchell Group Full time
Job Summary:
Our client is seeking a Big Data Engineer to join their team This position is located in Santa Monica, California.

Duties:
  • Design and build core components of a large-scale data platform for both real-time and batch processing, owning key features of big data applications that evolve with business needs
  • Develop next-generation, cloud-based big data infrastructure supporting batch and streaming workloads, with continuous improvements to performance, scalability, reliability, and availability
  • Champion engineering excellence, promoting best practices such as design patterns, CI/CD, thorough code reviews, and automated testing
  • Drive innovation, contributing new ideas and applying cutting-edge technologies to deliver impactful solutions
  • Participate in the full software development lifecycle, including system design, experimentation, implementation, deployment, and testing
  • Collaborate closely with program managers, product managers, SDETs, and researchers in an open, agile, and highly innovative environment
Desired Skills/Experience:
  • Bachelor's degree in a STEM field such as: Science, Technology, Engineering, Mathematics
  • 5+ years of relevant professional experience
  • 4+ years of professional software development experience using Java, Scala, Python, or similar programming languages
  • 3+ years of hands-on big data development experience with technologies such as Spark, Flink, SingleStore, Kafka, NiFi, and AWS big data tools
  • Strong understanding of system and application design, architecture principles, and distributed system fundamentals
  • Proven experience building highly available, scalable, and production-grade services
  • Genuine passion for technology, with the ability to work across interdisciplinary areas and adopt new tools or approaches
  • Experience processing massive datasets at the petabyte scale
  • Proficiency with cloud infrastructure and DevOps tools, such as Terraform, Kubernetes (K8s), Spinnaker, IAM, and ALB
  • Hands-on experience with modern data warehousing and analytics platforms, including ClickHouse, Druid, Snowflake, Impala, Presto, Kinesis, and more
  • Familiarity with common web development frameworks, such as Spring Boot, React.js, Vue.js, or Angular
Benefits:
  • Medical, Dental, & Vision Insurance Plans
  • Employee-Owned Profit Sharing (ESOP)
  • 401K offered
The approximate pay range for this position is between $52.00 and $75.00. Please note that the pay range provided is a good faith estimate. Final compensation may vary based on factors including but not limited to background, knowledge, skills, and location. We comply with local wage minimums.

  • Senior Software Engineer, Big Data

    2 weeks ago

    Santa Monica, CA, United States ZipRecruiter Full time

    We offer a hybrid work environment. Most US-based positions can alsobeperformed remotely (any exceptions will be noted in the Minimum Qualifications below.) Our Mission: To actively connect people to their next great opportunity. Who We Are: ZipRecruiter is a leading online employment marketplace. Powered by AI-driven smart matching technology, the...

  • Principal Big Data Engineer

    5 days ago

    Santa Clara, CA, United States Right Skale, Inc. Full time

    Principal Big Data Engineer - Extendible Contract - Onsite (Santa Clara, CA) This role will be available in Santa Clara, CA, and local candidates are strongly preferred. About you: As a Principal Big Data Engineer, you will be an integral member of our data ingestion and processing platform team responsible for architecture, design, and development. Key...

  • Principal Big Data Engineer

    3 days ago

    Santa Clara, CA, United States Right Skale, Inc. Full time

    Principal Big Data Engineer - Extendible Contract - Onsite (Santa Clara, CA) This role will be available in Santa Clara, CA, and local candidates are strongly preferred. About you: As a Principal Big Data Engineer, you will be an integral member of our data ingestion and processing platform team responsible for architecture, design, and development. Key...

  • Principal Big Data Engineer

    7 days ago

    Santa Clara, CA, United States Right Skale, Inc. Full time

    Principal Big Data Engineer - Extendible Contract - Onsite (Santa Clara, CA) This role will be available in Santa Clara, CA, and local candidates are strongly preferred. About you: As a Principal Big Data Engineer, you will be an integral member of our data ingestion and processing platform team responsible for architecture, design, and development. Key...

  • Principal Big Data Engineer

    5 days ago

    Santa Clara, CA, United States Right Skale, Inc. Full time

    Principal Big Data Engineer - Extendible Contract - Onsite (Santa Clara, CA) This role will be available in Santa Clara, CA, and local candidates are strongly preferred. About you: As a Principal Big Data Engineer, you will be an integral member of our data ingestion and processing platform team responsible for architecture, design, and development. Key...

  • Principal Engineer Software

    2 weeks ago

    Santa Clara, CA, United States Palo Alto Networks Full time

    Company DescriptionOur Mission At Palo Alto Networks® everything starts and ends with our mission: Being the cybersecurity partner of choice, protecting our digital way of life. Our vision is a world where each day is safer and more secure than the one before. We are a company built on the foundation of challenging and disrupting the way things are done,...

  • Principal Engineer Software

    2 weeks ago

    Santa Clara, CA, United States Palo Alto Networks Full time

    Company DescriptionOur Mission At Palo Alto Networks® everything starts and ends with our mission: Being the cybersecurity partner of choice, protecting our digital way of life. Our vision is a world where each day is safer and more secure than the one before. We are a company built on the foundation of challenging and disrupting the way things are done,...

  • Principal Engineer Software

    7 days ago

    Santa Clara, CA, United States Palo Alto Networks Full time

    Company DescriptionOur Mission At Palo Alto Networks® everything starts and ends with our mission: Being the cybersecurity partner of choice, protecting our digital way of life. Our vision is a world where each day is safer and more secure than the one before. We are a company built on the foundation of challenging and disrupting the way things are done,...

  • Sr. SDET

    7 days ago

    Santa Monica, CA, United States aKube, Inc. Full time

    Job Description City: Santa Monica, CA Onsite/ Hybrid/ Remote:Onsite (4 days a week) Duration: 12 months Rate Range: Up to$96/hr on W2 depending on experience (no C2C or 1099 or sub-contract) Work Authorization: GC, USC, All valid EADs except OPT, CPT, H1B Must Have: Strong Python development skills (will be tested in CoderPad) RESTful API testing...

  • Senior Big Data Infrastructure Administrator

    1 week ago

    Santa Clara, CA, United States InfoCepts Full time

    Big Data Infrastructure Administrator About Our Team: The Big Data Operations team is dedicated to empowering organizations to leverage the potential of Big Data through a robust and dependable platform. We are in the process of developing an advanced Big Data infrastructure on AWS while ensuring the scalability and maintenance of our existing systems in the...