Big Data Software Engineer

2 weeks ago


Santa Clara, United States Palo Alto Networks Full time

PALO ALTO NETWORKS® is the fastest-growing security company in history.  We offer the chance to be part of an important mission: ending breaches and protecting our way of digital life. If you are a motivated, intelligent, creative, and hardworking individual, then this job is for you

In this service, we ingest tens of terabytes of data daily from several sources into the system. As the historical data is always valuable for analysis and correlation (i.e. the malware does not expire), the total amount of storage can easily get to peta bytes. By doing several data correlation among this vast amount of data, we can provide intelligence to our customers to help them prioritize threats and decide what actions they should take.

RESPONSIBILITIES:

  • As a Big Data Software Engineer, you will be an integral member of our threat intelligence service, i.e. auto focus, team responsible for architecture, design and development.
  • Having the dynamic ability to adapt to conventional big-data frameworks and tools with the use-cases required by the project
  • Ability to communicate with research teams and data scientists, finding bottlenecks and resolving them
  • Design and implement different architectural models for our scalable data processing, as well as scalable data storage
  • Build tools for proper data ingestion from multiple heterogeneous sources

QUALIFICATIONS:

  • 2+ years of experience in design and implementation in an environment with hundreds of terabytes of data

  • 4+ years of experience with large data processing tools such as: Hadoop, HBase, Elastic Search, etc.

  • 2+ years experience with Java

  • Passion for doing research on large data sets containing ill-formatted data

  • Can-do attitude on problem solving, quality and ability to execute

  • Excellent inter-personal and teamwork skills

  • BS in Computer Science/Engineering, or equivalent experience

    Learn more about Palo Alto Networks here and check out our fast facts

    #LI-PALSAAS



  • Santa Clara, United States Petlibro Full time

    About the jobAbout PetlibroPetlibro is a design thinking company creating products that nurture the intertwined lives of pets & their people. We launched with a philosophy that good design, in form & in function, can make a difference. Petlibro innovates with the latest technology to solve everyday problems for the modern pet parents and revolutionize how we...


  • Santa Clara, United States Petlibro Full time

    About the jobAbout PetlibroPetlibro is a design thinking company creating products that nurture the intertwined lives of pets & their people. We launched with a philosophy that good design, in form & in function, can make a difference. Petlibro innovates with the latest technology to solve everyday problems for the modern pet parents and revolutionize how we...


  • Santa Clara, United States Palo Alto Networks Full time

    PALO ALTO NETWORKS® is the fastest-growing security company in history.  We offer the chance to be part of an important mission: ending breaches and protecting our way of digital life. If you are a motivated, intelligent, creative, and hardworking individual, then this job is for you! We are ushering in the future of security innovation and reinventing...

  • Big Data Engineer

    2 weeks ago


    Santa Clara, United States Omega Solutions Full time

    Big Data Engineer San Jose, CA (Remote) Experian • Need 8Yrs of experience and Hands on programing experience in any one or more programing languages like Java, Scala or Python • Good experience with Distributed systems like Hadoop, HDFs and No SQL databases • Experience in Spark, Hive or Presto • Experience with AWS cloud services: EC2, EMR, Athena...


  • Santa Clara, California, United States Palo Alto Networks Full time

    Job Description Your Career We are seeking an experienced Big Data Software Engineer to design, develop and deliver next-generation technologies within our Prisma Access team. We want passionate engineers who love to code and build great products. Engineers who bring new ideas in all facets of software development. Collaboration and teamwork are at the...


  • Santa Clara, United States LigaDATA Full time

    About Ligadata: Ligadata is a cutting-edge data analytics company that leverages machine learning to empower businesses with actionable insights. We are at the forefront of innovation, providing advanced solutions for data processing, analysis, and decision-making. Join our dynamic team and contribute to shaping the future of data-driven intelligence. Job...


  • Santa Clara, United States LigaDATA Full time

    About Ligadata: Ligadata is a cutting-edge data analytics company that leverages machine learning to empower businesses with actionable insights. We are at the forefront of innovation, providing advanced solutions for data processing, analysis, and decision-making. Join our dynamic team and contribute to shaping the future of data-driven intelligence. Job...


  • Santa Monica, United States NR Consulting Full time

    Job Title: Sr. Big Data Engineer Duration: FTE /Permanent Hiring Location: Santa Monica CA ( Remote Till Covid ) Description: 5+ years of data engineering experience developing large data pipelines Strong SQL skills and ability to create queries to extract data and build performant datasets Hands-on experience with distributed systems such as Spark, Hadoop...

  • Sr. Big Data Engineer

    2 weeks ago


    Santa Monica, United States NR Consulting Full time

    Job Title: Sr. Big Data Engineer Duration: FTE /Permanent Hiring Location: Santa Monica CA ( Remote Till Covid )Description: 5+ years of data engineering experience developing large data pipelines Strong SQL skills and ability to create queries to extract data and build performant datasets Hands-on experience with distributed systems such as Spark, Hadoop...


  • Santa Clara, United States SoundHound Full time

    SOUNDHOUND INC. TURNS SOUND INTO UNDERSTANDING AND ACTIONABLE MEANING. We believe in enabling humans to interact with the things around them in the same way we interact with each other: by speaking naturally to mobile phones, cars, TVs, music speakers, coffee machines, and every other part of the emerging 'connected' world. Our latest product, Hound,...


  • Santa Clara, United States Telenav Full time

    Do you dream of what cars of the future will look like when you combine them with connectivity, a smartphone, and cloud services? Can you imagine uniting those dreams with a company that has the skills and relationships to make that a reality? If so, Telenav wants you! At Telenav, we believe the car is at the beginning of a massive innovation wave that...


  • Santa Clara, United States Telenav Full time

    Do you dream of what cars of the future will look like when you combine them with connectivity, a smartphone, and cloud services? Can you imagine uniting those dreams with a company that has the skills and relationships to make that a reality? If so, Telenav wants you! At Telenav, we believe the car is at the beginning of a massive innovation wave that...

  • Data Engineer

    2 weeks ago


    Santa Clara, United States InterSources Full time

    Title: Data Engineer Location: Remote Experience: 4+ Years About the Role Fintech is seeking a strong and passionate data engineer with experience in large scale system implementation, with a focus on complex data pipelines. The candidate must be able to design and drive large projects from inception to production. The right person will work with PMs,...

  • Senior Data Engineer

    2 weeks ago


    Santa Clara, United States NVIDIA Full time

    We are looking for a Sr. Data Engineer - Data Science Platform. At NVIDIA, we pride ourselves on data-driven decision-making, and the data science team is at the heart of this initiative. We are looking for an excellent Sr. Data engineer with extensive data engineering experience for our data science platform supporting NVIDIA's cloud platform services. Our...

  • Software Engineer

    4 weeks ago


    Santa Clara, United States Selector Software Full time

    Job DescriptionJob DescriptionSalary: About UsSelector is building an operational intelligence platform for digital infrastructure. By adopting an AI/ML-based analytics approach, the platform provides actionable multi-dimensional insights to network, cloud, and application operators. It enables operations teams to meet their KPIs through seamless...


  • Santa Clara, United States Telenav Full time

    Do you dream of what cars of the future will look like when you combine them with connectivity, a smartphone, and cloud services? Can you imagine uniting those dreams with a company that has the skills and relationships to make that a reality? If so, Telenav wants you! At Telenav, we believe the car is at the beginning of a massive innovation wave that...


  • Santa Clara, United States Resource Point LLC Full time

    Job DescriptionJob DescriptionJob title: Software Development EngineerLocation: Santa Clara, CA (Onsite from day one)Duration: 12 Months CTH Job Description: Candidate will participate in a focused effort to develop and productize ground-breaking solutions that will redefine the world of transportation and the growing field of self-driving cars. You will...


  • Santa Clara, California, United States Palo Alto Networks Full time

    Job Description Your Career Bring your backend java cloud engineering skills to work on the latest cloud software/web applications. Help us deploy and scale the next generation of cloud security utilizing big data and Analytics. We are looking for a Principal Engineer to join the team that is building our latest cloud security product - Data Loss...


  • Santa Clara, United States MapR Technologies Full time

    ABOUT MAPR TECHNOLOGIES MapR Technologies, a provider of the industry’s leading data platform for AI and Analytics, enables enterprises to inject analytics into their business processes to increase revenue, reduce costs, and mitigate risks. MapR addresses the data complexities of high-scale and mission-critical distributed processing from the cloud to the...


  • Santa Clara, California, United States SafeAI Full time

    SafeAI is seeking a highly skilled Senior Software Engineer with expertise to join our dynamic and forward-thinking organization. You'll tackle numerous novel simulation and data infra challenges, employing innovative and creative solutions. Operating within a highly collaborative environment, you'll collaborate closely with teams across the stack, driving...