Senior Software Big Data Developer

3 weeks ago

Santa Clara, United States LigaDATA Full time

About Ligadata:

Ligadata is a cutting-edge data analytics company that leverages machine learning to empower businesses with actionable insights. We are at the forefront of innovation, providing advanced solutions for data processing, analysis, and decision-making. Join our dynamic team and contribute to shaping the future of data-driven intelligence.

Job Description:

Role Overview:

As a Senior Software Hadoop developer, you will be involved in database management, operating system integration, storage solutions, application processing, and monitoring. The Engineer should have experience in multiple disciplines including Cloud, Linux, and Hadoop. You will lead complex projects and competing priorities with a high level of technical acumen and strong communication skills.

Description:

  • Experience with multiple large-scale open source and Enterprise Hadoop, Data Bricks, Cloudera, HD Insights, or other environments focused on operations, design, capacity planning, cluster setup, security, performance tuning and monitoring
  • Experience with the full Cloudera CDH/CDP distribution to install, configure and monitor all services in the Cloudera stack
  • Strong understanding of core Hadoop services such as HDFS, MapReduce, Kafka, Spark and Spark-Streaming, Hive, Impala, HBase, Kudu, Sqoop, and Oozie
  • Experience in administering, and supporting RHEL Linux operating systems, databases, and hardware in an enterprise environment
  • Expertise in typical system administration and programming skills such as storage capacity management, debugging, performance tuning
  • Proficient in shell scripting (e.g. Bash, KSH, etc)
  • Experience in setup, configuration and management of security for Hadoop clusters using Kerberos with integration with LDAP/AD at an enterprise-level
  • Experience with large enterprise scale, separation of resource concepts and the physical nature of those environments to operate (storage, memory, network, and compute)
Desired Skills:
  • Certifications in one or many disciplines of Cloudera Hadoop, Cloud (Azure, AWS, Google), or RHEL
  • Experience in version control systems (Git)
  • Experience with Spectrum Conductor or Databricks with Apache Spark
  • Experience in different programming languages (Python, Java, R)
  • Enterprise Database Administration Platform Experience
  • Experience In Large Analytic Tools including SAS, Search, Machine Learning, Log Aggregation
  • Experience with Hadoop distributions in the Cloud is a plus, AWS, Azure, Google
  • Experience with the full Cloudera CDH distribution to install, configure and monitor all services in the CDH stack

  • Sr. Software Engineer

    1 day ago

    Santa Clara, United States Petlibro Full time

    About the job About Petlibro Petlibro is a design thinking company creating products that nurture the intertwined lives of pets & their people. We launched with a philosophy that good design, in form & in function, can make a difference. Petlibro innovates with the latest technology to solve everyday problems for the modern pet parents and revolutionize how...

  • Big Data Software Engineer

    1 day ago

    Santa Clara, United States Palo Alto Networks Full time

    PALO ALTO NETWORKS is the fastest-growing security company in history. We offer the chance to be part of an important mission: ending breaches and protecting our way of digital life. If you are a motivated, intelligent, creative, and hardworking individual, then this job is for you! In this service, we ingest tens of terabytes of data daily from several...

  • Sr. Software Engineer

    2 weeks ago

    Santa Clara, United States Petlibro Full time

    About the jobAbout PetlibroPetlibro is a design thinking company creating products that nurture the intertwined lives of pets & their people. We launched with a philosophy that good design, in form & in function, can make a difference. Petlibro innovates with the latest technology to solve everyday problems for the modern pet parents and revolutionize how we...

  • Sr. Software Engineer

    2 weeks ago

    Santa Clara, United States Petlibro Full time

    About the jobAbout PetlibroPetlibro is a design thinking company creating products that nurture the intertwined lives of pets & their people. We launched with a philosophy that good design, in form & in function, can make a difference. Petlibro innovates with the latest technology to solve everyday problems for the modern pet parents and revolutionize how we...

  • Senior Software Engineering Manager

    2 days ago

    Santa Clara, United States Big Cloud Full time

    We're looking for a creative, analytical and experienced Engineering Manager to join a world-class OS Architecture team (Santa Clara, Hybrid).This is a leading international semiconductor company building AI processors that enable data centres to perform computations for AI services on a huge scale. The team are seeing lots of market success, and you'd be...

  • Senior Software Engineering Manager

    1 day ago

    Santa Clara, United States Big Cloud Full time

    We're looking for a creative, analytical and experienced Engineering Manager to join a world-class OS Architecture team (Santa Clara, Hybrid).This is a leading international semiconductor company building AI processors that enable data centres to perform computations for AI services on a huge scale. The team are seeing lots of market success, and you'd be...

  • Big Data Developer

    1 day ago

    Santa Monica, United States Diamondpick Full time

    Software Engineer (14280593)Santa Monica, CAContractClient Location: HU_2500B 2500 BROADWAY STREET 2500 Broadway Street Santa Monica CA 90404 Responsibilities:● Design, architect, develop, scale, and improve our data platform and its services● Implement large-scale high-throughput solutions using on-premise and cloud● technologies such as Kafka, Spark...

  • Embedded Software Engineer

    2 days ago

    Santa Clara, United States Big Cloud Full time

    Are you interested in advancing the deployment of AI and cloud technologies?Do you possess robust development/systems engineering skills?Are you experienced in intricate software systems, particularly with Linux on embedded systems (RTOS)?We're seeking a Lead RTOS Architect with a good mix of technical leadership, creativity and analytical skills for a...

  • Embedded Software Engineer

    1 day ago

    Santa Clara, United States Big Cloud Full time

    Are you interested in advancing the deployment of AI and cloud technologies?Do you possess robust development/systems engineering skills?Are you experienced in intricate software systems, particularly with Linux on embedded systems (RTOS)?We're seeking a Lead RTOS Architect with a good mix of technical leadership, creativity and analytical skills for a...

  • Big Data Developer

    2 days ago

    Santa Monica, United States Milestone Technologies, Inc. Full time

    Senior Bigdata Engineer (Java/Scala)Location: Santa Monica; CA or Glendale; CA or San Francisco; CA or Seattle; WA6 Months ContractSeeking a Software Developer (Bigdata/Scala/Java) who will be an extraordinary addition to our growing team. You will help build our next-generation data analytics platform utilizing the most advanced big data technologies. You...

  • Senior Firmware Engineer

    2 days ago

    Santa Clara, United States Big Cloud Full time

    We're looking for a creative, analytical and experienced Firmware Engineer to join a world-class software team in Santa Clara (Hybrid).This is a leading international semiconductor company building AI processors that are transforming computer vision, language processing, reinforcement learning and a lot more. The team is seeing lots of market success, and...

  • Senior Firmware Engineer

    2 days ago

    Santa Clara, United States Big Cloud Full time

    We're looking for a creative, analytical and experienced Firmware Engineer to join a world-class software team in Santa Clara (Hybrid).This is a leading international semiconductor company building AI processors that are transforming computer vision, language processing, reinforcement learning and a lot more. The team is seeing lots of market success, and...

  • Senior Firmware Engineer

    1 day ago

    Santa Clara, United States Big Cloud Full time

    We're looking for a creative, analytical and experienced Firmware Engineer to join a world-class software team in Santa Clara (Hybrid).This is a leading international semiconductor company building AI processors that are transforming computer vision, language processing, reinforcement learning and a lot more. The team is seeing lots of market success, and...

  • Senior Software Engineer

    3 weeks ago

    Santa Clara, United States Solomon Page Full time

    Our client, a software company, is looking to fill the role of Senior Software Engineer- Backend Development. This position will be hybrid and based out of the Santa Clara office. We are seeking Senior Software Engineer with expertise in Backend Development to contribute to the design, development, and deployment of a robust and scalable cloud-based...

  • Senior Software Engineer

    3 weeks ago

    Santa Clara, United States Solomon Page Full time

    Our client, a software company, is looking to fill the role of Senior Software Engineer- Backend Development. This position will be hybrid and based out of the Santa Clara office. We are seeking Senior Software Engineer with expertise in Backend Development to contribute to the design, development, and deployment of a robust and scalable cloud-based...

  • Senior Software Engineer

    3 weeks ago

    Santa Clara, United States Solomon Page Full time

    Our client, a software company, is looking to fill the role of Senior Software Engineer- Backend Development. This position will be hybrid and based out of the Santa Clara office. We are seeking Senior Software Engineer with expertise in Backend Development to contribute to the design, development, and deployment of a robust and scalable cloud-based...

  • Embedded Software Engineer

    1 week ago

    Santa Clara, United States L4B Software Full time

    Job DescriptionL4B Software is a cutting-edge technology company specializing in Embedded systems and Linux-based solutions. We are at the forefront of innovation, developing advanced software solutions that power a wide range of devices across various industries. As we continue to grow, we are seeking passionate and talented individuals to join our...

  • Senior Software Engineer

    3 days ago

    Santa Clara, United States Polaris Wireless Full time

    Polaris solutions continually process massive accurate cell-phone geolocation data covering all subscribers across the entire country. Analytics are used to convert this massive data flow into various applications that benefit our end-customers. The Aigis product backend includes the WINT platform. The WINT platform processes incoming events and computes...

  • Senior Software Engineer

    3 days ago

    Santa Clara, United States Polaris Wireless Full time

    Polaris solutions continually process massive accurate cell-phone geolocation data covering all subscribers across the entire country. Analytics are used to convert this massive data flow into various applications that benefit our end-customers. The Aigis product backend includes the WINT platform. The WINT platform processes incoming events and computes...

  • Senior Java developer Opurtun

    2 weeks ago

    Santa Clara, United States Omega Solutions Full time

    Senior Java Developer Client: Altimetrik / Oportun San Jose, CA (Remote) Requirement: •Strong Java developer with very good understanding of micro services and over 10 years of experience •Solid Experience in managing data warehouses and ETL pipelines (Min. 2 years) •Strong analytical and problem-solving skills (Math skills required for data analysis...