Hadoop Platform Engineer

3 weeks ago


San Jose, United States RAMPS International Inc. Full time
Job DescriptionJob Description

Hadoop Platform Engineer
San Jose, CA
4-12 Months

Position summary
The Data and Analytics Platform team resides within Adobe's Information and Data Services team and we are looking for a Hadoop Platform Engineer who will be responsible for the implementation and ongoing administration of Hadoop infrastructure including designing, deploying, monitoring, tuning and troubleshooting.

Job Responsibilities
Responsibilities:
• Design and develop different architectural models for our scalable data processing as well as scalable data storage
• Build data pipelines and ETL using heterogeneous sources
• Build data ingestion from various source systems to Hadoop using Kafka, Flume, Sqoop, Spark Streaming etc.
• Transform data using data mapping and data processing capabilities like MapReduce, Spark SQL
• Supports Big Data and batch/real time analytical solutions
• Own the platform architecture and drive it to the next level of effectiveness to support current and future requirements
• Design, implement, deploy and maintain security, data capacity, node forecasting and planning.
• Provide hardware architectural guidance, plan and estimate cluster capacity, and create roadmaps for the Hadoop cluster deployment.
• Closely work with the Hadoop development, infrastructure, network, database, and business intelligence teams.
• Participate in a 12x7 rotation for production issue escalations.
• Communicate effectively with people at all levels of the organization.

Requirements:
• B.S. degree in Computer Science, Electrical and Computer Engineering, or equivalent technical fields.
• Experience in tools integration, automation, configuration management systems.
• Experience with networking, systems administration skills.
• 3+ years of hands on working experience on Hadoop infrastructure stack (Ex: HDFS, MapReduce, HBase, Flume, Spark, Pig, Hive, Oozie, YARN, Zookeeper, Presto, etc). 2+ years of experience in Python or Perl.
• MapReduce, Hbase, Hive, Impala, Spark, Kafka, Kudu, Solr)
• Strong development/automation skills. Must be very comfortable with reading and writing Scala, Python or Java code.
• Proven Ability to build Curated Models for BI and Analytics
• Strong SQL Skills

Best regards,
 
Sridhar P
Senior Recruiter | RAMPS International, Inc
1199 Amboy Ave, Suite 2F, Edison, NJ 08837
email:  sridhar@rampscorp.com |url: www.rampscorp.com



  • San Jose, United States RAMPS International Inc. Full time

    Job DescriptionJob DescriptionHadoop Platform EngineerSan Jose, CA4-12 MonthsPosition summaryThe Data and Analytics Platform team resides within Adobe's Information and Data Services team and we are looking for a Hadoop Platform Engineer who will be responsible for the implementation and ongoing administration of Hadoop infrastructure including...

  • Hadoop Engineer

    3 weeks ago


    San Jose, United States OrgSpire Full time

    Wanted 1 -2 years of experience working on Hadoop eco system. Strong understanding of Hadoop distributions ( Cloudera 5.x Hortonworks ..) Hands-on working experience on any one or two of Hadoop technologies (HDFS Hive Impala Sqoop UDF Oozie Map reduce Spark Framework etc.). Strong understanding of any one of the different file formats (e.g. AVRO ORC...

  • Hadoop Engineer

    3 weeks ago


    San Jose, California, United States OrgSpire Full time

    Wanted 1 -2 years of experience working on Hadoop eco system. Strong understanding of Hadoop distributions ( Cloudera 5.x Hortonworks ..) Hands-on working experience on any one or two of Hadoop technologies (HDFS Hive Impala Sqoop UDF Oozie Map reduce Spark Framework etc.). Strong understanding of any one of the different file formats (e.g. AVRO ORC Parquet...


  • San Jose, United States HireIO Inc Full time

    Team Introduction: Our mission in experimentation and evaluation team is to build the next-gen A/B testing platform, that empowers the company to make data-driven decision for the products. The supported scenarios include recommendation, push, ads, search, mobile app, UI interaction and service upgrades etc. Our platform's capabilities cover the entire...


  • San Jose, United States Hireio, Inc. Full time

    Job DescriptionJob DescriptionTeam Introduction:Our mission in experimentation and evaluation team is to build the next-gen A/B testing platform, that empowers the company to make data-driven decision for the products. The supported scenarios include recommendation, push, ads, search, mobile app, UI interaction and service upgrades etc. Our platform's...


  • San Francisco, United States Motion Recruitment Full time

    Our large crypto company is looking for a contract Data Platform Engineer. This is a remote contract position. Contract Duration: 12-Months Required Skills & Experience 4+ years of relevant work experience. Fluent SQL skills for ETL/ELT, data quality, and reporting. Strong Python or Spark backend development skills. General experience working...

  • Platform Engineer

    1 week ago


    San Antonio, United States IAMUS Consulting Inc Full time

    Job Description We are looking for a Cloud Platform Engineer with experience in Cloud technology (AWS), Python programming skills, and a strong Linux foundation. Will significantly contribute to the development of custom software components and integration of open-source code to address complex time series analysis problems through the use of cutting edge...

  • Hadoop developer

    4 weeks ago


    San Francisco, California, United States MicroNet IT solutions inc Full time

    Responsibilities. Write software to interact with HDFS and MapReduce. Assess requirements and evaluate existing solutions. Build operate monitor and troubleshoot Hadoop infrastructure. Develop tools and libraries and maintain processes for other engineers to access data and write MapReduce programs.

  • Hadoop Admin

    1 week ago


    San Antonio, United States eTeam Full time

    Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions. This is not intended to be an all-inclusive list of job duties and the position will perform other duties as assigned . Hands-on experience on Cloudera installation, configuration, debugging, tuning and administration. Collaborate and assist...

  • Hadoop Admin

    14 hours ago


    San Antonio, United States eTeam Full time

    Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions. This is not intended to be an all-inclusive list of job duties and the position will perform other duties as assigned . Hands-on experience on Cloudera installation, configuration, debugging, tuning and administration. Collaborate and assist...

  • Platform Engineer

    4 weeks ago


    San Francisco, California, United States Watchtower AI Full time

    "As an early Platform Engineer at Watchtower, you'll enable us to deliver our platform reliably, securely, and at massive scale. You'll help architect low latency, real-time microservices that process & detect sensitive data at scale.Responsibilities:Building highly-available and secure authentication and API servicesMaintaining and evolving mission-critical...


  • San Jose, California, United States SMASH Full time

    The rolePlatform Engineers at One are responsible for providing a stable, secure, and efficient platform that upholds our high standards of security and compliance, ultimately ensuring customer trust and business success.Besides writing, reviewing, and shipping code, engineers collaborate with others across the company, from product, design, and data to,...

  • Platform Engineer

    3 weeks ago


    San Francisco, United States Watchtower AI Full time

    "As an early Platform Engineer at Watchtower, you’ll enable us to deliver our platform reliably, securely, and at massive scale. You’ll help architect low latency, real-time microservices that process & detect sensitive data at scale.Responsibilities:Building highly-available and secure authentication and API servicesMaintaining and evolving...

  • Systems Engineer

    1 day ago


    San Jose, United States RIT Solutions, Inc. Full time

    Job Description The Client`s Platform Integration Team is looking for an innovative, Systems Engineer, with a passion for learning, to focus on Platform System Integration. The successful candidate will work with customers and leadership as well as internal software and hardware engineering teams to integrate client`s products into various customer...


  • San Jose, United States Indotronix Avani Group Full time

    Job Title: Sr. DevOps Platform EngineerLocation: San Jose, CA, USA, 95131 (Hybrid – 3 days per week onsite)Duration: 6 monthsJob Description:We are looking for candidates with deep fundamental knowledge of containerization, CI/CD pipeline designs, and integration of Azure DevOps Services with hybrid infrastructure. Must have strong and current hands-on...


  • San Jose, United States Indotronix Avani Group Full time

    Job Title: Sr. DevOps Platform EngineerLocation: San Jose, CA, USA, 95131 (Hybrid – 3 days per week onsite)Duration: 6 monthsJob Description:We are looking for candidates with deep fundamental knowledge of containerization, CI/CD pipeline designs, and integration of Azure DevOps Services with hybrid infrastructure. Must have strong and current hands-on...


  • San Jose, United States Indotronix Avani Group Full time

    Job Title: Sr. DevOps Platform EngineerLocation: San Jose, CA, USA, 95131 (Hybrid – 3 days per week onsite)Duration: 6 monthsJob Description:We are looking for candidates with deep fundamental knowledge of containerization, CI/CD pipeline designs, and integration of Azure DevOps Services with hybrid infrastructure. Must have strong and current hands-on...


  • San Jose, United States Nutanix Full time

    Hungry, Humble, Honest, with Heart. The Opportunity We are seeking a talented and experienced Software Quality Engineer who can drive high-quality standards for software features and products developed within the Nutanix Platform organization.  You have a QA mindset and will contribute to defining and executing an effective overall QA strategy for the team....


  • San Jose, United States Bayone Full time

    Location: San Francisco, Seattle, LA or PST Enterprise Data Platform to enable timely, effective and safe sharing of data to multiple engineering, operations and business teams for building world class data products Responsibilities Build data ingestion and processing pipelines to enable data analytics and data science use-cases in areas of digital...


  • San Diego, California, United States ServiceNow Full time

    Job Description Please Note:   This position requires passing a ServiceNow background screening, USFedPASS (US Federal Personnel Authorization Screening Standards). This includes a credit check, criminal/misdemeanor check and taking a drug test. Any employment is contingent upon passing the screening.  Due to Federal requirements, only US citizens, US...