Hadoop Developer

3 weeks ago


plano, United States Photon Full time

Hadoop Data Engineer is a hybrid role with experiences in database management, clustered compute, operating system integration, cloud concepts, storage solutions, application processing, and advanced monitoring techniques. The resource has experience in multiple disciplines including Cloud, Linux as well as Hadoop. Must be able to lead complex projects and competing priorities with a high level of technical acumen and strong communication skills.


Must have skills required: Hive, Scoop, Impala & Spark


Required Skills:

  • Experience with multiple large-scale Enterprise Hadoop or Big Data, Data Bricks, Cloudera, HD Insights, or other environments focused on operations, design, capacity planning, cluster set up, security, performance tuning and monitoring
  • Experience with the full Cloudera CDH/CDP distribution to install, configure and monitor all services in the Cloudera stack
  • Strong understanding of core Hadoop services such as HDFS, MapReduce, Kafka, Spark and Spark-Streaming, Hive, Impala, HBASE, Kudu, Sqoop, and Oozie
  • Experience in administering, and supporting RHEL Linux operating systems, databases, and hardware in an enterprise environment
  • Expertise in typical system administration and programming skills such as storage capacity management, debugging, performance tuning
  • Proficient in shell scripting (e.g. Bash,ksh,etc)
  • Experience in setup, configuration and management of security for Hadoop clusters using Kerberos with integration with LDAP/AD at an Enterprise level
  • Experience with large enterprise scale, separation of resource concepts and the physical nature for those environments to operate (storage, memory, network, and compute)


Desired Skills:

  • Experience in version control systems (Git)
  • Experience with Spectrum Conductor or Databricks with Apache Spark
  • Experience in different programming languages (Python, Java, R)
  • Enterprise Database Administration Platform Experience
  • Experience In Large Analytic Tools including SAS, Search, Machine Learning, Log Aggregation
  • Experience with Hadoop distributions in the Cloud is a plus, AWS, Azure, Google
  • Experience with the full Cloudera CDH distribution to install, configure and monitor all services in the CDH stack

  • Hadoop Developer

    4 weeks ago


    Plano, Texas, United States Photon Full time

    Job Title: Hadoop DeveloperJob Description:We are seeking a highly skilled Hadoop Developer to join our team at Photon. As a Hadoop Developer, you will be responsible for designing, implementing, and maintaining large-scale data processing systems using Hadoop and related technologies.Key Responsibilities:Design and implement data processing pipelines using...

  • Hadoop Developer

    4 weeks ago


    Plano, Texas, United States ApTask Full time

    About ApTask:ApTask is a leading global provider of workforce solutions and talent acquisition services, dedicated to shaping the future of work. As an African American-owned and Veteran-certified company, ApTask offers a comprehensive suite of services, including staffing and recruitment solutions, managed services, IT consulting, and project management.Job...


  • Plano, Texas, United States Insight Global Full time

    Job Title: Senior Hadoop DeveloperJob Summary:We are seeking a skilled Senior Hadoop Developer to join our team at Insight Global. As a Senior Hadoop Developer, you will be responsible for designing, developing, and maintaining software applications using Hadoop and big data technologies.Key Responsibilities:Develop and maintain ETL processes using Hadoop...

  • Hadoop Developer

    1 month ago


    Plano, United States Photon Full time

    Hadoop Data Engineer is a hybrid role with experiences in database management, clustered compute, operating system integration, cloud concepts, storage solutions, application processing, and advanced monitoring techniques. The resource has experience in multiple disciplines including Cloud, Linux as well as Hadoop. Must be able to lead complex projects and...


  • Plano, United States BCforward Full time

    Hadoop & ETL DeveloperBCforward is currently seeking a highly motivated " Hadoop & ETL Developer " for an opportunity in - Plano, TX 75024.Position Title : Hadoop & ETL DeveloperLocation: Plano, TX 75024 Job Posting Expected Start Date: ASAP (Please note this is the target date and is subject to change. BCforward will send official notice ahead of a...


  • Plano, United States Mitchell Martin Inc. Full time

    Hadoop - Data Engineer role in Plano, TX, or Richmond, VA or Atlanta, GA (HYBRID, 3 DAYS ONSITE PER WEEK)Duration: 12 to 18 monthsONLY W2Required Skills:• 6 - 8 years' hands on experience in coding for the following Hadoop Eco System: Java, Python, Spark/Scala, Kafka, Autosys, Shell Scripting.• Strong experience in Apache Spark development• Have...


  • plano, United States Mitchell Martin Inc. Full time

    Hadoop - Data Engineer role in Plano, TX, or Richmond, VA or Atlanta, GA (HYBRID, 3 DAYS ONSITE PER WEEK)Duration: 12 to 18 monthsONLY W2Required Skills:• 6 - 8 years' hands on experience in coding for the following Hadoop Eco System: Java, Python, Spark/Scala, Kafka, Autosys, Shell Scripting.• Strong experience in Apache Spark development• Have...

  • Hadoop Developer

    3 weeks ago


    plano, United States Insight Global Full time

    A large financial services client is seeking an Informatica/Hadoop Developer to join their growing team. This individual will support production (L3) in Treasury. This resource will be responsible for understanding design, propose high level and detailed design solutions, propose out of box technical solutions for resolving business problems and technical...

  • Hadoop Developer

    3 weeks ago


    Plano, United States Insight Global Full time

    A large financial services client is seeking an Informatica/Hadoop Developer to join their growing team. This individual will support production (L3) in Treasury. This resource will be responsible for understanding design, propose high level and detailed design solutions, propose out of box technical solutions for resolving business problems and technical...

  • Hadoop Developer

    3 weeks ago


    plano, United States Insight Global Full time

    A large financial services client is seeking an Informatica/Hadoop Developer to join their growing team. This individual will support production (L3) in Treasury. This resource will be responsible for understanding design, propose high level and detailed design solutions, propose out of box technical solutions for resolving business problems and technical...

  • Hadoop Developer

    3 weeks ago


    Plano, United States Tata Consultancy Services Full time

    Hadoop DeveloperValid Work Authorization: USC, GC, GC EAD Only Location : Newark, DE OR Plano, TX Experience Required: 7+ Years Experience Roles and Responsibilities:7+ Years of experience in the data warehousing architectural approaches and minimum 4 years of experience in Big data(Cloudera).Exposure to and strong working knowledge on distributed...


  • Plano, Texas, United States Photon Full time

    Greetings from Photon, a leading Digital Experience provider. For the past 20 years, we have empowered numerous Fortune 100 companies with innovative solutions. Our team of over 6000 experts across the globe is dedicated to Digital Modernization. To learn more about us, please check our brief video.Location: Onsite/HybridHiring Type: Full TimeWe are seeking...


  • Plano, Texas, United States The Cigna Group Full time

    Job SummaryWe are seeking a highly skilled Senior Hadoop Engineer to join our team at The Cigna Group. As a key member of our Data Engineering team, you will be responsible for designing, developing, and supporting Cloudera Hadoop systems.Key ResponsibilitiesDesign and implement complex big data deploymentsDevelop and maintain automation scripts using...


  • Plano, United States Infosys Full time

    Infosys is seeking a Hadoop and Spark Lead Developer. In this role, you will enable digital transformation for our clients in a global delivery model, research on technologies independently, recommend appropriate solutions and contribute to technology-specific best practices and standards. You will be responsible to interface with key stakeholders and apply...


  • plano, United States Infosys Full time

    Infosys is seeking a Hadoop and Spark Lead Developer. In this role, you will enable digital transformation for our clients in a global delivery model, research on technologies independently, recommend appropriate solutions and contribute to technology-specific best practices and standards. You will be responsible to interface with key stakeholders and apply...


  • Plano, United States Matlen Silver Full time

    Python/Hadoop Developer - W2 - Onsite in Plano TX (IN-PERSON interview required)W2 Only - No C2C, No visa sponsorship.1. Python Development2. Hadoop, HDFS (Hadoop Distributed File System)3. Unix and Linux Shell Scripting4. Spark5. Production Support (they don't need to have served in a production support role, they just need to be able to fix production...


  • plano, United States Matlen Silver Full time

    Python/Hadoop Developer - W2 - Onsite in Plano TX (IN-PERSON interview required)W2 Only - No C2C, No visa sponsorship.1. Python Development2. Hadoop, HDFS (Hadoop Distributed File System)3. Unix and Linux Shell Scripting4. Spark5. Production Support (they don't need to have served in a production support role, they just need to be able to fix production...


  • Plano, TX, United States Infosys Full time

    Infosys is seeking a Hadoop and Spark Lead Developer. In this role, you will enable digital transformation for our clients in a global delivery model, research on technologies independently, recommend appropriate solutions and contribute to technology-specific best practices and standards. You will be responsible to interface with key stakeholders and apply...


  • Plano, Texas, United States Mitchell Martin Inc. Full time

    Job SummaryWe are seeking a highly skilled Quality Assurance Engineer to join our team at Mitchell Martin Inc. The ideal candidate will have strong expertise in Hadoop and Spark, as well as experience with ETL testing and data analysis.Key ResponsibilitiesEnsure that software is developed to meet functional, non-functional, and compliance requirements.Lead...

  • Hadoop Developer

    3 weeks ago


    Plano, United States Tata Consultancy Services Full time

    Roles and Responsibilities:7+ Years of experience in the data warehousing architectural approaches and minimum 4 years of experience in Big data(Cloudera).Exposure to and strong working knowledge on distributed systems.Excellent working knowledge in Kafka streams and Python.Good to have Sqoop, Spark, Unix shell scripting skills.Excellent understanding of...