Senior Hadoop Engineer

4 weeks ago


Plano, Texas, United States Photon Full time

Greetings from Photon, a leading Digital Experience provider. For the past 20 years, we have empowered numerous Fortune 100 companies with innovative solutions. Our team of over 6000 experts across the globe is dedicated to Digital Modernization. To learn more about us, please check our brief video.

Location: Onsite/Hybrid

Hiring Type: Full Time

We are seeking a highly skilled Hadoop Developer to join our team. This hybrid role involves expertise in database management, clustered compute, operating system integration, cloud concepts, storage solutions, application processing, and advanced monitoring techniques. The ideal candidate will have experience in multiple disciplines, including Cloud, Linux, and Hadoop. Strong leadership and communication skills are essential for managing complex projects and competing priorities.

Key Responsibilities:

  • Design, implement, and maintain large-scale Enterprise Hadoop or Big Data environments, including Data Bricks, Cloudera, HD Insights, and other platforms.
  • Configure and monitor Cloudera CDH/CDP distribution, ensuring optimal performance and security.
  • Develop and administer RHEL Linux operating systems, databases, and hardware in an enterprise environment.
  • Expertise in system administration, programming, and shell scripting (e.g., Bash, ksh).
  • Implement security measures for Hadoop clusters using Kerberos with integration with LDAP/AD at an enterprise level.
  • Manage large-scale enterprise environments, ensuring separation of resources and optimal utilization of storage, memory, network, and compute resources.

Desired Skills:

  • Experience with version control systems (Git)
  • Experience with Spectrum Conductor or Databricks with Apache Spark
  • Experience in different programming languages (Python, Java, R)
  • Enterprise Database Administration Platform Experience
  • Experience In Large Analytic Tools including SAS, Search, Machine Learning, Log Aggregation
  • Experience with Hadoop distributions in the Cloud is a plus, AWS, Azure, Google


  • Plano, Texas, United States The Cigna Group Full time

    Job SummaryWe are seeking a highly skilled Senior Hadoop Engineer to join our team at The Cigna Group. As a key member of our Data Engineering team, you will be responsible for designing, developing, and supporting Cloudera Hadoop systems.Key ResponsibilitiesDesign and implement complex big data deploymentsDevelop and maintain automation scripts using...


  • Plano, Texas, United States Insight Global Full time

    Job Title: Senior Hadoop DeveloperJob Summary:We are seeking a skilled Senior Hadoop Developer to join our team at Insight Global. As a Senior Hadoop Developer, you will be responsible for designing, developing, and maintaining software applications using Hadoop and big data technologies.Key Responsibilities:Develop and maintain ETL processes using Hadoop...

  • Hadoop Developer

    4 weeks ago


    Plano, Texas, United States ApTask Full time

    About ApTask:ApTask is a leading global provider of workforce solutions and talent acquisition services, dedicated to shaping the future of work. As an African American-owned and Veteran-certified company, ApTask offers a comprehensive suite of services, including staffing and recruitment solutions, managed services, IT consulting, and project management.Job...


  • Plano, Texas, United States Mitchell Martin Inc. Full time

    Job SummaryWe are seeking a highly skilled Quality Assurance Engineer to join our team at Mitchell Martin Inc. The ideal candidate will have strong expertise in Hadoop and Spark, as well as experience with ETL testing and data analysis.Key ResponsibilitiesEnsure that software is developed to meet functional, non-functional, and compliance requirements.Lead...


  • Plano, Texas, United States Diverse Lynx Full time

    Job Title: Senior Software Engineer - JavaAbout the Role:We are seeking a highly skilled Senior Software Engineer with expertise in Java to join our team at Diverse Lynx LLC. As a key member of our engineering team, you will be responsible for designing, developing, and deploying large-scale software systems using Java and related technologies.Key...


  • Plano, Texas, United States ICONMA Full time

    Job DescriptionICONMA is seeking a highly skilled Hadoop Developer with expertise in Unix and SQL to join our team.The ideal candidate will have a strong background in Hadoop, SQL, and Unix, with experience in Hive, Impala, and Spark. They will also have a working knowledge of data warehousing and be able to work on large-scale data processing projects.The...


  • Plano, Texas, United States Inficare Full time

    Job Title: Senior MongoDB EngineerLocation: RemoteMode: Full Time/ ContractJob Description:We are seeking a highly skilled Senior MongoDB Engineer to join our team at Inficare. The ideal candidate will have a strong background in software engineering, with a minimum of 5 years of experience in designing and implementing MongoDB applications. Key...


  • Plano, Texas, United States Efficus, Inc. Full time

    Job OverviewWe are seeking a highly skilled Senior Machine Learning Engineer to join our team at Efficus, Inc. as a Client Engineer - Pricing and Recommendations. In this role, you will play a pivotal part in shaping the future of our consumer journey through cutting-edge Machine Learning Client solutions for pricing and recommendations.About the RoleKey...


  • Plano, Texas, United States Mitchell Martin Full time

    Job SummaryWe are seeking a highly skilled Senior Quality Assurance Engineer with expertise in Big Data to join our team at Mitchell Martin.Key ResponsibilitiesEnsure software development meets functional, non-functional, and compliance requirements.Lead small efforts and contribute to good software testing practices.Develop and maintain test automation...

  • Big Data Engineer

    4 weeks ago


    Plano, Texas, United States Photon Full time

    Job SummaryPhoton is seeking a highly skilled Big Data Engineer to join our team. As a Big Data Engineer, you will be responsible for designing, implementing, and maintaining large-scale data processing systems using Hadoop and related technologies.Key ResponsibilitiesDesign and implement data processing pipelines using Hadoop and SparkDevelop and maintain...


  • Plano, Texas, United States Capital One Full time

    About the Role:We are seeking a Senior Lead Data Engineer to join our team at Capital One. As a Senior Lead Data Engineer, you will be responsible for leading a team of developers in designing, developing, and implementing technical solutions in full-stack development tools and technologies.Key Responsibilities:Collaborate with and across Agile teams to...

  • Big Data Engineer

    4 weeks ago


    Plano, Texas, United States Matlen Silver Full time

    Job Title: Hadoop DeveloperDuration: 12-18 monthsLocation: Hybrid 3 days a weekRequired Pay Scale: $60-$70/hrJob Summary:Hadoop DeveloperHadoop LeadNot looking for data engineers or adminsProject Details:Hadoop Developer to work in one or more than one projects in the hadoop data lake, including technical deliverables as per business needs.Must Haves:Hadoop...

  • Senior Data Engineer

    4 weeks ago


    Plano, Texas, United States Capital One Full time

    About the Role:We are seeking a highly skilled Data Engineer to join our team at Capital One. As a Data Engineer, you will play a critical role in designing, developing, and implementing data solutions that drive business value.Key Responsibilities:Collaborate with cross-functional teams to design and develop data solutions that meet business...

  • Big Data Engineer

    4 weeks ago


    Plano, Texas, United States HexaQuEST Global, Inc. Full time

    Job SummaryAt HexaQuEST Global, Inc., we are seeking a highly skilled Data Architect to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and implementing large-scale data processing systems using Hadoop and related technologies.Key Responsibilities• Develop and maintain large-scale data...

  • Senior Data Engineer

    1 month ago


    Plano, Texas, United States Capital One Full time

    About the RoleCapital One is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, developing, and implementing data pipelines and architectures to support our business needs.Key ResponsibilitiesCollaborate with cross-functional teams to design and develop data solutionsDevelop and maintain data...

  • Senior Data Engineer

    4 weeks ago


    Plano, Texas, United States Capital One Full time

    Job DescriptionCapital One is seeking a talented Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, developing, and implementing technical solutions in full-stack development tools and technologies.You will work closely with Agile teams to collaborate on projects, utilize programming languages like Java, Scala, Python,...

  • Big Data Engineer

    4 weeks ago


    Plano, Texas, United States Randstad Full time

    Job Summary:We are seeking an experienced Big Data Engineer to join our team. The ideal candidate will have a strong background in Hadoop and Kafka, with expertise in developing and implementing scalable data pipelines.Key Responsibilities:Analyze and design scalable data pipelines using Hadoop and KafkaDevelop and implement data processing solutions using...


  • Plano, Texas, United States Pyramid Consulting, Inc Full time

    Job Title: Senior Big Data Solutions ArchitectOur client, a leading Banking and Financial Industry, is seeking a skilled Big Data Solutions Architect to design, build and operate cloud services. The ideal candidate should have extensive experience in Big Data/Analytics areas, including Hadoop, Enterprise Business Intelligence and Analytics, and underlying...


  • Plano, Texas, United States Infosys Full time

    Job Title**Hadoop and Spark Lead Developer**At Infosys, we're seeking a talented Hadoop and Spark Lead Developer to join our team. As a key member of our global delivery model, you'll play a crucial role in enabling digital transformation for our clients.Key ResponsibilitiesResearch and recommend appropriate technologies and solutionsContribute to...


  • Plano, Texas, United States BCforward Full time

    Job Title:Senior Data Integration SpecialistJob Summary:BCforward is seeking a highly skilled Senior Data Integration Specialist to lead the development and implementation of data integration solutions involving Informatica and Hadoop. The ideal candidate will have a strong background in data delivery and integration, with experience in leading multiple...