Hadoop Developer

3 hours ago

Charlotte, NC, United States Avance Consulting Full-time

Hadoop DeveloperCloud-Native Azure PySparkMust Have Technical/Functional SkillsPrimary Skill: Hadoop ecosystem (HDFS, Hive, Spark), PySpark, Python, Apache KafkaExperience: Minimum 10 yearsRoles & ResponsibilitiesArchitectural Leadership:
• Define end-to-end architecture for data platforms, streaming systems, and web applications.
• Ensure alignment with enterprise standards, security, and compliance requirements.
• Evaluate emerging technologies and recommend adoption strategies.
Data Engineering:
• Design and implement data ingestion, transformation, and processing pipelines using Hadoop, PySpark, and related tools.
• Optimize ETL workflows for large-scale datasets and real-time streaming.
• Integrate Apache Kafka for event-driven architectures and messaging.
Collaboration & Leadership:
• Work closely with product owners, business analysts, and DevOps teams.
• Mentor junior developers and data engineers.
• Participate in agile ceremonies, code reviews, and design discussions.
Required Skills &

Qualifications:
Technical Expertise:
• Strong experience with Hadoop ecosystem (HDFS, Hive, Spark).
• Proficiency in PySpark for distributed data processing.
• Advanced programming skills in Python.
• Hands-on experience with Apache Kafka for real-time streaming.
Architectural

Skills:
• Expertise in designing scalable, secure, and high-performance systems.
• Familiarity with microservices, API design, and cloud-native architectures.
Additional

Skills:
• Knowledge of CI/CD pipelines, containerization (Docker/Kubernetes).
• Exposure to cloud platforms (AWS, Azure, GCP).
Soft

Skills:
• Strong analytical and problem-solving abilities.
• Excellent communication and leadership skills.
• Ability to thrive in a fast-paced, agile environment.

About the company
Avance Consulting is a global leader in innovative talent solutions for diverse industries. Since 2007, we have been serving nearly a third of Fortune 500 companies and most of the top 100 technology companies worldwide.
Our team of 700+ experts offers Engineering Services, Information Technology, Digital and Executive Search solutions from our offices in North America, UK, Europe and APAC.
We understand the local markets and cultures and tailor our services to meet the needs of our clients. Our clients value our flexibility and agility, which enable us to deliver high-quality results at any scale across the globe.
This allows us to work with numerous industries at varying scale across the globe while ensuring the excellent service standard that our clients have come to expect.
At Avance you can learn new skills and technologies, have more advancement opportunities and career growth, being a part of our productive atmosphere, and a positive reinforcement culture.