Senior Java Spark Developer

3 days ago

Austin, TX, United States Equiliem Full time
Job Title: Senior Java Spark Developer

Location: Austin, TX

Experience Required: 8+ years
Employment Type: 6-12 months contract

Job Summary:

We are seeking a Senior Java Spark Developer with expertise in Java, Apache Spark, and the Cloudera Hadoop Ecosystem to design and develop large-scale data processing applications. The ideal candidate will have strong hands-on experience in Java-based Spark development, distributed computing, and performance optimization for handling big data workloads.

Key Responsibilities:

Java & Spark Development:
  • Develop, test, and deploy Java-based Apache Spark applications for large-scale data processing.
  • Optimize and fine-tune Spark jobs for performance, scalability, and reliability.
  • Implement Java-based microservices and APIs for data integration.
Big Data & Cloudera Ecosystem:
  • Work with Cloudera Hadoop components such as HDFS, Hive, Impala, HBase, Kafka, and Sqoop.
  • Design and implement high-performance data storage and retrieval solutions.
  • Troubleshoot and resolve performance bottlenecks in Spark and Cloudera platforms.
Collaboration & Data Engineering:
  • Collaborate with data scientists, business analysts, and developers to understand data requirements.
  • Implement data integrity, accuracy, and security best practices across all data processing tasks.
  • Work with Kafka, Flume, Oozie, and Nifi for real-time and batch data ingestion.
Software Development & Deployment:
  • Implement version control (Git) and CI/CD pipelines (Jenkins, GitLab) for Spark applications.
  • Deploy and maintain Spark applications in cloud or on-premises Cloudera environments.
Required Skills & Experience:
  • 8+ years of experience in application development, with a strong background in Java and Big Data processing.
  • Strong hands-on experience in Java, Apache Spark, and Spark SQL for distributed data processing.
  • Proficiency in Cloudera Hadoop (CDH) components such as HDFS, Hive, Impala, HBase, Kafka, and Sqoop.
  • Experience building and optimizing ETL pipelines for large-scale data workloads.
  • Hands-on experience with SQL & NoSQL databases like HBase, Hive, and PostgreSQL.
  • Strong knowledge of data warehousing concepts, dimensional modeling, and data lakes.
  • Proven ability to troubleshoot and optimize Spark applications for high performance.
  • Familiarity with version control tools (Git, Bitbucket) and CI/CD pipelines (Jenkins, GitLab).
  • Exposure to real-time data streaming technologies like Kafka, Flume, Oozie, and Nifi.
  • Strong problem-solving skills, attention to detail, and ability to work in a fast-paced environment.

  • Senior Java Spark Developer

    2 weeks ago

    Austin, TX, United States Diverse Lynx Full time

    e are seeking a Senior Java Spark Developer with expertise in Java, Apache Spark, and the Cloudera Hadoop Ecosystem to design and develop large-scale data processing applications. The ideal candidate will have strong hands-on experience in Java-based Spark development, distributed computing, and performance optimization for handling big data workloads. Key...

  • Java developer

    2 weeks ago

    Austin, TX, United States Info Way Solutions Full time

    Java developer (Scala and Spark) Location: Austin, TX (Onsite) Type : Contract Job Requirement: Responsibilities for this position include: Solid experience with Java, Scala and Spark Engineering software solutions that employ a diverse range of technologies such as Java, NoSQL, Hadoop, Cassandra, Kafka, Spark Solid understanding of data...

  • Senior Java Developer

    16 hours ago

    Austin, TX, United States Trident Consulting Full time

    Trident Consulting is seeking a "Senior Java Developer" for one of our client in Austin, TX. A global leader in business and technology services. Job Title: Senior Java Developer with Retail/Order Management Domain Experience Location: *Hybrid Day 1: Austin, TX (onsite Tues-Thurs)* Job Type: Contract Duration: 1 Year with possible extensions Pay Rate: $75/Hr...

  • Senior Java Developer

    1 week ago

    Austin, TX, United States Wise Skulls Full time

    Title: Senior Java Developer Location: Sunnyvale, CA, and Austin, TX (Hybrid) Duration: 6 months (possibility of extension) Implementation Partner: Infosys End Client: To be disclosed JD: 8+ years of Java development experience. Strong AWS/cloud experience. Experience with EKS is a plus. Excellent communication and teamwork skills.

  • Senior Java Developer

    2 weeks ago

    Austin, TX, United States Wise Skulls Full time

    Title: Senior Java Developer Location: Sunnycale, CA, and Austin, TX (Hybrid) Duration: 6 months (possibility of extension) Implementation Partner: Infosys End Client: To be disclosed JD: 8+ years of Java development experience. Strong AWS/cloud experience. Experience with EKS is a plus. Excellent communication and teamwork skills.

  • Senior Java Developer

    7 days ago

    Austin, TX, United States Wise Skulls Full time

    Title: Senior Java Developer Location: Sunnyvale, CA, and Austin, TX (Hybrid) Duration: 6 months (possibility of extension) Implementation Partner: Infosys End Client: To be disclosed JD: 8+ years of Java development experience. Strong AWS/cloud experience. Experience with EKS is a plus. Excellent communication and teamwork skills.

  • Senior Java Developer

    2 weeks ago

    Austin, TX, United States Wise Skulls Full time

    Title: Senior Java Developer Location: Sunnycale, CA, and Austin, TX (Hybrid) Duration: 6 months (possibility of extension) Implementation Partner: Infosys End Client: To be disclosed JD: 8+ years of Java development experience. Strong AWS/cloud experience. Experience with EKS is a plus. Excellent communication and teamwork skills.

  • Senior Java Developer

    3 days ago

    Austin, TX, United States Wise Skulls Full time

    Title: Senior Java Developer Location: Sunnyvale, CA, and Austin, TX (Hybrid) Duration: 6 months (possibility of extension) Implementation Partner: Infosys End Client: To be disclosed JD: 8+ years of Java development experience. Strong AWS/cloud experience. Experience with EKS is a plus. Excellent communication and teamwork skills.

  • Senior Java Developer

    1 week ago

    Austin, TX, United States Wise Skulls Full time

    Title: Senior Java Developer Location: Sunnyvale, CA, and Austin, TX (Hybrid) Duration: 6 months (possibility of extension) Implementation Partner: Infosys End Client: To be disclosed JD: 8+ years of Java development experience. Strong AWS/cloud experience. Experience with EKS is a plus. Excellent communication and teamwork skills.

  • Senior Java Developer

    20 hours ago

    Austin, TX, United States Wise Skulls Full time

    Title: Senior Java Developer Location: Sunnyvale, CA, and Austin, TX (Hybrid) Duration: 6 months (possibility of extension) Implementation Partner: Infosys End Client: To be disclosed JD: 8+ years of Java development experience. Strong AWS/cloud experience. Experience with EKS is a plus. Excellent communication and teamwork skills.