Senior Data Engineer-Java, Python, Spark US

3 days ago

Charlotte, NC, United States Zortech Solutions Full time
Role: Senior Data Engineer-Java, Python, Spark

Location: Charlotte NC (hybrid)

Duration: 6+ Months

Job Description:
  • We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. As a Senior Data Engineer, you will play a crucial role in designing, implementing, and maintaining data pipelines and infrastructure for our big data projects. Your expertise in Java, Python, Spark cluster management, data science, big data, REST API development, and knowledge of Databricks and Delta Lake will be essential in driving the success of our data initiatives.

Responsibilities:

- Design, develop, and implement scalable data pipelines and ETL processes using Java, Python, and Spark.

- Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and design efficient solutions.

- Manage and optimize Spark clusters to ensure high performance and reliability.

- Perform data exploration, data cleaning, and data transformation tasks to prepare data for analysis and modeling.

- Develop and maintain data models and schemas to support data integration and analysis.

- Implement data quality and validation checks to ensure accuracy and consistency of data.

- Utilize REST API development skills to create and integrate data services and endpoints for seamless data access and consumption.

- Monitor and troubleshoot data pipeline performance, identifying and resolving bottlenecks and issues.

- Stay updated with the latest technologies and trends in big data, data engineering, data science, and REST API development, and provide recommendations for process improvements.

- Mentor and guide junior team members, providing technical leadership and sharing best practices.

Qualifications:

- Master's degree in Computer Science, Data Science, or a related field.

- Minimum of 3 years of professional experience in data engineering, working with Java, Python, Spark, and big data technologies.

- Strong programming skills in Java and Python, with expertise in building scalable and maintainable code.

- Proven experience in Spark cluster management, optimization, and performance tuning.

- Solid understanding of data science concepts and experience working with data scientists and analysts.

- Proficiency in SQL and experience with relational databases (e.g., Snowflake, Delta Tables).

- Experience in designing and developing REST APIs using frameworks such as Flask or Spring.

- Familiarity with cloud-based data platforms (e.g.Azure)

- Experience with data warehousing concepts and tools (e.g., Snowflake, BigQuery) is a plus.

- Strong problem-solving and analytical skills, with the ability to tackle complex data engineering challenges.

- Excellent communication and collaboration skills, with the ability to work effectively in a team-oriented environment.

If you are a highly motivated and skilled Senior Data Engineer with a passion for big data, data engineering, and REST API development, we would love to hear from you. Join our team and contribute to the success of our data-driven initiatives as we strive to make a significant impact in the industry.

  • IT - Technology Lead | Big Data - Data Processing | Spark

    1 week ago

    Charlotte, NC, United States SysMind Tech Full time

    Job Title: Senior Data Engineer Work Location & Reporting Address: Charlotte, NC 28203 (hybrid - 2 days onsite per week) market rate Contract duration: 12 months Target Start Date: 06 Oct 2025 Does this position require Visa independent candidates only? No Job Details: Must Have Skills: Spark, Python, Bigdata, AWS Detailed Job Description We are currently...

  • IT - Technology Lead | Big Data - Data Processing | Spark

    7 days ago

    Charlotte, NC, United States SysMind Tech Full time

    Job Title: Senior Data Engineer Work Location & Reporting Address: Charlotte, NC 28203 (hybrid - 2 days onsite per week) market rate Contract duration: 12 months Target Start Date: 06 Oct 2025 Does this position require Visa independent candidates only? No Job Details: Must Have Skills: Spark, Python, Bigdata, AWS Detailed Job Description We are currently...

  • IT - Technology Lead | Big Data - Data Processing | Spark

    4 days ago

    Charlotte, NC, United States SysMind Tech Full time

    Job Title: Senior Data Engineer Work Location & Reporting Address: Charlotte, NC 28203 (hybrid - 2 days onsite per week) market rate Contract duration: 12 months Target Start Date: 06 Oct 2025 Does this position require Visa independent candidates only? No Job Details: Must Have Skills: Spark, Python, Bigdata, AWS Detailed Job Description We are currently...

  • IT - Technology Lead | Big Data - Data Processing | Spark

    3 days ago

    Charlotte, NC, United States SysMind Tech Full time

    Job Title: Senior Data Engineer Work Location & Reporting Address: Charlotte, NC 28203 (hybrid - 2 days onsite per week) market rate Contract duration: 12 months Target Start Date: 06 Oct 2025 Does this position require Visa independent candidates only? No Job Details: Must Have Skills: Spark, Python, Bigdata, AWS Detailed Job Description We are currently...

  • Senior Data Engineer

    7 days ago

    Charlotte, NC, United States eTeam Full time

    Job Title: Senior Data Engineer Location: Charlotte, NC 28203 (Hybrid - 2 days onsite per week) Duration: 12 Months Job Details: Must Have Skills: Spark, Python, Bigdata, AWS Detailed Job Description We are currently seeking a Senior Data Engineer with hands-on coding experience and a strong background in Python, PySpark, and Object-oriented...

  • Senior Data Engineer

    3 days ago

    Charlotte, NC, United States eTeam Full time

    Job Title: Senior Data Engineer Location: Charlotte, NC 28203 (Hybrid - 2 days onsite per week) Duration: 12 Months Job Details: Must Have Skills: Spark, Python, Bigdata, AWS Detailed Job Description We are currently seeking a Senior Data Engineer with hands-on coding experience and a strong background in Python, PySpark, and Object-oriented...

  • Data Engineer

    5 days ago

    Charlotte, NC, United States Northern Base Full time

    Typically requires 10-plus years of applicable experience. Ability to develop, modify, and adopt tools and processes to support self-service data pipeline management. Drive adoption of data tools to modernize existing ETL frameworks/processes and implement with a strategic mindset and typically have in-depth knowledge of development tools, and languages....

  • Data Engineer

    2 weeks ago

    Charlotte, NC, United States Northern Base Full time

    Typically requires 10-plus years of applicable experience. Ability to develop, modify, and adopt tools and processes to support self-service data pipeline management. Drive adoption of data tools to modernize existing ETL frameworks/processes and implement with a strategic mindset and typically have in-depth knowledge of development tools, and languages....

  • Data Engineer

    2 days ago

    Charlotte, NC, United States Northern Base Full time

    Typically requires 10-plus years of applicable experience. Ability to develop, modify, and adopt tools and processes to support self-service data pipeline management. Drive adoption of data tools to modernize existing ETL frameworks/processes and implement with a strategic mindset and typically have in-depth knowledge of development tools, and languages....

  • Software Developer

    2 days ago

    Charlotte, NC, United States SynergisticIT Full time

    Since 2010 Synergisticit has helped Jobseekers get employed in the tech Job market by providing candidates the requisite skills, experience, and technical competence to outperform at interviews and clients. Here at SynergisticIT We just don't focus on getting you a tech Job we make careers. In this Job market also, our candidates can achieve multiple job...