Python Spark Expert

21 hours ago


Wilmington, Delaware, United States Georgia IT Inc Full time

About Georgia IT Inc.

">

We are seeking a Python Spark Expert to join our team in Willington, DE. The ideal candidate will have a strong background in Python and PySpark, with a proven track record of developing large-scale data processing pipelines.

Job Overview

">

This is a contract position that requires the ability to work independently and collaboratively as part of a team. The successful candidate will be responsible for designing, implementing, and optimizing data solutions using PySpark and other big data technologies.

Key Responsibilities

">
  • ">
  • Develop, implement, and optimize large-scale data processing pipelines using Python and PySpark;">
  • Collaborate with data scientists, data engineers, and other stakeholders to design and enhance data solutions;">
  • Perform data analysis and develop algorithms to process and analyze large datasets efficiently;">
  • Maintain and improve existing PySpark codebase, ensuring high performance and scalability;">
  • Integrate data from various sources, ensuring data quality and consistency;">
  • Write and maintain comprehensive documentation for data processing workflows and algorithms;">
  • Troubleshoot and resolve issues related to data processing and workflow automation;">
">

Qualifications

">

To be successful in this role, you will need:

  • ">
  • Bachelor's or Master's degree in Computer Science, Information Technology, or related field;">
  • Proven experience as a Python developer, with a strong focus on PySpark;">
  • In-depth knowledge of Spark architecture and the Hadoop ecosystem;">
  • Experience with big data technologies such as Hive, HDFS, and Kafka is a plus;">
  • Strong SQL skills and experience with relational databases;">
  • Proficient in writing efficient, scalable, and maintainable code;">
  • Experience with cloud platforms (AWS, Azure, GCP) is highly desirable;">
  • Excellent problem-solving skills and attention to detail;">
  • Strong communication and teamwork abilities;">
">

Salary

">

The estimated salary for this position is $130,000 - $160,000 per year, depending on experience.

Benefits

">

We offer a competitive benefits package, including health insurance, 401(k) matching, and paid time off.



  • Wilmington, Delaware, United States Pyramid Consulting Full time

    Job DescriptionWe are seeking a highly skilled Senior Java Spark Expert to lead our team in developing and implementing innovative solutions using Apache Spark and Java. This is a long-term contract opportunity with the potential for permanent employment.Location: Wilmington, DE (Hybrid)Estimated Salary: $67.50/hourThe ideal candidate will have at least 8...

  • Technical Lead

    3 weeks ago


    Wilmington, Delaware, United States Pyramid Consulting Full time

    Job OverviewImmediate need for a skilled Technical Lead with expertise in Java and Apache Spark. This is a 12+ months contract opportunity with long-term potential.About the RoleWe are seeking a highly experienced Technical Lead to lead our team of software developers working on big data projects using Core Java and Apache Spark. The ideal candidate will...


  • Wilmington, Delaware, United States ICS Global Soft INC Full time

    Job DescriptionWe are seeking a highly skilled Data Engineering Expert to join our team at ICS Global Soft Inc. in Wilmington, DE.This is a multi-year contract position that will involve expanding and optimizing data and data pipeline architecture, modernizing the data ecosystem with open-source technologies, and optimizing data flow and collection for...


  • Wilmington, Delaware, United States Georgia IT Inc Full time

    About the Role:As a Python PySpark Developer at Georgia IT Inc, you will be responsible for developing, implementing, and optimizing large-scale data processing pipelines using Python and PySpark. You will work closely with data scientists, data engineers, and other stakeholders to design and enhance data solutions, perform data analysis, and develop...


  • Wilmington, Delaware, United States Aloden, Inc. Full time

    Are you a skilled Cloud Data Engineer? We're seeking an expert in cloud data engineering to join our team at Aloden, Inc. in Wilmington, DE. With a competitive salary of $142,000 per year and excellent benefits, you'll enjoy a fulfilling career with opportunities for growth and professional development.You'll work closely with our data science team to...

  • Senior Data Engineer

    23 hours ago


    Wilmington, Delaware, United States Aloden, Inc. Full time

    About Aloden, Inc. We are a leading technology company seeking a highly skilled Big Data Engineer to join our team. As a key member of our data engineering group, you will design, develop, and maintain scalable and efficient data pipelines in the AWS cloud environment. Salary: $140,000 - $180,000 per year About the Job As a Python Big Data Engineer at...


  • Wilmington, Delaware, United States Capital One Full time

    Senior Backend Engineering ExpertJoin our team of experts at Capital One and contribute to the design and development of our new core platform. As a Senior Backend Engineering Expert, you'll collaborate with Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies.You'll have the...


  • Wilmington, Delaware, United States Aloden, Inc. Full time

    Job Description:We are seeking an experienced Data Pipeline Developer to join our team at Aloden, Inc. in Wilmington, DE.Key Responsibilities:Design and develop efficient data pipelines using Ab Initio or similar tools to extract, transform, and load data.Migrate legacy ETL processes to a Spark-based framework.Collaborate with data analysts and stakeholders...


  • Wilmington, Delaware, United States Aloden, Inc. Full time

    Job Description:We are seeking an experienced ETL Engineer to join our team at Aloden, Inc. in Wilmington, DE. As an ETL Engineer, you will design, develop, and maintain ETL pipelines using Ab Initio or similar tools. Your expertise in big data and Java development will be essential in migrating legacy ETL processes to a Spark-based framework. You will work...


  • Wilmington, Delaware, United States Diverse Lynx Full time

    About the RoleThe Snowflake Technology Specialist will be responsible for migrating from Hadoop to AWS using Pipelines, EMR, and developing, enhancing, and testing new/existing interfaces. The ideal candidate will have a strong understanding of data concepts, including Oracle, Java, Python, Spark, Kafka, HDFS, Airflow, and Elastic...


  • Wilmington, Delaware, United States Citigroup Inc Full time

    Job DescriptionCitigroup Inc. is seeking a highly skilled Data Analytics Expert to join our team in Wilmington, Delaware.The ideal candidate will have a strong background in channel analytics and digital performance metrics. The successful individual will be responsible for analyzing data from various sources, identifying trends and opportunities for...


  • Wilmington, Delaware, United States Edge Global Full time

    We are looking for an Mainframe Expert to join our team at Edge Global in Wilmington, DE. As a Contract position, this role requires 8-12 years of experience in Mainframe & Java Modernisation.The ideal candidate has a strong understanding of Mainframe Modernization and Legacy Migration. Experience with Java FSD, Python, COBOL, JCL, DB2, IMS, MQ, and...


  • Wilmington, Delaware, United States SysMind Tech Full time

    Job DescriptionWe are seeking a highly skilled Python Developer to join our team at SysMind Tech.Job OverviewAs a Python Developer, you will play a key role in designing, developing, and maintaining our cloud-based applications using Python and SQL programming languages. You will work closely with our cross-functional teams to ensure seamless integration and...


  • Wilmington, Delaware, United States Aloden, Inc. Full time

    About the Position We are a leading technology company seeking a highly skilled Big Data Engineer to join our team at Aloden, Inc. As a key member of our data engineering group, you will design, develop, and maintain scalable and efficient data pipelines in the AWS cloud environment. Annual Salary: $155,000 Job Description The ideal candidate will have 5+...


  • Wilmington, Delaware, United States Diverse Lynx Full time

    About the Role:We are seeking a highly skilled Technical TM1 Expert to join our team in Wilmington, DE. As a key member of our analytics team, you will design and implement solutions using IBM's Planning Analytics platform and provide technical expertise to the team.The estimated salary for this role is $110,000 - $160,000 per year, based on experience.Key...

  • Big Data Engineer

    23 hours ago


    Wilmington, Delaware, United States Georgia IT Inc Full time

    About Georgia IT Inc.">We are seeking an experienced Big Data Engineer to join our team in Willington, DE. The ideal candidate will have a strong background in Python and PySpark, with a proven track record of developing large-scale data processing pipelines.Job Overview">This is a contract position that requires the ability to work independently and...


  • Wilmington, Delaware, United States Donato Technologies, Inc Full time

    Job Title: Cloud Engineering Professional - Software Development Expert">About the Role:">We are seeking an experienced Cloud Engineering Professional to join our team at Donato Technologies, Inc. This is a unique opportunity for a software development expert with a passion for cloud engineering to take on new challenges and contribute to the growth of our...

  • Senior Data Engineer

    3 weeks ago


    Wilmington, Delaware, United States Bank of America Full time

    Job Description:The Senior Data Engineer role is responsible for developing and implementing data-driven solutions to support the Corporate Audit and Credit Review (CACR) organization. This includes designing and building data pipelines, data transformation, and data quality controls. Strong analytical and problem-solving skills are required to drive...


  • Wilmington, Delaware, United States SysMind Tech Full time

    SysMind Tech is seeking a highly skilled Senior Software Engineer to lead our data science initiatives.About the RoleAs a Senior Software Engineer, you will be responsible for designing and developing scalable software solutions using Python and SQL programming languages. Your expertise in Azure services such as VMs, Function Apps, Storage Accounts, and ADLS...


  • Wilmington, Delaware, United States Capital One Full time

    Job SummaryCapital One is seeking a highly skilled Lead Data Engineer, Bank Tech to join our team. As a key member of our engineering organization, you will be responsible for designing, developing, and deploying cloud-based data solutions that drive business value.Key ResponsibilitiesCollaborate with cross-functional teams to design and implement data...