Python PySpark Developer

1 day ago


Wilmington, Delaware, United States Georgia IT Inc Full time

About the Role:

As a Python PySpark Developer at Georgia IT Inc, you will be responsible for developing, implementing, and optimizing large-scale data processing pipelines using Python and PySpark. You will work closely with data scientists, data engineers, and other stakeholders to design and enhance data solutions, perform data analysis, and develop algorithms to process and analyze large datasets efficiently.

Responsibilities:

  • Develop, implement, and optimize large-scale data processing pipelines using Python and PySpark.
  • Collaborate with data scientists, data engineers, and other stakeholders to design and enhance data solutions.
  • Perform data analysis and develop algorithms to process and analyze large datasets efficiently.
  • Maintain and improve existing PySpark codebase, ensuring high performance and scalability.
  • Integrate data from various sources, ensuring data quality and consistency.
  • Write and maintain comprehensive documentation for data processing workflows and algorithms.
  • Troubleshoot and resolve issues related to data processing and workflow automation.

Requirements:

  • Bachelor's or Master's degree in Computer Science, Information Technology, or related field.
  • Proven experience as a Python developer, with a strong focus on PySpark.
  • In-depth knowledge of Spark architecture and the Hadoop ecosystem.
  • Experience with big data technologies such as Hive, HDFS, and Kafka.
  • Strong SQL skills.
  • Proficient in writing efficient, scalable, and maintainable code.
  • Excellent problem-solving skills and attention to detail.
  • Strong communication and teamwork abilities.
  • Experience with cloud platforms (AWS, Azure, GCP) is highly desirable.

Estimated Salary: $80,000 - $110,000 per year.



  • Wilmington, Delaware, United States Aloden, Inc. Full time

    Are you a skilled Cloud Data Engineer? We're seeking an expert in cloud data engineering to join our team at Aloden, Inc. in Wilmington, DE. With a competitive salary of $142,000 per year and excellent benefits, you'll enjoy a fulfilling career with opportunities for growth and professional development.You'll work closely with our data science team to...


  • Wilmington, Delaware, United States ICS Global Soft INC Full time

    Job DescriptionWe are seeking a highly skilled Data Engineering Expert to join our team at ICS Global Soft Inc. in Wilmington, DE.This is a multi-year contract position that will involve expanding and optimizing data and data pipeline architecture, modernizing the data ecosystem with open-source technologies, and optimizing data flow and collection for...


  • Wilmington, Delaware, United States Aloden, Inc. Full time

    Job Description:We are seeking an experienced Data Pipeline Developer to join our team at Aloden, Inc. in Wilmington, DE.Key Responsibilities:Design and develop efficient data pipelines using Ab Initio or similar tools to extract, transform, and load data.Migrate legacy ETL processes to a Spark-based framework.Collaborate with data analysts and stakeholders...


  • Wilmington, Delaware, United States Compunnel Full time

    Job SummaryWe are seeking a skilled Cloud Data Solutions Developer to join our team in a fully remote capacity. The ideal candidate will have strong expertise in cloud data platforms, significant experience with Databricks, and advanced Python coding skills for developing reusable frameworks.About the RoleThe successful candidate will be responsible for...


  • Wilmington, Delaware, United States Capital One Full time

    About the RoleIn this Senior Backend Development Manager position at Capital One, you will lead a team of experienced engineers to design and implement cutting-edge solutions using Java, Python, SQL, Node, Go, and Scala. You will work closely with product managers to define requirements and ensure timely delivery of high-quality products. Additionally, you...


  • Wilmington, Delaware, United States Capital One Full time

    Job SummaryThe ideal candidate will have at least 3 years of experience in application development, including big data technologies, with a strong background in Java, Python, or Scala. The role involves designing, developing, testing, implementing, and supporting technical solutions in full-stack development tools and technologies.

  • Software Engineer

    2 weeks ago


    Wilmington, Delaware, United States Citigroup Full time

    Transforming the Financial Landscape with TechnologyAs a leading global bank, Citigroup offers unparalleled opportunities for growth and innovation. Our Enterprise Operations & Technology teams are at the forefront of shaping the financial industry's future.Citigroup's commitment to diversity and inclusion fosters an environment where talented individuals...


  • Wilmington, Delaware, United States Diverse Lynx Full time

    About the RoleAs a Senior TM1 Developer at Diverse Lynx LLC, you will be responsible for designing and implementing solutions using IBM's Planning Analytics platform. This exciting opportunity is based in Wilmington, DE.ResponsibilitiesCreate complex business rules and develop Turbo Integrator processes to drive efficient data management and deliver...


  • Wilmington, Delaware, United States Capital One Full time

    Transform Business with Emerging TechnologiesCapital One is seeking Back End Software Engineers who are passionate about marrying data with emerging technologies. As a Capital One Software Engineer, you'll have the opportunity to be on the forefront of driving a major transformation within the company.Key Responsibilities:Collaborate with Agile teams to...


  • Wilmington, Delaware, United States Capital One Full time

    About UsAt Capital One, we're shaping the future of banking and technology. Our team is passionate about innovation and making a difference in people's lives.Your RoleWe're seeking an experienced Backend Software Developer to join our team. As a Cloud Engineer - Bank Tech, you'll be responsible for designing, developing, testing, implementing, and supporting...


  • Wilmington, Delaware, United States Capital One Full time

    Job SummaryWe are seeking a skilled Technical Solutions Developer to join our team at Capital One. As a senior software engineer, you will play a key role in designing, developing, and implementing technical solutions in full-stack development tools and technologies.About UsCapital One is a leading financial services company dedicated to helping customers...


  • Wilmington, Delaware, United States Capital One Full time

    About the RoleWe're looking for talented Senior Software Engineers to help us build and modernize our bank's core platform. This is an exciting opportunity to work with a talented team, using cutting-edge technologies to create innovative solutions that improve customer experiences.Your Key Responsibilities:Partner with Agile teams to design, develop, test,...


  • Wilmington, Delaware, United States Capital One Full time

    We are seeking a talented Full-Stack Software Engineer to join our team at Capital One. As a Full-Stack Software Engineer, you will play a critical role in driving a major transformation within the company by delivering robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial...

  • TM1 Developer

    2 weeks ago


    Wilmington, Delaware, United States ApTask Full time

    About ClientThe client is a leading provider of information technology services, encompassing business outsourcing, infrastructure technology, and application services. Their application service includes development, maintenance, and support for various industries such as financial services and insurance, healthcare, manufacturing, government,...


  • Wilmington, Delaware, United States Capital One Full time

    At Capital One, we're seeking experienced Back End Software Engineers to join our team. As a Senior Lead Software Engineer, you'll be responsible for leading a portfolio of technology projects and a team of developers with deep experience in distributed microservices, full stack systems, and cloud-based solutions.We're looking for someone who is passionate...


  • Wilmington, Delaware, United States Donato Technologies, Inc Full time

    Job Title: Cloud Engineering Professional - Software Development Expert">About the Role:">We are seeking an experienced Cloud Engineering Professional to join our team at Donato Technologies, Inc. This is a unique opportunity for a software development expert with a passion for cloud engineering to take on new challenges and contribute to the growth of our...


  • Wilmington, Delaware, United States SysMind Tech Full time

    SysMind Tech is seeking a highly skilled Senior Software Engineer to lead our data science initiatives.About the RoleAs a Senior Software Engineer, you will be responsible for designing and developing scalable software solutions using Python and SQL programming languages. Your expertise in Azure services such as VMs, Function Apps, Storage Accounts, and ADLS...


  • Wilmington, Delaware, United States Focused HR Solutions Full time

    We are seeking a Data Scientist to join our teamAs a Data Scientist at our company, you will be responsible for developing and deploying machine learning models to drive business growth. You will work closely with cross-functional teams to identify opportunities for improvement and implement data-driven solutions.Design and implement machine learning...

  • Software Engineer

    2 weeks ago


    Wilmington, Delaware, United States Capital One Full time

    Company Overview:Capital One is a leading financial institution that empowers individuals to achieve financial empowerment through innovative solutions.About the Role:We are seeking a highly skilled Senior Software Engineer to join our team in Wilmington, Delaware. As a key member of our Agile development team, you will design, develop, and implement...


  • Wilmington, Delaware, United States Capital One Full time

    Capital One - Cloud Software EngineerWe are seeking experienced Senior Software Engineers to join our Bank Modernization team in the United States. As a key member of this team, you will contribute to the design and development of our new core platform, working with cutting-edge technologies to shape the future of workflow automation.As a Cloud Software...