Sr. AWS Pyspark Developer

1 week ago


Richmond, United States Cognizant Full time

Job Summary

We are seeking an experienced Architect with 6 to 10 years of experience to join our team. The ideal candidate will have a strong background in Spark Optimization AWS IAM Big Data AWS EC2 Amazon S3 Apache Spark and Python. Additionally domain expertise in Cards and Payments is required. This role involves designing and optimizing big data solutions to drive our business forward.

Responsibilities

  • Lead the design and implementation of big data solutions using Apache Spark and AWS services.
  • Oversee the optimization of Spark jobs to ensure high performance and cost-efficiency.
  • Provide expertise in AWS IAM to manage access and permissions securely.
  • Utilize AWS EC2 and Amazon S3 for scalable storage and compute solutions.
  • Implement data processing pipelines using Apache Spark and Python.
  • Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.
  • Ensure data security and compliance with industry standards in the Cards and Payments domain.
  • Conduct performance tuning and troubleshooting of big data applications.
  • Develop and maintain documentation for data architecture and processes.
  • Mentor junior team members and provide technical guidance.
  • Stay updated with the latest trends and technologies in big data and cloud computing.
  • Contribute to the continuous improvement of data engineering practices within the organization.
  • Drive innovation by exploring new tools and techniques to enhance data processing capabilities.

Qualifications

  • Possess a strong background in Spark Optimization and AWS IAM.
  • Demonstrate expertise in Big Data technologies and AWS EC2.
  • Have hands-on experience with Amazon S3 and Apache Spark.
  • Show proficiency in Python for data processing tasks.
  • Exhibit domain knowledge in Cards and Payments.
  • Have excellent problem-solving and analytical skills.
  • Display strong communication and collaboration abilities.


  • Richmond, United States Cognizant Full time

    About Cognizant’s AI Practice - Digital technologies, including analytics and AI, give companies a once-in-a-generation opportunity to perform orders of magnitude better than ever before. However, clients need new business models built from analyzing customers and business operations at every angle to really understand them.With the power to apply...

  • AWS/Pyspark Engineer

    4 weeks ago


    Richmond, United States Cognizant Full time

    We are Cognizant Artificial Intelligence Digital technologies, including analytics and AI, give companies a once-in-a-generation opportunity to perform orders of magnitude better than ever before! But clients need new business models built from analyzing customers and business operations at every angle to really understand them. With the power to apply...

  • Data Engineer

    2 weeks ago


    Richmond, United States Strategic Staffing Solutions Full time

    Data Engineer - Python, PySpark, AWS W2 ONLY- NO C2C Location: Richmond, VA Setting: May work remote or on site Contract: 4+months Beware of scams. S3 never asks for money during its onboarding process. Position Overview: As a Data Engineer, you will be responsible for designing, implementing, and maintaining scalable data pipelines and...


  • Richmond, United States Numero Data Full time

    Job requirements:• 5 years of experience ideal, but flexible• EMR in AWS, Hadoop• Large regulatory reporting application - supports 7 regulatory reporting use cases, for other banks this would have to be 7 different applications due to the scale• Pulls data from all systems across C1, do large transformations and prepare regulatory reporting and...


  • Richmond, United States Numero Data Full time

    Job requirements:• 5 years of experience ideal, but flexible• EMR in AWS, Hadoop• Large regulatory reporting application - supports 7 regulatory reporting use cases, for other banks this would have to be 7 different applications due to the scale• Pulls data from all systems across C1, do large transformations and prepare regulatory reporting and...


  • Richmond, United States Numero Data LLC Full time

    Job requirements: 5 years of experience ideal, but flexible EMR in AWS, Hadoop Large regulatory reporting application - supports 7 regulatory reporting use cases, for other banks this would have to be 7 different applications due to the scale Pulls data from all systems across C1, do large transformations and prepare regulatory reporting and report to...


  • Richmond, Virginia, United States Cognizant Full time

    About Cognizant's AI PracticeDigital technologies, including analytics and artificial intelligence, offer companies a unique opportunity to significantly improve their performance. However, clients need new business models built from analyzing customers and business operations from every angle to truly understand them.With the power to apply artificial...


  • Richmond, United States Cognizant Full time

    Job Summary We are seeking an experienced Architect with 6 to 10 years of experience to join our team. The ideal candidate will have a strong background in Spark Optimization AWS IAM Big Data AWS EC2 Amazon S3 Apache Spark and Python. Additionally domain expertise in Cards and Payments is required. This role involves designing and optimizing big data...


  • Richmond, United States Cognizant Full time

    Job Summary We are seeking an experienced Architect with 6 to 10 years of experience to join our team. The ideal candidate will have a strong background in Spark Optimization AWS IAM Big Data AWS EC2 Amazon S3 Apache Spark and Python. Additionally domain expertise in Cards and Payments is required. This role involves designing and optimizing big data...


  • Richmond, United States Cognizant Full time

    Job Summary We are seeking an experienced Architect with 6 to 10 years of experience to join our team. The ideal candidate will have a strong background in Spark Optimization AWS IAM Big Data AWS EC2 Amazon S3 Apache Spark and Python. Additionally domain expertise in Cards and Payments is required. This role involves designing and optimizing big data...


  • Richmond, United States Cognizant Full time

    Job Summary We are seeking an experienced Architect with 6 to 10 years of experience to join our team. The ideal candidate will have a strong background in Spark Optimization AWS IAM Big Data AWS EC2 Amazon S3 Apache Spark and Python. Additionally domain expertise in Cards and Payments is required. This role involves designing and optimizing big data...


  • Richmond, United States Cognizant Full time

    Job Summary We are seeking an experienced Architect with 6 to 10 years of experience to join our team. The ideal candidate will have a strong background in Spark Optimization AWS IAM Big Data AWS EC2 Amazon S3 Apache Spark and Python. Additionally domain expertise in Cards and Payments is required. This role involves designing and optimizing big data...


  • Richmond, United States Strategic Staffing Solutions Full time

    Data Engineer – Python, PySpark, AWS ******W2 ONLY- NO C2C Location: Richmond, VA Setting: May work remote or on site  Contract: 4+months Beware of scams. S3 never asks for money during its onboarding process. Position Overview: As a Data Engineer, you will be responsible for designing, implementing, and maintaining scalable data...


  • Richmond, VA, United States Cognizant Full time

    Job Summary We are seeking an experienced Architect with 6 to 10 years of experience to join our team. The ideal candidate will have a strong background in Spark Optimization AWS IAM Big Data AWS EC2 Amazon S3 Apache Spark and Python. Additionally domain expertise in Cards and Payments is required. This role involves designing and optimizing big data...


  • Richmond, United States Cognizant Full time

    About Cognizant’s AI Practice Digital technologies, including analytics and AI, give companies a once-in-a-generation opportunity to perform orders of magnitude better than ever before. However, clients need new business models built from analyzing customers and business operations at every angle to really understand them. With the power to apply...


  • Richmond, Virginia, United States Cognizant Full time

    About Cognizant's AI PracticeCognizant's AI Practice is a leading provider of artificial intelligence and data science solutions to businesses. Our team of experts helps companies leverage digital technologies to drive innovation and growth.We are seeking an experienced Architect with 6 to 9 years of expertise in Spark Optimization AWS IAM Big Data AWS EC2...

  • AWS Java Developer

    1 month ago


    Richmond, United States Global Soft Systems Full time

    Job DescriptionJob DescriptionRole: AWS Java DeveloperDuration: 6+ monthsLocation: Richmond,VA, Plano,TX, McLean,VA Spring Boot,Java,AngularAWS,KubernetesKafkaRequirement: Bachelor's degree in Computer Science or related field or equivalent combination of industry-related professional experience and education.


  • Richmond, United States Precision Technologies Full time

    Position: Sr. Full Stack Java Developer/LeadLocation: Richmond, VA (Onsite)Interview Type: In-Person OnlyWork Arrangement: 100% OnsiteLocal Candidates OnlyComplete Description:Seeking an experienced Sr. Full Stack Java Developer/Lead with expertise in Java/J2EE, AWS services, DocuSign API integration, and web development technologies. The role requires a...


  • Richmond, United States Precision Technologies Full time

    Position: Sr. Full Stack Java Developer/LeadLocation: Richmond, VA (Onsite)Interview Type: In-Person OnlyWork Arrangement: 100% OnsiteLocal Candidates OnlyComplete Description:Seeking an experienced Sr. Full Stack Java Developer/Lead with expertise in Java/J2EE, AWS services, DocuSign API integration, and web development technologies. The role requires a...


  • richmond, United States Precision Technologies Full time

    Position: Sr. Full Stack Java Developer/LeadLocation: Richmond, VA (Onsite)Interview Type: In-Person OnlyWork Arrangement: 100% OnsiteLocal Candidates OnlyComplete Description:Seeking an experienced Sr. Full Stack Java Developer/Lead with expertise in Java/J2EE, AWS services, DocuSign API integration, and web development technologies. The role requires a...