AWS/Pyspark Engineer

4 weeks ago


Richmond, United States Cognizant Full time

We are Cognizant Artificial Intelligence Digital technologies, including analytics and AI, give companies a once-in-a-generation opportunity to perform orders of magnitude better than ever before But clients need new business models built from analyzing customers and business operations at every angle to really understand them. With the power to apply artificial intelligence and data science to business decisions via enterprise data management solutions, we help leading companies prototype, refine, validate and scale the most desirable products and delivery models to enterprise scale within weeks *This role is not able to offer visa transfer or sponsorship now or in the future* Location - On Site, Richmond, VA We are seeking a highly skilled Sr. Developer with 5 to 7 years of experience to join our dynamic team. The ideal candidate will have extensive experience in AWS Glue AWS EMR AWS Lambda Amazon Dynamo DB Amazon S3 Apache Spark and Python. Additionally expertise in the Cards & Payments domain is essential. This role involves developing and maintaining scalable data processing solutions ensuring data integrity and optimizing performance to support our business objectives. Responsibilities Develop and maintain scalable data processing solutions using AWS Glue AWS EMR and AWS Lambda. Ensure data integrity and optimize performance for data storage solutions using Amazon Dynamo DB and Amazon S3. Use Pyspark, Apache Spark and Python to process large datasets efficiently. Collaborate with multi-functional teams to understand business requirements and translate them into technical specifications. Implement standard processes for data security and compliance within the Cards & Payments domain. Monitor and solve data processing workflows to ensure smooth operation. Provide technical guidance and mentorship to junior developers. Conduct code reviews to ensure code quality and alignment to standards. Develop and maintain documentation for data processing solutions and workflows. Stay updated with the latest industry trends and technologies to continuously improve our data processing capabilities. Participate in agile development processes including sprint planning stand-ups and retrospectives. Contribute to the design and architecture of data processing systems to ensure scalability and reliability. Required Skills & Experience 5+ years of AWS Glue AWS EMR AWS Lambda Amazon Dynamo DB and Amazon S3. Demonstrate proficiency in Pyspark, Apache Spark and Python for data processing tasks. Have in-depth knowledge of the Cards & Payments domain and related compliance requirements. Show experience in implementing data security standard processes. Display good communication skills to effectively collaborate with multi-functional teams. Be familiar with agile development methodologies and practices. Preferred Qualifications: Experience working in an Agile environment with business and technical teams Knowledge of provider-sponsored health insurance systems/processes and the healthcare industry Knowledge of ETL and ELT using tools like Informatica Salary and Other Compensation: Applications will be accepted until 09/14/2024 The annual salary for this position is between $68,000 – $123,000 USD depending on experience and other qualifications of the successful candidate. This position is also eligible for Cognizant’s discretionary annual incentive program, based on performance and subject to the terms of Cognizant’s applicable plans. Benefits: Cognizant offers the following benefits for this position, subject to applicable eligibility requirements: Medical/Dental/Vision/Life Insurance Paid holidays plus Paid Time Off 401(k) plan and contributions Long-term/Short-term Disability Paid Parental Leave Employee Stock Purchase Plan Disclaimer: The salary, other compensation, and benefits information is accurate as of the date of this posting. Cognizant reserves the right to modify this information at any time, subject to applicable law.


  • Data Engineer

    2 weeks ago


    Richmond, United States Strategic Staffing Solutions Full time

    Data Engineer - Python, PySpark, AWS W2 ONLY- NO C2C Location: Richmond, VA Setting: May work remote or on site Contract: 4+months Beware of scams. S3 never asks for money during its onboarding process. Position Overview: As a Data Engineer, you will be responsible for designing, implementing, and maintaining scalable data pipelines and...


  • Richmond, United States Numero Data Full time

    Job requirements:• 5 years of experience ideal, but flexible• EMR in AWS, Hadoop• Large regulatory reporting application - supports 7 regulatory reporting use cases, for other banks this would have to be 7 different applications due to the scale• Pulls data from all systems across C1, do large transformations and prepare regulatory reporting and...


  • Richmond, United States Numero Data Full time

    Job requirements:• 5 years of experience ideal, but flexible• EMR in AWS, Hadoop• Large regulatory reporting application - supports 7 regulatory reporting use cases, for other banks this would have to be 7 different applications due to the scale• Pulls data from all systems across C1, do large transformations and prepare regulatory reporting and...


  • Richmond, United States Numero Data LLC Full time

    Job requirements: 5 years of experience ideal, but flexible EMR in AWS, Hadoop Large regulatory reporting application - supports 7 regulatory reporting use cases, for other banks this would have to be 7 different applications due to the scale Pulls data from all systems across C1, do large transformations and prepare regulatory reporting and report to...


  • Richmond, United States Strategic Staffing Solutions Full time

    Data Engineer – Python, PySpark, AWS ******W2 ONLY- NO C2C Location: Richmond, VA Setting: May work remote or on site  Contract: 4+months Beware of scams. S3 never asks for money during its onboarding process. Position Overview: As a Data Engineer, you will be responsible for designing, implementing, and maintaining scalable data...


  • Richmond, United States Cognizant Full time

    About Cognizant’s AI Practice - Digital technologies, including analytics and AI, give companies a once-in-a-generation opportunity to perform orders of magnitude better than ever before. However, clients need new business models built from analyzing customers and business operations at every angle to really understand them.With the power to apply...


  • Richmond, Virginia, United States Cognizant Full time

    About Cognizant's AI PracticeDigital technologies, including analytics and artificial intelligence, offer companies a unique opportunity to significantly improve their performance. However, clients need new business models built from analyzing customers and business operations from every angle to truly understand them.With the power to apply artificial...


  • Richmond, United States Cognizant Full time

    About Cognizant’s AI Practice Digital technologies, including analytics and AI, give companies a once-in-a-generation opportunity to perform orders of magnitude better than ever before. However, clients need new business models built from analyzing customers and business operations at every angle to really understand them. With the power to apply...


  • Richmond, United States Cognizant Full time

    Job Summary We are seeking an experienced Architect with 6 to 10 years of experience to join our team. The ideal candidate will have a strong background in Spark Optimization AWS IAM Big Data AWS EC2 Amazon S3 Apache Spark and Python. Additionally domain expertise in Cards and Payments is required. This role involves designing and optimizing big data...


  • Richmond, United States Cognizant Full time

    Job Summary We are seeking an experienced Architect with 6 to 10 years of experience to join our team. The ideal candidate will have a strong background in Spark Optimization AWS IAM Big Data AWS EC2 Amazon S3 Apache Spark and Python. Additionally domain expertise in Cards and Payments is required. This role involves designing and optimizing big data...


  • Richmond, United States Cognizant Full time

    Job Summary We are seeking an experienced Architect with 6 to 10 years of experience to join our team. The ideal candidate will have a strong background in Spark Optimization AWS IAM Big Data AWS EC2 Amazon S3 Apache Spark and Python. Additionally domain expertise in Cards and Payments is required. This role involves designing and optimizing big data...


  • Richmond, United States Cognizant Full time

    Job Summary We are seeking an experienced Architect with 6 to 10 years of experience to join our team. The ideal candidate will have a strong background in Spark Optimization AWS IAM Big Data AWS EC2 Amazon S3 Apache Spark and Python. Additionally domain expertise in Cards and Payments is required. This role involves designing and optimizing big data...


  • Richmond, United States Cognizant Full time

    Job Summary We are seeking an experienced Architect with 6 to 10 years of experience to join our team. The ideal candidate will have a strong background in Spark Optimization AWS IAM Big Data AWS EC2 Amazon S3 Apache Spark and Python. Additionally domain expertise in Cards and Payments is required. This role involves designing and optimizing big data...


  • Richmond, United States Cognizant Full time

    Job Summary We are seeking an experienced Architect with 6 to 10 years of experience to join our team. The ideal candidate will have a strong background in Spark Optimization AWS IAM Big Data AWS EC2 Amazon S3 Apache Spark and Python. Additionally domain expertise in Cards and Payments is required. This role involves designing and optimizing big data...


  • Richmond, VA, United States Cognizant Full time

    Job Summary We are seeking an experienced Architect with 6 to 10 years of experience to join our team. The ideal candidate will have a strong background in Spark Optimization AWS IAM Big Data AWS EC2 Amazon S3 Apache Spark and Python. Additionally domain expertise in Cards and Payments is required. This role involves designing and optimizing big data...

  • Python Data Engineer

    3 months ago


    Richmond, United States Pyramid Consulting Full time

    Immediate need for a talented Senior Data Engineer (Python). This is a 12+ Months contract opportunity with long-term potential and is located in Richmond, VA (Hybrid). Please review the job description below and contact me ASAP if you are interested. Job ID: 23-29512 Pay Range: $65-$70/hour. Employee benefits include, but are not limited to, health...

  • AWS DevOps Engineer

    7 days ago


    Richmond, United States VDart Inc Full time

    Job DescriptionJob DescriptionJob Title: AWS DevOps Engineer Job Location: Richmond, VA Job Type: Contract - 6+ MonthsRequired Skills:AWSDevOpsJob Summary:Working knowledge of containerization (Docker)and supporting technologiesExperience with Orchestration tools like KubernetesExperience working with CICD pipeline and having knowledge of ATDD...

  • AWS DevOps Engineer

    7 days ago


    Richmond, United States TekWissen LLC Full time

    Job DescriptionJob DescriptionOverview: TekWissen Group is a workforce management provider throughout the USA and many other countries in the world. Our client is an American multinational information technology services and consulting company and is a leading provider of information technology, consulting, and business process outsourcing services,...


  • Richmond, United States Pyramid Consulting Full time

    Immediate need for a talented Data Engineer/ Platform Engineer. This is a 12+ Months Contract opportunity with long-term potential and is located in McLean, VA/Richmond, VA (Hybrid). Please review the job description below and contact me ASAP if you are interested. Job ID:24-34210 Pay Range: $50 - $55/hour. Employee benefits include, but are not limited...

  • Cloud/Data Engineer

    2 weeks ago


    Richmond, United States Pyramid Consulting, Inc Full time

    Immediate need for a talented Cloud/Data Engineer. This is a 04+months contract opportunity with long-term potential and is located in Richmond, VA (Hybrid). Please review the job description below and contact me ASAP if you are interested.Job ID:24-38601 Pay Range: $60 - $65/hour. Employee benefits include, but are not limited to, health insurance (medical,...