Aws Glue Data Lead

2 weeks ago


Richmond, United States Cognizant Full time

**We are Cognizant Artificial Intelligence**

Digital technologies, including analytics and AI, give companies a once-in-a-generation opportunity to perform orders of magnitude better than ever before. However, clients need new business models built from analyzing customers and business operations at every angle to really understand them.

**You must be legally authorized to work in the United States without the need of employer sponsorship, now or at any time in the future **

**Job Title: AWS Glue Data Lead (Onsite)**

**Job Summary**
- We are seeking an experienced Architect/Manager
- Projects with a strong background in Python, Apache Spark, and AWS services, particularly AWS Glue technologies.
- With a focus on innovation and efficiency this role will contribute significantly to our project management team driving the success of our data-driven initiatives.

**Required Skills**:
Technical Skills: AWS Glue.

Technical Skills: Python, Apache Spark, Catalog, ETL, Studio Spark Optimization and Databrew.

**Roles/Responsibilities**
- Lead the design and implementation of scalable data processing architectures using Python and Apache Spark.
- Utilize AWS Glue Catalog, AWS Glue ETL, and AWS Glue Studio to manage and transform large datasets efficiently.
- Leverage AWS Glue Databrew for data preparation and cleaning, ensuring high-quality data for analytics.
- Collaborate with the development team to integrate AWS services like AWS IAM Amazon S3, and Amazon DynamoDB into the data architecture.
- Oversee the deployment of data pipelines in AWS utilizing AWS CloudWatch and AWS DevOps practices for monitoring and automation.
- Ensure data security and compliance by implementing robust access controls and monitoring with AWS IAM and AWS Cloud Formation.
- Drive innovation by exploring and integrating new AWS technologies and services into the data architecture.
- Provide technical leadership and guidance to the team fostering a culture of continuous improvement and learning.
- Contribute to risk management strategies identifying potential issues and developing mitigation plans.
- Support the Cards & Payments domain with high-quality reliable data solutions that meet business needs.
- Qualifications
- Proven experience with Python, Apache Spark, and AWS Glue technologies is mandatory.
- Familiarity with Amazon DynamoDB, Amazon Redshift, and AWS IAM is highly desirable.
- Strong understanding of data architecture principles and best practices in the Cards & Payments domain.
- Excellent problem-solving skills and the ability to work independently or as part of a team.
- Effective communication skills with the ability to articulate technical concepts to non-technical stakeholders.
- A commitment to continuous learning and development in the field of data architecture.

**Job Location**

Primary: Richmond - VA USA

**Salary and Other Compensation**:

- Medical/Dental/Vision/Life Insurance
- Paid holidays plus Paid Time Off
- 401(k) plan and contributions
- Long-term/Short-term Disability
- Paid Parental Leave
- Employee Stock Purchase Plan

**#LI-GH1 #CB #Ind123


  • AWS Consultant

    3 weeks ago


    Richmond, Virginia, United States Cognizant Technology Solutions Full time

    Cognizant is seeking a AWS Consultant / python / spark We are seeking an experienced Architect with a focus on Manager - Projects within the Cards & Payments domain. The ideal candidate will have a strong background in Python Apache Spark AWS IAM SQL Amazon RDS Snowflake and Unix with 6 to 10 years of experience. This role is pivotal in driving our projects...

  • Sr Data Engineer

    4 days ago


    Richmond, United States LanceSoft Full time

    Job Description: Responsibilities: Be a part of team designing and building Enterprise Level scalable, low-latency, fault-tolerant data Pipelines that provides meaningful and timely insights Build the next generation Distributed Data Pipelines using programming languages like Python Be part of a group of engineers building data pipelines using big data...

  • Sr. Data Engineer

    2 weeks ago


    Richmond, United States Ampcus Full time

    Title: Sr. Data Engineer Location: Richmond, VA - 23238 - Hybrid Duration: 6 months assignment with the possibility of extension Responsibilities: Be a part of a team designing and building Enterprise Level scalable, low-latency, fault-tolerant data Pipelines that provide meaningful and timely insights Build the next generation of Distributed Data Pipelines...

  • Software Engineer

    2 weeks ago


    Richmond, United States Ampcus Full time

    Title: Software Engineer Location: Richmond, VA OR McLean, VA - Hybrid Duration: 12-month assignment with the possibility of extension JOB DESCRIPTION: Software Engineer responsible for developing and maintaining data processing application which will handle data from small to large volumes in terabytes of business critical enterprise data. Must have 4+...


  • Richmond, United States Quiddity Infotech Full time

    10+ years of experience in analytics, Spark, Scala, Python, and associated data engineering jobs. - Must have experience with managing and transforming big data sets using PySpark, spark-scala - Experience with AWS services - Glue, Lambda, EMR, Redshift, RDS - Experience in managing Python codes and collaborating with customer on model evolution - Good...


  • Richmond, United States Ageatia Global Solutions Full time

    Designs, develops, modifies, tests and automation used to provide data warehouse and business intelligence applications solutions. This includes design, development, architecture recommendations, quality management, metadata and repository creation, trouble-shooting problems and tuning warehouse applications. Develops transition and implementation plans....


  • Richmond, United States Delphi-US Full time

    Job Title: Data Warehouse Developer / Data Engineer (Contract) - Job#4252) Location: Hybrid. Richmond, VA. 2 days onsite Job Description: This client is seeking resources with abilities to design, develop, modify, test and automate to provide data warehouse and business intelligence applications solutions. This includes design, development, architecture...

  • AWS Cloud Architect

    1 month ago


    Richmond, United States CareerBuilder Full time

    Role: AWS Cloud ArchitectLocation: Richmond VA(Hybrid)Duration: 6+Months Job Description: Job responsibilities includes Evaluate existing AWS instances and provide recommendations as required. Looking for ways to improve operations within the agency to digitize common tasks. Design and build enterprise wide cloud solutions on a global scale. Create a...

  • BigData Consultants

    2 months ago


    Richmond, Virginia, United States Vedainfo Full time

    Job Role BigData Consultant with AWS Location Richmond VA Project Duration 12+ Months 2+ years- experience in Hadoop Spark Good knowledge on frameworks like Spark Beam Flink HDFS HIVE HBASE Good knowledge of SQL Good understanding of AWS components storage (S3) & compute services (EC2); hands on experience of AWS managed services (lambda Athena) and ETL...

  • Cloud AWS Engineer

    4 days ago


    Richmond, United States Ampcus Incorporated Full time

    Title: Cloud AWS Engineer Location: Richmond, VA 23219 - Remote Duration: 12 months assignment with the possibility of extension Qualifications: Data management and analytics visualization are growing areas of emphasis across the Client’s System. As a software engineer (visual analytics support facilitator) within Enterprise Data Services, you will be...

  • BigData Consultants

    2 months ago


    Richmond, United States Vedainfo Full time

    Job Role BigData Consultant with AWS Location Richmond VA Project Duration 12+ Months 2+ years- experience in Hadoop Spark Good knowledge on frameworks like Spark Beam Flink HDFS HIVE HBASE Good knowledge of SQL Good understanding of AWS components storage (S3) & compute services (EC2); hands on experience of AWS managed services (lambda ...

  • Spark/Scala Developer

    2 months ago


    Richmond, United States Advaana Staffing Full time

    Role Spark/Scala DeveloperLocation Richmond VADuration Long Term ContractRequirements• 5+ years’ experience in any flavor of SQL dealing with complex queries analytics and data models.• 3+ years’ experience in any of the modern programming languages.• Should have thorough understanding of Hadoop concepts.• Must have 4+ years of experience in...

  • Technical Lead

    3 days ago


    Richmond, United States Ascendion Full time

    Key Responsibilities:Develop user-facing features using Vue.jsBuild and maintain backend services with Node.jsDesign and implement scalable applications on AWS infrastructureCollaborate with cross-functional teams to analyze, design, and ship new featuresImplement security and data protection solutionsOptimize applications for maximum speed and...


  • Richmond, United States Pyramid Consulting Full time

    Immediate need for a talented Senior Data Engineer (Python). This is a 12+ Months contract opportunity with long-term potential and is located in Richmond, VA (Hybrid). Please review the job description below and contact me ASAP if you are interested. Job ID: 23-29512 Pay Range: $65-$70/hour. Employee benefits include, but are not limited to, health...

  • Spark/Scala Developer

    2 months ago


    Richmond, Virginia, United States Advaana Staffing Full time

    Role Spark/Scala DeveloperLocation Richmond VADuration Long Term ContractRequirements 5+ years' experience in any flavor of SQL dealing with complex queries analytics and data models. 3+ years' experience in any of the modern programming languages. Should have thorough understanding of Hadoop concepts. Must have 4+ years of experience in Spark & Scala....


  • Richmond, United States Hudson Data Full time

    Job Title: Lead Azure Developer Location: Richmond, VA (Hybrid) Duration: Long Term In-Person Interview Description: Note: This is an In-Person Interview and this position requires that the resource works onsite 2 -3 days a week or as needed. *Local Richmond, VA candidates strongly preferred *Candidate must be able to work onsite as needed, up...


  • Richmond, United States JobRialto Full time

    Job Summary : DBA with Production support experience Should have AWS knowledge with Performance Tuning experience Roles & Responsibilities : 9 +Experience with Oracle RAC ASM Data Guard OEM performance tuning RMAN and UNIX Highly qualified candidates having experience with Exadata Golden Gate and patching Manage and maintain data in all production and...


  • Richmond, United States JobRialto Full time

    Job Summary : DBA with Production support experience Should have AWS knowledge with Performance Tuning experience Roles & Responsibilities : 9 +Experience with Oracle RAC ASM Data Guard OEM performance tuning RMAN and UNIX Highly qualified candidates having experience with Exadata Golden Gate and patching Manage and maintain data in all production and...

  • Data Modeler

    5 days ago


    Richmond, United States Saxon Global Full time

    Modeling for large enterprise systems, legacy modernization and detailed work, and ability to work in gray space. Not an easy combination to find, but it's what I need. Must-have skills: Hands-on data modeling for large enterprise systems Logical and physical data modeling The problem space is modernization of legacy systems so need someone who has done...


  • Richmond, United States Cynet Systems Full time

    Job Description: Responsibilities: Understand technology vision and strategic direction of business needs Understand our current data model and infrastructure, proactively identify gaps, areas for improvement, and prescribe architectural recommendations with a focus on performance and accessibility. Partner across engineering teams to...