Sr. AWS Glue ETL Developer

1 week ago

Windsor Mill, United States Global Commerce and Information, Inc. Full time
Your Success is Our Success. Global CI is an award-winning 30-year IT Services company founded on the principles of providing high-quality, value-added technology consulting services. Our vision is to create a better future by improving the lives of the people we serve through emerging technologies. Join us and together we will advance the future of technology services.
Global CI offers competitive compensation and non-salary benefits to all eligible employees.

Job Description

Global CI is seeking a Sr. AWS Glue ETL Developer with strong systems, software, and AWS cloud experience to support a major mainframe systems modernization initiative for federal customer. Based in DevOps framework, participate in and/or direct major deliverables of projects through all aspects of the software development lifecycle including scope and work estimation, architecture and design, coding, unit testing, support deployments and testing in higher environments.

Primary Responsibilities:

• Re-engineer mainframe batch jobs to equivalent ETL batch processes, preferably using Cloud-Native tools like AWS Glue.

• Leverage serverless cloud services to prepare (extract and transform) and load large numbers of datasets for data processing.

• Coordinate closely with mainframe resources to ensure requirements and specifications are clearly understood.

• Design Glue jobs to meet requirements, consider performance where applicable, code per standards, and perform end-to-end testing.

• Document the design specifications and contribute to implementation plan then work with the architecture team and lead developer to review the design and the code.

• Effectively coordinate the infrastructure/service needs working with the architecture and infrastructure teams.

• Implement overall solution comprising of Glue ETL PySpark jobs including SQL queries, Lambda, Step Functions, REST API calls.

• Develop and integrate custom developed software solutions to leverage automated deployment technologies.

• Use industry leading DevOps tools such as CodeCommit, CodeBuild, CodePipeline and AWS CloudFormation.

• Communicate key project data to team members and infrastructure team cohesion and effectiveness.

• Leverage Atlassian tool suite like JIRA and Confluence to track activities.

• Identify and apply best practices and standard operating procedures.

• Create innovative solutions to meet the technical needs of customers.
Basic Qualifications:

• Experience working in the software development lifecycle, with strong experience on ETL based development.

• Working experience with development using Amazon Web Services (AWS) and primarily on AWS Glue studio.

• Experience working with programming language PySpark/Python

• Experience working with relational database like PostgreSQL.

• Experience working in a fast-paced development environment with drive to completion.

• Well versed with using version control systems (CodeCommit, CodeBuild, CodePipeline preferred)

• Well versed with using issue/problem tracking systems (Jira preferred)

• Candidate must have bachelor's with 8-12 years of prior relevant experience or master's with 6-10 years of prior relevant experience

Preferred Qualifications:

• Familiarity working with multiple file formats, and knowledge on DB2, JCL, COBOL COPYBOOK and EBCDIC character format is strongly desired.

• Prior experience working mainframe modernization.

• Prior experience with Linux bash scripting

Benefits include:
  • Comprehensive medical, dental, vision, life, and short & long-term disability insurance + health savings account
  • Matching 401k retirement plan + IRA's and Roth IRA's
  • Generous paid time off and paid holidays
  • Employee recruitment/referral bonus
  • Paid community service hours
  • Tuition reimbursement
  • Employee discounts
At Global Commerce & Information, Inc. we celebrate, support, and are committed to creating a diverse and inclusive environment. We're proud to be an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, veteran status, or any other legally protected characteristics.
Global Commerce & Information, Inc maintains a drug-free workplace.

  • Sr. AWS Glue ETL Developer

    1 month ago

    Windsor Mill, United States Global Commerce and Information, Inc. Full time

    Your Success is Our Success. Global CI is an award-winning 30-year IT Services company founded on the principles of providing high-quality, value-added technology consulting services. Our vision is to create a better future by improving the lives of the people we serve through emerging technologies. Join us and together we will advance the future of...

  • Sr. AWS Glue ETL Developer

    4 weeks ago

    Windsor Mill, United States Global Commerce and Information, Inc. Full time

    Your Success is Our Success. Global CI is an award-winning 30-year IT Services company founded on the principles of providing high-quality, value-added technology consulting services. Our vision is to create a better future by improving the lives of the people we serve through emerging technologies. Join us and together we will advance the future of...

  • AWS Glue ETL Developer

    1 month ago

    Windsor Mill, United States Global Commerce and Information, Inc. Full time

    Your Success is Our Success. Global CI is an award-winning 30-year IT Services company founded on the principles of providing high-quality, value-added technology consulting services. Our vision is to create a better future by improving the lives of the people we serve through emerging technologies. Join us and together we will advance the future of...

  • AWS Glue ETL Developer

    4 weeks ago

    Windsor Mill, United States Global Commerce and Information, Inc. Full time

    Your Success is Our Success. Global CI is an award-winning 30-year IT Services company founded on the principles of providing high-quality, value-added technology consulting services. Our vision is to create a better future by improving the lives of the people we serve through emerging technologies. Join us and together we will advance the future of...

  • AWS Sr. Developer/Technical Lead

    1 month ago

    Windsor Locks, United States Diverse Lynx Full time

    Role: AWS Sr. Developer/Technical Lead Location: Hartford, CT or Bloomfield CT or Denver CO (Onsite) Duration: Full-time Experience Required •Required Technical Skill Set** - AWS native services like EC2, Lambda, EMR, VPC, EBS, SNS, RDS, Dynamo DB, ELB, Cloud Watch, Cloud trail, Auto. Scaling, S3, and Route53 Desired Experience Range** 10+ years...

  • Sr. AWS Data Engineer

    6 days ago

    Fort Mill, United States Incedo Inc. Full time

    Job Title: Sr. AWS Data EngineerJob Location: Fort Mill, SC (Onsite 2-3 Days)Job Type: W2 Contract / Full TimeMust Have Skills: Data EngineerPython AWS (Glue, Lambda, S3) API DevOps (CI/CD Pipeline)

  • Snowflake AWS Data Engineer with Python

    2 days ago

    Fort Mill, United States New York Technology Partners Full time

    Hello , I hope you are doing good. We are constantly on the lookout for professionals to fulfil the staffing needs of our clients, and we currently have a job opening that may interest you. Role: Snowflake AWS Data Engineer with PythonDuration: Long Term ContractLocation: Fort Mill, SC Job Description: We are seeking a highly skilled and experienced Data...

  • Snowflake AWS Data Engineer with Python

    1 day ago

    Fort Mill, United States New York Technology Partners Full time

    Hello , I hope you are doing good. We are constantly on the lookout for professionals to fulfil the staffing needs of our clients, and we currently have a job opening that may interest you. Role: Snowflake AWS Data Engineer with PythonDuration: Long Term ContractLocation: Fort Mill, SC Job Description: We are seeking a highly skilled and experienced Data...

  • Scrum Master

    3 weeks ago

    Fort Mill, United States Acunor Inc Full time

    Job DescriptionJob DescriptionPosition Overview:As a Scrum Master with AWS, ETL, and Snowflake expertise, you will be responsible for facilitating the agile development process, ensuring the team follows agile practices, and managing the day-to-day operations of data projects. Your role will involve close collaboration with cross-functional teams to ensure...

  • AWS Big Data/Data Analytics Lead

    1 week ago

    Windsor Locks, Connecticut, United States Diverse Lynx Full time

    Role: AWS Big Data/Data Analytics Lead/Consultant Location: Hartford, CT (min engagement is 6 months) Job Description: Must have experience in Leading Solution design, reviewing Complex Data Analytics Architectures. Minimum of 5 years of Consulting or client service delivery experience on Amazon AWS (AWS). Minimum of 10 years of experience in...

  • AWS Big Data/Data Analytics Lead

    2 months ago

    Windsor Locks, United States Diverse Lynx Full time

    Role: AWS Big Data/Data Analytics Lead/Consultant Location: Hartford, CT (min engagement is 6 months) Job Description: Must have experience in Leading Solution design, reviewing Complex Data Analytics Architectures. Minimum of 5 years of Consulting or client service delivery experience on Amazon AWS (AWS). Minimum of 10 years of experience in...

  • Data Engineer

    5 hours ago

    Fort Mill, United States JobRialto Full time

    Job Description: We are seeking a highly skilled and experienced Data Engineer to join our team. The ideal candidate will have expertise in the following areas: Snowflake, Snowpark: The candidate should have a deep understanding of Snowflake data warehousing platform and be proficient in using Snowpark for data processing and analytics. DBT: Experience with...

  • Snowflake Data Engineer

    1 week ago

    Fort Mill, United States Ampcus Incorporated Full time

    Role: Snowflake Data Engineer Work Location: Fort Mill , SC Hybrid Duration: 6+ Months Assignment' Job Description: We are seeking a highly skilled and experienced Data Engineer to join our team.  The ideal candidate will have expertise in the following areas: 1. Snowflake, Snowpark: The candidate should have a deep understanding of Snowflake data...

  • Snowflake Data Engineer

    1 week ago

    Fort Mill, United States Ampcus Full time

    Role: Snowflake Data Engineer Work Location: Fort Mill , SC Hybrid Duration: 6+ Months Assignment'Job Description: We are seeking a highly skilled and experienced Data Engineer to join our team. The ideal candidate will have expertise in the following areas: 1. Snowflake, Snowpark: The candidate should have a deep understanding of Snowflake data warehousing...

  • Snowflake Data Engineer

    3 weeks ago

    Fort Mill, United States Ampcus Full time

    Role: Snowflake Data Engineer Work Location: Fort Mill , SC Hybrid Duration: 6+ Months Assignment'Job Description: We are seeking a highly skilled and experienced Data Engineer to join our team. The ideal candidate will have expertise in the following areas: 1. Snowflake, Snowpark: The candidate should have a deep understanding of Snowflake data warehousing...

  • Senior Snowflake Developer with Strong exp in Sql and ETL

    3 weeks ago

    Windsor, United States AKT Corp Full time

    Job DescriptionJob DescriptionPosition: Senior Snowflake Developer with Strong exp in Sql and ETL Location: Windsor, CT (Hybrid)Must HaveSnowflake, MSSQLInformatica, MatillionAbility to communicate effectively with colleagues, clients, and stakeholders.Experience working with Cloud Technologies: AWS, IAM, S3, EFS, Amazon SQS, Amazon SNS, AWS APIs, AWS CLI,...

  • Snowflake Data Engineer

    1 hour ago

    Fort Mill, United States New York Technology Partners Full time

    Role : Snowflake Data EngineerDuration : Long Term Contact Location : Fort Mill SC Hybrid JD: "We are seeking a highly skilled and experienced Data Engineer to join our team. The ideal candidate will have expertise in the following areas: 1. Snowflake, Snowpark: The candidate should have a deep understanding of Snowflake data warehousing platform and be...

  • Snowflake Data Engineer

    24 hours ago

    Fort Mill, South Carolina, United States Capgemini Full time

    Title - Snowflake Data Engineer - AWSLocation - Fort Mills SC (Hybrid)Duration – FulltimeKey ResponsibilitiesDesign develop and maintain data pipelines and ETL processes using Snowflake AWS services Python and DBT Collaborate with data scientists and analysts to understand data requirements and implement solutionsOptimize data workflows for performance...

  • Data Engineer

    2 days ago

    Fort Mill, United States Triunity Software, Inc. Full time

    Title: Data Engineer (W2 Only)Location: Fort Mills, SC (Hybrid) (within 50 miles only)JD: "We are seeking a highly skilled and experienced Data Engineer to join our team. The ideal candidate will have expertise in the following areas: 1. Snowflake, Snowpark: The candidate should have a deep understanding of Snowflake data warehousing platform and be...

  • Snowflake Data Engineer

    1 day ago

    Fort Mill, United States New York Technology Partners Full time

    Role : Snowflake Data EngineerDuration : Long Term Contact Location : Fort Mill SC Hybrid JD: "We are seeking a highly skilled and experienced Data Engineer to join our team. The ideal candidate will have expertise in the following areas: 1. Snowflake, Snowpark: The candidate should have a deep understanding of Snowflake data warehousing platform and be...