Data Engineer
2 months ago
We are seeking an experienced AWS Glue Specialist to join our team and lead the migration of ETL processes from IBM DataStage to AWS Glue. This role requires hands-on expertise in designing, developing, and optimizing ETL pipelines, with a focus on migrating data from various sources, both on-premises and cloud-based. The ideal candidate will have a proven ability to work independently and collaborate with multi-domain teams to ensure successful data integration and transformation.
Key Responsibilities
- Lead the migration of ETL processes from IBM DataStage to AWS Glue, ensuring efficiency and reliability.
- Design, develop, and optimize ETL pipelines using AWS Glue, incorporating best practices for performance, scalability, and cost-efficiency.
- Analyze existing DataStage ETL workflows to identify and implement optimized solutions in the AWS environment.
- Extract data from diverse sources (on-premises and cloud) and transform it into a cloud-compatible format using AWS Glue.
- Collaborate with cross-functional teams to understand data requirements and ensure seamless data integration across multiple domains.
- Independently troubleshoot and resolve technical challenges, ensuring data integrity and compliance with project timelines.
- Document technical specifications, data flows, and transformation logic for ETL processes.
- Monitor and maintain ETL pipelines to ensure continuous operation, making enhancements as needed.
- Support the team with best practices in cloud data management and AWS Glue usage.
Qualifications
- 5+ years of experience in ETL development, with a focus on data migration.
- 3+ years of hands-on experience with AWS Glue, including job creation, workflow orchestration, and optimization.
- Proven expertise in IBM DataStage and experience in migrating ETL jobs to cloud platforms, particularly AWS.
- Strong knowledge of AWS services (S3, Lambda, CloudWatch, Redshift, RDS, etc.) and how they integrate with AWS Glue.
- Experience with Python or PySpark for ETL scripting and transformations.
- Familiarity with SQL and relational databases, as well as NoSQL databases.
- Strong problem-solving skills with the ability to work independently and collaborate across multiple teams.
- Excellent communication skills for interacting with stakeholders and documenting processes.
Preferred Skills
- Experience with AWS Data Migration Services (DMS) or other data migration tools.
- Knowledge of data warehousing concepts and best practices.
- AWS certifications (e.g., AWS Certified Data Analytics, AWS Certified Solutions Architect) are a plus.
- Familiarity with Agile methodologies and experience working in a fast-paced environment.
-
S Slalom Data Engineer- Senior Consultant
3 weeks ago
Atlanta, GA, United States Data Engineer Jobs Full time*Please note: This role is not eligible for 100% remote work. Employees must live within a commutable distance of the Atlanta Area and must be willing to be onsite at the client and/or Slalom Atlanta office up to 5 days a week.* Who You'll Work With As a modern technology company, our Slalom Technologists are disrupting the market and bringing to life the...
-
Commissioning Engineer for Data Centers
4 days ago
Atlanta, Georgia, United States T5 Data Centers Full timeAbout T5 Data Centers:As a leading provider of customized data center solutions, T5 Data Centers has been supporting enterprise and hyperscale customers since 2008. With over 400 engineers, technicians, and professional staff, we are dedicated to delivering unrivaled quality across the lifecycle of our core data centers. From turnkey development to...
-
Quality Assurance Engineer
4 days ago
Atlanta, Georgia, United States T5 Data Centers Full timeCompany ProfileT5 Data Centers is an innovative company that specializes in delivering high-quality data center solutions. Our mission is to provide exceptional service, expertise, and flexibility to our clients. As a Data Center Commissioning Engineer, you will play a key role in ensuring that our data centers meet the highest standards of quality and...
-
Data Engineer Data Engineer
7 days ago
Atlanta, United States IRIS Consulting Corporation Full timeManage and transfer large data volumes via Data Lake and/or Teradata. · Design and implement database structures that support efficient data storage and retrieval. · Develop and maintain data models using Erwin Data Modeling Tool. · Perform dimensional modeling and ensure data warehouse optimization. · Write and optimize SQL queries (DMLs and DDLs)...
-
Data Engineer
5 months ago
Atlanta, United States iVoyant Full timeAbout the job Data Engineer iVoyant is looking for multiple Data Engineers to join our client Digital Team. The Data Engineers will work with the client functional SMEs within the Digital and the Business team to understand the requirements and prepare technical design. They will ensure the availability and validity of the data to ensure that it fits with...
-
Data Engineer
2 weeks ago
Atlanta, United States Salesforce.Com Inc Full timeTo get the best candidate experience, please consider applying for a maximum of 3 roles within 12 months to ensure you are not duplicating efforts. Job Category Software Engineering Job Details About Salesforce We're Salesforce, the Customer Company, inspiring the future of business with AI+ Data +CRM. Leading with our core values, we help companies across...
-
Data Engineer
1 month ago
Atlanta, United States Insight Global Full timeWe are actively seeking a skilled Data Engineer to join our innovative team in Atlanta. This is a contract-to-hire position with a decision expected by the end of the year. The ideal candidate will have extensive experience working with offshore teams and a strong background in data engineering and data science projects.Responsibilities:Collaborate with a...
-
Data Engineer
2 weeks ago
Atlanta, Georgia, United States TechnoGen Full timeAt TechnoGen, we are seeking a talented Data Engineer to join our team. As a key member of our data engineering group, you will be responsible for designing, building, and maintaining large-scale data systems.The ideal candidate will have a strong background in computer science, mathematics, or a related field, with experience working with various relational...
-
Data Engineer
1 month ago
Atlanta, United States RIT Solutions, Inc. Full timeData Engineer | TELECOMMUTE TELECOMMUTE, MN Job Description 100% telecommute Hours: Regular day working hours with some flexibility, but must be available for most of Central Time working hours with a heavier focus on availability in the mornings. Project: Working with customers to design data extracts based on their reporting needs ...
-
Data Engineer
2 days ago
Atlanta, United States Motion Recruitment Full timeData EngineerLocation: Atlanta GA 30354 (Hybrid) ONLY W2 ---NO C2C Candidate ---- 5 or more years of hands-on experience as a Data Analyst or related technical engineering capacity. Relevant technologies and programming languages include JAVA, Spring Boot, Python, IBM MQ, Oracle Database table design, queries and optimization.Expertise in Database Design,...
-
Data Engineer
3 days ago
Atlanta, United States Motion Recruitment Full timeData EngineerLocation: Atlanta GA 30354 (Hybrid) ONLY W2 ---NO C2C Candidate ---- 5 or more years of hands-on experience as a Data Analyst or related technical engineering capacity. Relevant technologies and programming languages include JAVA, Spring Boot, Python, IBM MQ, Oracle Database table design, queries and optimization.Expertise in Database Design,...
-
Data Engineer
2 days ago
Atlanta, United States Motion Recruitment Full timeData EngineerLocation: Atlanta GA 30354 (Hybrid)Term: 12 Months Contract (W2 Only)Qualifications:5 or more years of hands-on experience as a Data Analyst or related technical engineering capacity. Relevant technologies and programming languages include JAVA, Spring Boot, Python, IBM MQ, Oracle Database table design, queries and optimization.Expertise in...
-
Data Engineer
3 days ago
Atlanta, United States Motion Recruitment Full timeData EngineerLocation: Atlanta GA 30354 (Hybrid)Term: 12 Months Contract (W2 Only)Qualifications:5 or more years of hands-on experience as a Data Analyst or related technical engineering capacity. Relevant technologies and programming languages include JAVA, Spring Boot, Python, IBM MQ, Oracle Database table design, queries and optimization.Expertise in...
-
Data Engineer
2 days ago
Atlanta, United States Motion Recruitment Full timeData EngineerAtlanta, GAContract roleQualifications:5 or more years of hands-on experience as a Data Analyst or related technical engineering capacity. Relevant technologies and programming languages include JAVA, Spring Boot, Python, IBM MQ, Oracle Database table design, queries and optimization.Expertise in Database Design, Dimensional Modeling, and Data...
-
Data Engineer
3 days ago
Atlanta, United States Motion Recruitment Full timeData EngineerAtlanta, GAContract roleQualifications:5 or more years of hands-on experience as a Data Analyst or related technical engineering capacity. Relevant technologies and programming languages include JAVA, Spring Boot, Python, IBM MQ, Oracle Database table design, queries and optimization.Expertise in Database Design, Dimensional Modeling, and Data...
-
Data Engineer
1 week ago
Atlanta, United States Datum Technologies Group Full timeData Engineer #39559 Long-Term Contract Hybrid Schedule Atlanta, Ga Top Skills: Management and transfer of large volumes of data via Data Lake and/or Teradata, Data modeling, fine tuning of queries, creating tables and manage data relationships. Qualifications: 5 or more years of hands-on experience as a Data Analyst or related technical engineering...
-
Data Engineer
2 days ago
Atlanta, United States Pinnacle Group, Inc. Full timeJob Title: Data EngineerLocation: Atlanta, GA 30309.Duration: 6 Month of Project (Temp to Hire)Pay Rate: $60/hr. $65/hr. on W2 (without benefit) Job Summary:At Regions, the Software Engineer oversees application development, modification, and maintenance of applications. This position monitors system applications, ensures systems run smoothly, and creates...
-
Data Engineer
3 days ago
Atlanta, United States Pinnacle Group, Inc. Full timeJob Title: Data EngineerLocation: Atlanta, GA 30309.Duration: 6 Month of Project (Temp to Hire)Pay Rate: $60/hr. $65/hr. on W2 (without benefit) Job Summary:At Regions, the Software Engineer oversees application development, modification, and maintenance of applications. This position monitors system applications, ensures systems run smoothly, and creates...
-
Data Engineer
4 weeks ago
Atlanta, United States Ampcus Full timeAmpcus Inc. is a certified global provider of a broad range of Technology and Business consulting services. We are in search of a highly motivated candidate to join our talented Team. Job Title: Data Engineer Location(s): Atlanta, GA (Remote) Experience: A Data Engineer who has hands on experience (2 years preferred) ingesting Clickstream data preferably...
-
Data Engineer
2 days ago
Atlanta, United States Motion Recruitment Full timeJob Title: Sr. Data EngineerLocation: 1030 Delta Boulevard, Atlanta, GA 30354, United StatesType: Contract (Hybrid)Overview: We are seeking a Sr. Data Engineer with expertise in cloud and data technologies, strong SQL skills, and a track record of improving data pipelines.Required Skills & Experience:Bachelor of Science in Computer Science or...