Sr. Data Engineer

1 month ago

Atlanta, United States TechnoGen Full time
Title:: Sr. Data Engineer (Teradata ETL with AWS exp.)

Location:: Atlanta, GA (Hybrid role, 3x days onsite/week)

Type of Hire:: Contract (c2c/w2)

Duration:: 12 months

Job ID: 38955

Qualifications:

Required Skillsets:

Teradata Expertise:
• In-depth knowledge of Teradata architecture and components (e.g., AMP, Nodes, Parsing Engines, etc.).
• Proficiency in Teradata SQL and Teradata utilities.

SQL and Scripting:
• Strong SQL skills for querying and managing relational databases.
• Scripting experience (e.g., Shell, Python) for automating tasks.
• Know tools like Teradata Utilities (e.g., BTEQ, FastLoad, MultiLoad, TPT, etc.).

ETL Tools:
• Experience with ETL tools and technologies used in Teradata environments.

Performance Optimization:
• Knowledge of query optimization techniques, indexing, partitioning, and workload management in Teradata.

Data Warehousing Concepts:
• Strong understanding of data warehousing principles, including star/snowflake schemas, OLAP, and ETL processes.

Cloud Platform / AWS Expertise:
• Proficiency with core AWS services: EC2, S3, RDS, Lambda, CloudWatch, CloudFormation, etc.
• Experience with AWS networking (VPC, subnets, security groups, NACLs) and security management.
• Familiarity with AWS storage options, such as S3, EFS, and Glacier, in the context of large-scale data storage and retrieval.

Teradata and AWS Integration:
• Experience deploying and managing Teradata in AWS cloud environments.
• Knowledge of AWS services that enhance Teradata performance, such as using S3 for staging data or integrating with Redshift for analytics.

Automation and Infrastructure as Code (IaC):
• Hands-on experience with AWS CloudFormation, Terraform, or similar tools for automating infrastructure deployment.
• Proficiency in automating ETL pipelines and data processing workflows using AWS Lambda, Step Functions, or AWS Glue.

Data Security in AWS:
• Understanding of encryption and security protocols for data stored and processed in AWS.
• Experience implementing compliance standards such as GDPR, HIPAA, or other data protection regulations in cloud environments.

Key Responsibilities:

Database Management:
• Design, implement, and maintain Teradata databases.
• Optimize and tune queries for performance.
• Monitor and troubleshoot database issues.

ETL Development:
• Develop and maintain ETL (Extract, Transform, Load) processes for data integration and transformation.
• Use tools like Teradata Utilities (e.g., BTEQ, FastLoad, MultiLoad, TPT, etc.).

Data Modeling:
• Create and maintain data models to support business processes.
• Work with stakeholders to understand data requirements and design solutions.

Performance Tuning:
• Identify and resolve performance bottlenecks in SQL queries, system configuration, or data design.
• Regularly monitor and optimize system performance.

Data Security & Governance:
• Implement data security best practices.
• Ensure compliance with data governance policies and regulations.

Cloud Integration and Management:
• Implement and manage Teradata on AWS infrastructure, leveraging AWS services for scalability and performance.
• Manage data migration from on-premises Teradata environments to AWS cloud-based Teradata instances.
• Ensure seamless integration between Teradata and AWS services like S3, Redshift, RDS, and Lambda.

Cloud Infrastructure:
• Design and deploy cloud infrastructure (VPCs, EC2 instances, S3 buckets) to support Teradata environments.
• Implement networking and security best practices in AWS to ensure secure data access and storage.

Automation and DevOps:
• Automate infrastructure provisioning, scaling, and monitoring using AWS tools like CloudFormation, Terraform, or AWS CLI.
• Use AWS Lambda for automating ETL processes or handling specific workloads.

Data Warehousing and Analytics:
• Leverage AWS data services (e.g., Redshift, Athena, Glue) to complement Teradata workloads.
• Implement data pipelines using AWS services for ETL processes, integrating data from various sources into Teradata.

Security and Compliance:
• Implement AWS security best practices, such as IAM roles and policies, to secure Teradata environments in the cloud.
• Ensure compliance with relevant data governance policies, including encryption at rest and in transit.

Collaboration:
• Work closely with data architects, analysts, and other stakeholders to understand data needs and deliver solutions.

  • Sr. Data Engineer

    1 month ago

    Atlanta, United States VDart Full time

    Job Title: Sr. Data engineer Location: Atlanta, GA - Onsite Duration: / Term: 6+ months - Contract Job Description: Proficiency in data modeling and database management. Strong programming skills (e.g., Python, Java, or SQL). Experience in Snowflake Knowledge of big data technologies like Hadoop and Spark. Experience with ETL (Extract, Transform, Load)...

  • S Slalom Data Engineer- Senior Consultant

    4 weeks ago

    Atlanta, GA, United States Data Engineer Jobs Full time

    *Please note: This role is not eligible for 100% remote work. Employees must live within a commutable distance of the Atlanta Area and must be willing to be onsite at the client and/or Slalom Atlanta office up to 5 days a week.* Who You'll Work With As a modern technology company, our Slalom Technologists are disrupting the market and bringing to life the...

  • Sr. Data Engineer

    4 days ago

    Atlanta, United States Robert Half Full time

    Job DescriptionJob DescriptionData EngineerHybrid 3 days onsite in Atlanta GA. Does not offer C2C or sponsorship now or in the futureRobert Half is searching for a Sr. Data engineer who will have ownership of designing and developing large scale data solution. You will have deep technical skills in a variety of technology to play an important role in...

  • Sr. Data Engineer

    2 months ago

    Atlanta, United States Furniture.com America LLC Full time

    Job DescriptionJob DescriptionSr Data Engineer Furniture.com Furniture.com is a high growth consumer tech start up that is addressing fundamental challenges in the $200B US furniture space. The company is a B2B and B2C digital aggregator with a simple mission: To make finding furniture easy. For consumers, we make it easy to find the right furniture by...

  • Data Engineer

    5 days ago

    Atlanta, United States Motion Recruitment Full time

    Job Title: Sr. Data EngineerLocation: 1030 Delta Boulevard, Atlanta, GA 30354, United StatesType: Contract (Hybrid)Overview: We are seeking a Sr. Data Engineer with expertise in cloud and data technologies, strong SQL skills, and a track record of improving data pipelines.Required Skills & Experience:Bachelor of Science in Computer Science or...

  • Data Engineer

    6 days ago

    Atlanta, United States Motion Recruitment Full time

    Job Title: Sr. Data EngineerLocation: 1030 Delta Boulevard, Atlanta, GA 30354, United StatesType: Contract (Hybrid)Overview: We are seeking a Sr. Data Engineer with expertise in cloud and data technologies, strong SQL skills, and a track record of improving data pipelines.Required Skills & Experience:Bachelor of Science in Computer Science or...

  • Sr. Data Analyst/Engineer

    4 weeks ago

    Atlanta, United States Saxon Global Full time

    The team keeps making new apps, the Sr. DA are responsible for maintaining the data flow Experience being business facing, but they will work with a Product Owner Heavy on the SQL side performing higher level tasks that a standard might not always do i.e. Detect and fixing discrepancies proactively Identify dupes Maintain data in single source systems...

  • Sr. Data Analyst/Engineer

    5 months ago

    Atlanta, United States Saxon Global Full time

    The team keeps making new apps, the Sr. DA are responsible for maintaining the data flow Experience being business facing, but they will work with a Product Owner Heavy on the SQL side performing higher level tasks that a standard might not always do i.e. à Detect and fixing discrepancies proactively Identify dupes Maintain data in single source systems...

  • Contract Data Engineer Position

    2 weeks ago

    Atlanta, Georgia, United States VDart Full time

    Sr. Data Engineer Role:VdArt is looking for a Sr. Data Engineer in Atlanta, GA. In this role, you will be responsible for leading the development of large-scale data processing systems, working closely with cross-functional teams to define and deliver technical solutions. You will lead the design and implementation of data pipelines and architectures to...

  • Sr. Data Engineer

    1 month ago

    Atlanta, United States Next Level Business Services, Inc. Full time

    Quals-- The Opportunity: The Senior Data Engineer will play a leading role on the Enterprise Data Services team, responsible for transforming data from disparate systems to provide insights and analytics for business stakeholders. Youll leverage cloud-based infrastructure to implement technology solutions that are scalable, resilient, and efficient. You will...

  • Sr. Data Engineer

    1 month ago

    Atlanta, United States Nlb Services Full time

    Quals-- The Opportunity: The Senior Data Engineer will play a leading role on the Enterprise Data Services team, responsible for transforming data from disparate systems to provide insights and analytics for business stakeholders. You ll leverage cloud-based infrastructure to implement technology solutions that are scalable, resilient, and efficient. You...

  • Senior Manager Data Engineering

    6 days ago

    Atlanta, United States Robert Half Full time

    Sr. Manager, Data EngineeringLocation: Atlanta, GA (Hybrid – 3 days onsite)Are you a technical leader with a passion for building cutting-edge data platforms? We’re seeking a Sr. Manager, Data Engineering to design and implement a Data Lake and Data Processing platform from the ground up on AWS. This is a unique opportunity to innovate, guide strategy,...

  • Senior Manager Data Engineering

    5 days ago

    Atlanta, United States Robert Half Full time

    Sr. Manager, Data EngineeringLocation: Atlanta, GA (Hybrid – 3 days onsite)Are you a technical leader with a passion for building cutting-edge data platforms? We’re seeking a Sr. Manager, Data Engineering to design and implement a Data Lake and Data Processing platform from the ground up on AWS. This is a unique opportunity to innovate, guide strategy,...

  • Sr Data Engineer

    1 month ago

    Atlanta, United States TechnoGen Full time

    Job Description: Responsibilities: Experience in collaboration and coordination with the stakeholders to ensure project delivery from requirement to user acceptance testing. Establish scalable, efficient, automated processes for data analyses, model development, validation, and implementation. Work closely with data scientists and analysts to create and...

  • snowflake data engineer

    1 month ago

    Atlanta, United States TechnoGen Full time

    Expert Level - Snow Flake , Azure Data Bricks , Data Modelling , looking for a Sr. Azure Data Engineer who is self driven, can lead a team of Data engineers working on an Onshore-Offshore model collaborating with customer IT SMEs, Business partners Job responsibilities - Azure DataBricks Snowflake Python Azure Data Factory Data Modeling Data Analysis Azure...

  • Commissioning Engineer for Data Centers

    6 days ago

    Atlanta, Georgia, United States T5 Data Centers Full time

    About T5 Data Centers:As a leading provider of customized data center solutions, T5 Data Centers has been supporting enterprise and hyperscale customers since 2008. With over 400 engineers, technicians, and professional staff, we are dedicated to delivering unrivaled quality across the lifecycle of our core data centers. From turnkey development to...

  • Sr. Network Engineer

    3 weeks ago

    Atlanta, United States ACL Digital Full time

    Job Role: Sr. Network EngineerJob Type: Contract (12 Months)Job Location: Atlanta, GA (Hybrid) Job Description:7 + years of experience requiredResponsibilities:Responsible for designing, testing, implementing, and supporting network infrastructure. Provide consultation and direct technical support in life cycle planning, problem management, integration, and...

  • Sr. Data Scientist

    1 month ago

    Atlanta, United States Visa Full time

    Company Description Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and secure...

  • Sr. Data Scientist

    1 month ago

    Atlanta, United States Visa Full time

    Company Description Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and secure...

  • Sr. Data Scientist

    2 months ago

    Atlanta, United States Visa Full time

    Company Description Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and secure...