Data Engineer

3 weeks ago

Memphis, United States Syntricate Technologies Full time
Data Engineer - Must Have Aws experience
Fulltime/Permanent - 4 Positions
2 for Memphis, TN and 2 for St. Louis, MO - Onsite / Hybrid

The candidates are being interviewed by high-level AWS Consultants who were responsible for client's AWS migration and want to make sure that whoever takes over this role is fully qualified.

They need someone who is well versed and highly experienced using AWS Glue because it is how they are going to integrate data (and prepare and move the data) from the different sources (think of Glue as a cloud ETL tool like SSIS but for AWS, not SQL Server). However, there are limitations to Glue which is why they need to have experience with other tools like AWS Lake Formation and AWS Lambda.

This is the bullet in the job description:
  • Strong understanding of AWS services related to data engineering, such as Amazon S3, Amazon Redshift, Amazon Aurora Postgres, AWS Glue, AWS Lambda, AWS Step Function, AWS Lake Formation, Amazon Data Zone, Amazon Kinesis, MSK and Amazon EMR.

Job Summary: The data engineer's main responsibility is to design, develop, and maintain data pipelines and infrastructure on the AWS platform. Working with large volumes of data, ensuring its quality, reliability, and accessibility. Tasks may include data ingestion, transformation, and storage, data sharing and consumption as well as implementing data security and privacy measures. This role is crucial in enabling efficient and effective data-driven decision-making within the company.

Essential Duties and Responsibilities
  1. Build and maintain scalable and reliable data pipelines, ensuring the smooth flow of data from various sources to the desired destinations in AWS cloud environment.
  2. Work closely with stakeholders to understand their data requirements and designing data solutions that meet their needs. This includes understanding data models/schemas, and implementing ETL (Extract, Transform, and Load) processes to transform raw data into a usable format in destination.
  3. Responsible for monitoring and optimizing the performance of data pipelines, troubleshooting any issues that arise, and ensuring data quality and integrity.

Qualifications & Technology
  1. Proficient in programming languages such as Python, as well as SQL for database querying and manipulation.
  2. Strong understanding of AWS services related to data engineering, such as Amazon S3, Amazon Redshift, Amazon Aurora Postgres, AWS Glue, AWS Lambda, AWS Step Function, AWS Lake Formation, Amazon Data Zone, Amazon Kinesis, MSK and Amazon EMR.
  3. Knowledge of database design principles and experience with database management systems
  4. Experience with data storage technologies like relational databases (e.g., SQL Server, PostgreSQL) and distributed storage systems (e.g., PySpark) is essential.
  5. Understanding of Extract, Transform, Load (ETL) processes and experience with ETL tools like AWS Glue and SQL Server Integration Services is important. You should be skilled at integrating disparate data sources and ensuring data quality and consistency.
  6. Understanding and experience with orchestration tools like Apache Airflow, AWS Glue Workflows, AWS Step Functions and notification services.
  7. Familiarity to IAC such as Terraform, git and DevOps pipelines
  8. Awareness of data governance practices, data privacy regulations, and security protocols is crucial. Experience implementing data security measures and ensuring compliance with relevant standards is desirable.
  9. Strong analytical thinking and problem-solving abilities are essential to identify and resolve data-related issues effectively. You should be able to analyze complex data sets, identify patterns and derive actionable insights.

Education and Experience
  1. Minimum Required: Bachelor's Degree in Computer Science or related field or equivalent experience
  2. Minimum Required: 8 to 10 years' of post Bachelor's progressive experience in Data Engineering

  • Data Engineer

    2 weeks ago

    Memphis, United States Monogram Foods Full time

    Job DetailsLevel Experienced Job Location Memphis Support Center - Memphis, TN Position Type Full Time Education Level 4 Year Degree Job Shift 1st Shift Job Category Information Technology Data Engineer Are you passionate about data and innovation? Monogram Foods is looking for a Data Engineer to join our IT team, supporting our co-manufacturing, private...

  • Data Engineer

    2 weeks ago

    Memphis, United States Syntricate Technologies Full time

    Data Engineer - Must Have Aws experience Fulltime/Permanent - 4 Positions 2 for Memphis, TN and 2 for St. Louis, MO - Onsite / Hybrid The candidates are being interviewed by high-level AWS Consultants who were responsible for client's AWS migration and want to make sure that whoever takes over this role is fully qualified. They need someone who is well...

  • Data Engineer

    1 week ago

    Memphis, Tennessee, United States Syntricate Technologies Inc Full time

    Please take a moment to review the job description below. If you are interested in applying, kindly respond to the email and we can discuss it further. This is a Full-Time/Permanent positio n . The interview process will be initiated as soon as possible. We look forward to hearing back from you. Job Description:Role: Data Engineer Must Have Aws...

  • Data Engineer

    4 weeks ago

    Memphis, United States Syntricate Technologies Inc Full time

    Please take a moment to review the job description below. If you are interested in applying, kindly respond to the email and we can discuss it further. This is a Full-Time/Permanent positio n . The interview process will be initiated as soon as possible. We look forward to hearing back from you. Job Description: Role: Data Engineer Must...

  • Data Engineer

    1 week ago

    Memphis, United States Monogram Foods Full time

    Are you passionate about data and innovation? Monogram Foods is looking for a Data Engineer to join our IT team, supporting our co-manufacturing, private label, and foodservice channels across the United States. In this role, you will build data processing pipelines and analytics solutions using Azure cloud tools, transform data, detect and extract changes,...

  • Data Engineer

    5 days ago

    Memphis, United States International Paper Full time

    Position Title:  Data Engineer   Pay Rate :   Category/Shift : Salaried Full-Time   Physical Location : 6400 Poplar Avenue Memphis, TN   The Data Engineer for Global Finance Information Management (GFIM) follows standard practices...

  • Senior Data Engineer

    3 weeks ago

    Memphis, United States THORNDALE PARTNERS Full time

    DETAILS: SENIOR DATA ENGINEER Title: Lead Full Stack Software Engineer, Java Compensation: $130k - $140k base, strong bonus plan, excellent benefits Start Date: ASAP Location: La Vergne, TN (Hybrid Role) OVERVIEW: SENIOR DATA ENGINEER We are searching for a Senior Data Engineer to join a great team with an exciting client. Projects and initiatives are...

  • Senior Data Engineer

    2 weeks ago

    Memphis, United States THORNDALE PARTNERS Full time

    DETAILS: SENIOR DATA ENGINEER Title: Lead Full Stack Software Engineer, Java Compensation: $130k - $140k base, strong bonus plan, excellent benefits Start Date: ASAP Location: La Vergne, TN (Hybrid Role) OVERVIEW: SENIOR DATA ENGINEER We are searching for a Senior Data Engineer to join a great team with an exciting client. Projects and initiatives are...

  • AWS Data Engineer

    4 weeks ago

    Memphis, United States Saxon Global Full time

    Title: AWS Data EngineerLocation: Hybrid in Memphis (3 days a week)Duration: 12 Months ContractPosition Description: The data engineer’s main responsibility is to design, develop, and maintain data pipelines and infrastructure on the AWS platform. Working with large volumes of data, ensuring its quality, reliability, and accessibility. Tasks may include...

  • AWS Data Engineer

    3 weeks ago

    Memphis, United States Saxon Global Full time

    Title: AWS Data EngineerLocation: Hybrid in Memphis (3 days a week)Duration: 12 Months ContractPosition Description: The data engineer’s main responsibility is to design, develop, and maintain data pipelines and infrastructure on the AWS platform. Working with large volumes of data, ensuring its quality, reliability, and accessibility. Tasks may include...

  • AWS Data Engineer

    1 week ago

    Memphis, United States Vaco Full time

    Vaco is actively seeking an AWS Data Engineer for a direct-hire position with our client in Memphis. This is a permanent opportunity to join a highly respected organization that is a proven leader in their field!Data Engineer SummaryAs an AWS Data Engineer, you will be responsible for designing, implementing, and maintaining scalable data pipelines and...

  • AWS Data Engineer

    2 days ago

    Memphis, United States Virtual Full time

    Vaco is actively seeking an AWS Data Engineer for a direct-hire position with our client in Memphis.  This is a permanent opportunity to join a highly respected organization that is a proven leader in their field! Data Engineer Summary As an AWS Data Engineer, you will be responsible for designing, implementing, and maintaining scalable data pipelines...

  • AWS Data Engineer

    1 week ago

    Memphis, United States Vaco Full time

    Vaco is actively seeking an AWS Data Engineer for a direct-hire position with our client in Memphis. This is a permanent opportunity to join a highly respected organization that is a proven leader in their field!Data Engineer SummaryAs an AWS Data Engineer, you will be responsible for designing, implementing, and maintaining scalable data pipelines and...

  • AWS Data Engineer

    2 weeks ago

    Memphis, United States Vaco Full time

    Vaco is actively seeking an AWS Data Engineer for a direct-hire position with our client in Memphis. This is a permanent opportunity to join a highly respected organization that is a proven leader in their field! Data Engineer Summary As an AWS Data Engineer, you will be responsible for designing, implementing, and maintaining scalable data pipelines...

  • AWS Data Engineer

    3 weeks ago

    Memphis, United States Vaco Full time

    Vaco is actively seeking an AWS Data Engineer for a direct-hire position with our client in Memphis. This is a permanent opportunity to join a highly respected organization that is a proven leader in their field! Data Engineer Summary As an AWS Data Engineer, you will be responsible for designing, implementing, and maintaining scalable data pipelines...

  • AWS Data Engineer

    1 month ago

    Memphis, United States Vaco Full time

    Vaco is actively seeking an AWS Data Engineer for a direct-hire position with our client in Memphis. This is a permanent opportunity to join a highly respected international organization that is a proven leader in their field! Product Owner Summary As an AWS Data Engineer, you will be responsible for designing, implementing, and maintaining scalable...

  • AWS Data Engineer

    3 weeks ago

    Memphis, United States Vaco Full time

    Vaco is actively seeking an AWS Data Engineer for a direct-hire position with our client in Memphis. This is a permanent opportunity to join a highly respected international organization that is a proven leader in their field! Product Owner Summary As an AWS Data Engineer, you will be responsible for designing, implementing, and maintaining scalable...

  • Lead Data Engineer

    2 weeks ago

    Memphis, United States Raymond James Financial Services Full time

    Description Note: This position will follow our hybrid work model, we expect the selected candidate to be in the office 8 days per month in one of the following corporate locations: St. Petersburg, FL; Memphis, TN; or Southfield, MI. Job Summary: As part of the Cash Management development team, the Lead Data Engineer will take a lead role in building...

  • Data Analyst/ Visualization Engineer

    2 days ago

    Memphis, United States Oscar Full time

    I am working with a highly successful Industrial Retailor who is searching for a Data Analyst/ Visualization Engineer to join them on a permanent basis. This is an excellent opportunity to work with industry experts and continue to grow your technical expertise with SQL, DAX and custom visualizations using PowerBI. A successful candidate will...

  • Data Analyst/ Visualization Engineer

    1 week ago

    Memphis, United States Oscar Full time

    I am working with a highly successful Industrial Retailor who is searching for a Data Analyst/ Visualization Engineer to join them on a permanent basis. This is an excellent opportunity to work with industry experts and continue to grow your technical expertise with SQL, DAX and custom visualizations using PowerBI. A successful candidate will...