AWS Devops Infrastructure Engineer with EMR cluster

2 weeks ago

Piscataway NJ United States Synechron Full time

Job Summary: We are seeking an AWS EMR Engineer who is passionate about data processing and infrastructure automation. The ideal candidate will have a solid understanding of API calls, experience in writing data pipelines, and familiarity with AWS DevOps tools such as Code Deploy and Jenkins. This role will focus on automating infrastructure deployments, writing validation checks, and enhancing our data processing capabilities using AWS EMR.

Key Responsibilities:

  • Design, implement, and manage AWS EMR clusters for large-scale data processing tasks.
  • Develop and maintain CI/CD pipelines using tools like Jenkins and Code Deploy to automate deployment processes.
  • Write and manage infrastructure as code (IaC) using Terraform, including reading and interpreting Terraform plans for effective infrastructure deployment.
  • Create, execute, and optimize data pipelines to run Bash or Python scripts for automating deployments and validation checks.
  • Collaborate with cross-functional teams to gather requirements and implement efficient workflows for data processing and infrastructure management.
  • Ensure high availability and performance of EMR jobs and troubleshoot any issues that arise.
  • Document processes, workflows, and architectural designs for future reference and knowledge sharing.
  • Implement best practices for security, governance, and compliance within the AWS environment.

Qualifications:

  • Bachelor’s degree in Computer Science, Information Technology, or a related field.
  • Proven experience with AWS EMR, including configuration and management of EMR clusters.
  • Strong understanding of API development and integration.
  • Hands-on experience with AWS DevOps tools, including Code Deploy, Jenkins, or equivalent.
  • Familiarity with Terraform for infrastructure provisioning and management, including the ability to read and interpret plans.
  • Proficient in scripting languages such as Bash or Python for automation tasks.
  • Excellent problem-solving skills, attention to detail, and a proactive approach to challenges.

Preferred Qualifications:

  • AWS certifications (e.g., AWS Certified Data Analytics, AWS Certified DevOps Engineer).
  • Experience with monitoring and logging tools (e.g., CloudWatch, ELK Stack).
  • Familiarity with data processing frameworks (e.g., Apache Spark).

  • AWS Devops Infrastructure Engineer with EMR cluster

    3 weeks ago

    Piscataway, United States Synechron Full time

    Job Summary: We are seeking an AWS EMR Engineer who is passionate about data processing and infrastructure automation. The ideal candidate will have a solid understanding of API calls, experience in writing data pipelines, and familiarity with AWS DevOps tools such as Code Deploy and Jenkins. This role will focus on automating infrastructure deployments,...

  • AWS Devops Infrastructure Engineer with EMR cluster

    3 weeks ago

    Piscataway, United States Synechron Full time

    Job Summary: We are seeking an AWS DevOps Cloud Engineer who is passionate about data processing and infrastructure automation. The ideal candidate will have a solid understanding of API calls, experience in writing data pipelines, and familiarity with AWS DevOps tools such as Code Deploy and Jenkins. This role will focus on automating infrastructure...

  • AWS DevOps Engineer

    2 weeks ago

    Piscataway, NJ, United States Synechron Full time

    Job Details:Role: AWS DevOps Engineer [EMR Cluster]Location: Piscataway, NJ/ HybridSummary:We are seeking an AWS DevOps Engineer [EMR Cluster] who is passionate about data processing and infrastructure automation. The ideal candidate will have a solid understanding of API calls, experience in writing data pipelines, and familiarity with AWS DevOps tools such...

  • AWS Devops Infrastructure Engineer with EMR cluster

    3 weeks ago

    Piscataway, United States Synechron Full time

    Job Summary: We are seeking an AWS DevOps Cloud Engineer who is passionate about data processing and infrastructure automation. The ideal candidate will have a solid understanding of API calls, experience in writing data pipelines, and familiarity with AWS DevOps tools such as Code Deploy and Jenkins. This role will focus on automating infrastructure...

  • AWS DevOps Engineer

    4 weeks ago

    Piscataway, United States Synechron Full time

    Job Details:Role: AWS DevOps Engineer [EMR Cluster]Location: Piscataway, NJ/ HybridSummary:We are seeking an AWS DevOps Engineer [EMR Cluster] who is passionate about data processing and infrastructure automation. The ideal candidate will have a solid understanding of API calls, experience in writing data pipelines, and familiarity with AWS DevOps tools such...

  • AWS DevOps Engineer

    3 weeks ago

    Piscataway, United States Synechron Full time

    Our Challenge:We are seeking an AWS DevOps Engineer [EMR Cluster] who is passionate about data processing and infrastructure automation. The ideal candidate will have a solid understanding of API calls, experience in writing data pipelines, and familiarity with AWS DevOps tools such as Code Deploy and Jenkins. This role will focus on automating...

  • AWS Data Engineer

    1 month ago

    Piscataway, United States Synechron Full time

    Job Summary: We are seeking a skilled AWS Data Engineer with experience in managing and optimizing EMR clusters to join our dynamic team. The ideal candidate will have a strong background in data engineering, cloud computing, and big data technologies.Key Responsibilities:Design, implement, and manage data pipelines using AWS services, particularly Amazon...

  • AWS Data Engineer

    3 weeks ago

    Piscataway, United States Synechron Full time

    Job Summary: We are seeking a skilled AWS Data Engineer with experience in managing and optimizing EMR clusters to join our dynamic team. The ideal candidate will have a strong background in data engineering, cloud computing, and big data technologies.Key Responsibilities:Design, implement, and manage data pipelines using AWS services, particularly Amazon...

  • AWS EMR developer

    2 weeks ago

    Piscataway, United States Synechron Inc. Full time

    We are At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron's progressive technologies and optimization strategies span end-to-end Artificial Intelligence, Consulting, Digital, Cloud &...

  • AWS EMR developer resolve vulnerability in HI

    4 weeks ago

    Piscataway, United States Synechron Inc. Full time

    We are At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron's progressive technologies and optimization strategies span end-to-end Artificial Intelligence, Consulting, Digital, Cloud &...

  • AWS EMR developer resolve vulnerability in HI

    3 weeks ago

    Piscataway, United States Synechron Inc. Full time

    We are At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron's progressive technologies and optimization strategies span end-to-end Artificial Intelligence, Consulting, Digital, Cloud &...

  • AWS EMR Developer

    2 weeks ago

    Piscataway, NJ, United States Saxon Global Full time

    Job Description: We are seeking an experienced AWS EMR Developer to join our team in the healthcare informatics sector. The successful candidate will be responsible for identifying and resolving security vulnerabilities within our AWS EMR environment to ensure the protection of sensitive healthcare data.Key Responsibilities:Conduct thorough security...

  • DevOps Engineer

    2 weeks ago

    Atlanta, GA, United States ICP Search Full time

    DevOps EngineerAtlanta - Hybrid - 2/3 Days Office BasedMy client a global communications organisation require an experienced DevOps Engineer to join a new team within the business, you will play a pivotal role in enhancing the reliability, scalability, and efficiency of their platform along with curating the pipeline to maximize developer productivity and...

  • DevOps Engineer

    2 weeks ago

    Irving, TX, United States CornerStone Technology Talent Services Full time

    Senior CloudOps EngineerLocation: Irving, TXAbout Us:CornerStone TTS is seeking a Senior DevOps Engineer to be a critical member of our client’s DevOps team. This role offers the opportunity to work at the intersection of cloud technology and healthcare, enabling scalable and secure infrastructure that supports better patient outcomes. If you're a...

  • AWS EMR Security Specialist

    4 weeks ago

    Piscataway, New Jersey, United States Synechron Full time

    Job Title:AWS EMR Security SpecialistJob Description:We are seeking an experienced AWS EMR Security Specialist to join our team in the healthcare informatics sector. The successful candidate will be responsible for identifying and resolving security vulnerabilities within our AWS EMR environment to ensure the protection of sensitive healthcare data.Key...

  • AWS Data Engineer with Big Data Processing

    4 weeks ago

    Piscataway, New Jersey, United States Accord Technologies Inc. Full time

    Job DescriptionData Engineering RoleA highly skilled AWS Data Engineer is required to design and implement robust data pipelines for big data processing. The ideal candidate will have expertise in AWS services such as EMR, S3, RDS, and Redshift, as well as experience with container orchestration using Kubernetes.Key ResponsibilitiesData Pipeline Development:...

  • DevOps Engineer

    2 weeks ago

    Charlotte, NC, United States Optomi Full time

    DevOps Engineer / Data Modernization / Full-Time SalaryOptomi is searching for a skilled Cloud DevOps Engineer to support a critical project aimed at enhancing cloud automation, patch management, and data modernization. This role will focus on building efficient infrastructure, optimizing cloud resources, and automating workflows to streamline operations and...

  • Lead Cloud Infrastructure Engineer

    2 weeks ago

    Chicago, IL, United States Synergy Interactive Full time

    We are currently partnered with an innovative tech start-up that is looking for a Lead Cloud Infrastructure Engineer who specializes in AWS Cloud DevOps and building out organization infrastructure.This is a full-time and fully on-site position in Downtown Chicago. Candidates must be on-site 5 days per week and comfortable with a fast-paced environment.Job...

  • Lead DevOps/ Infrastructure Engineer

    2 weeks ago

    Chicago, IL, United States Synergy Interactive Full time

    We’re seeking a Lead DevOps Engineer to join our operations team. You’ll play a key role in designing, building, and maintaining the infrastructure needed to ensure our web services are scalable, reliable, and secure.Responsibilities:Design, manage, and maintain cloud infrastructure across development and production environments.Collaborate with software...

  • Devops Engineer

    2 weeks ago

    Plano, TX, United States BCforward Full time

    Devops EngineerBCforward is currently seeking a highly motivated Devops Engineer for an opportunity in Plano, TX!Position Title: Devops EngineerLocation: Plano, TXAnticipated Start Date: 11/11/2024Please note this is the target date and is subject to change. BCforward will send official notice ahead of a confirmed start date.Expected Duration6+ months...