AWS Devops Infrastructure Engineer with EMR cluster

3 days ago


Piscataway, United States Synechron Full time

Job Summary: We are seeking an AWS EMR Engineer who is passionate about data processing and infrastructure automation. The ideal candidate will have a solid understanding of API calls, experience in writing data pipelines, and familiarity with AWS DevOps tools such as Code Deploy and Jenkins. This role will focus on automating infrastructure deployments, writing validation checks, and enhancing our data processing capabilities using AWS EMR.

Key Responsibilities:

  • Design, implement, and manage AWS EMR clusters for large-scale data processing tasks.
  • Develop and maintain CI/CD pipelines using tools like Jenkins and Code Deploy to automate deployment processes.
  • Write and manage infrastructure as code (IaC) using Terraform, including reading and interpreting Terraform plans for effective infrastructure deployment.
  • Create, execute, and optimize data pipelines to run Bash or Python scripts for automating deployments and validation checks.
  • Collaborate with cross-functional teams to gather requirements and implement efficient workflows for data processing and infrastructure management.
  • Ensure high availability and performance of EMR jobs and troubleshoot any issues that arise.
  • Document processes, workflows, and architectural designs for future reference and knowledge sharing.
  • Implement best practices for security, governance, and compliance within the AWS environment.

Qualifications:

  • Bachelor’s degree in Computer Science, Information Technology, or a related field.
  • Proven experience with AWS EMR, including configuration and management of EMR clusters.
  • Strong understanding of API development and integration.
  • Hands-on experience with AWS DevOps tools, including Code Deploy, Jenkins, or equivalent.
  • Familiarity with Terraform for infrastructure provisioning and management, including the ability to read and interpret plans.
  • Proficient in scripting languages such as Bash or Python for automation tasks.
  • Excellent problem-solving skills, attention to detail, and a proactive approach to challenges.

Preferred Qualifications:

  • AWS certifications (e.g., AWS Certified Data Analytics, AWS Certified DevOps Engineer).
  • Experience with monitoring and logging tools (e.g., CloudWatch, ELK Stack).
  • Familiarity with data processing frameworks (e.g., Apache Spark).


  • AWS DevOps Engineer

    1 week ago


    Piscataway, United States Synechron Full time

    Job Details:Role: AWS DevOps Engineer [EMR Cluster]Location: Piscataway, NJ/ HybridSummary:We are seeking an AWS DevOps Engineer [EMR Cluster] who is passionate about data processing and infrastructure automation. The ideal candidate will have a solid understanding of API calls, experience in writing data pipelines, and familiarity with AWS DevOps tools such...


  • Piscataway, United States Synechron Full time

    Our Challenge:We are seeking an AWS DevOps Engineer [EMR Cluster] who is passionate about data processing and infrastructure automation. The ideal candidate will have a solid understanding of API calls, experience in writing data pipelines, and familiarity with AWS DevOps tools such as Code Deploy and Jenkins. This role will focus on automating...

  • AWS Data Engineer

    2 weeks ago


    Piscataway, United States Synechron Full time

    Job Summary: We are seeking a skilled AWS Data Engineer with experience in managing and optimizing EMR clusters to join our dynamic team. The ideal candidate will have a strong background in data engineering, cloud computing, and big data technologies.Key Responsibilities:Design, implement, and manage data pipelines using AWS services, particularly Amazon...

  • AWS Data Engineer

    13 hours ago


    Piscataway, United States Synechron Full time

    Job Summary: We are seeking a skilled AWS Data Engineer with experience in managing and optimizing EMR clusters to join our dynamic team. The ideal candidate will have a strong background in data engineering, cloud computing, and big data technologies.Key Responsibilities:Design, implement, and manage data pipelines using AWS services, particularly Amazon...


  • Piscataway, United States Synechron Inc. Full time

    We are At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron's progressive technologies and optimization strategies span end-to-end Artificial Intelligence, Consulting, Digital, Cloud &...


  • Piscataway, United States Synechron Inc. Full time

    We are At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron's progressive technologies and optimization strategies span end-to-end Artificial Intelligence, Consulting, Digital, Cloud &...


  • Piscataway, New Jersey, United States Saxon Global Full time

    Role:AWS DevOps EngineerLocation: Remote Opportunity3 Days Hybrid from Day 1Position Overview : Saxon Global is seeking an experienced AWS DevOps Engineer to support our cloud-based systems. The ideal candidate will be responsible for automating and optimizing our cloud infrastructure on AWS, ensuring the scalability and security of our applications.Key...


  • Piscataway, New Jersey, United States Synechron Full time

    Job Title:AWS EMR Security SpecialistJob Description:We are seeking an experienced AWS EMR Security Specialist to join our team in the healthcare informatics sector. The successful candidate will be responsible for identifying and resolving security vulnerabilities within our AWS EMR environment to ensure the protection of sensitive healthcare data.Key...


  • Piscataway, New Jersey, United States Accord Technologies Inc. Full time

    Job OverviewAccord Technologies Inc. is seeking a skilled Data Engineer to design and implement robust data pipelines using AWS services. The ideal candidate will have experience with EMR clusters, Apache Spark, and Kubernetes for container orchestration.Data Pipeline Development: Develop and maintain ETL processes to extract, transform, and load data from...


  • Piscataway, New Jersey, United States Accord Technologies Inc. Full time

    Job DescriptionData Engineering RoleA highly skilled AWS Data Engineer is required to design and implement robust data pipelines for big data processing. The ideal candidate will have expertise in AWS services such as EMR, S3, RDS, and Redshift, as well as experience with container orchestration using Kubernetes.Key ResponsibilitiesData Pipeline Development:...

  • AWS EMR Developer

    3 weeks ago


    Piscataway, United States Synechron Full time

    Job Details:Job Title: AWS EMR Developer - Healthcare Informatics Vulnerability ResolutionLocation: Piscataway, NJJob Description: We are seeking an experienced AWS EMR Developer to join our team in the healthcare informatics sector. The successful candidate will be responsible for identifying and resolving security vulnerabilities within our AWS EMR...

  • AWS EMR Developer

    3 weeks ago


    Piscataway, United States Synechron Full time

    Job Title: AWS EMR Developer - Healthcare Informatics Vulnerability ResolutionLocation: Piscataway, NJJob Description: We are seeking an experienced AWS EMR Developer to join our team in the healthcare informatics sector. The successful candidate will be responsible for identifying and resolving security vulnerabilities within our AWS EMR environment to...


  • Piscataway, New Jersey, United States Synechron Full time

    Job Title: AWS Cloud Engineering LeadJob Summary:We are seeking an experienced AWS Cloud Engineering Lead to join our team at Synechron. The successful candidate will be responsible for designing, implementing, and maintaining cloud services for our developers.Key Responsibilities:Develop and maintain cloud infrastructure using Amazon Web Services (AWS)...


  • Piscataway, United States Synechron Full time

    Job Details:Role: Lead AWS Cloud EngineerLocation: Piscataway, NJ/ HybridAdditional Information – New Jersey Only*The base salary for this position will vary based on geography and other factors. In accordance with New York law, the base salary for this role if filled within New Jersey is $110-$120k/year & benefits (see below). Summary:We are looking to...


  • Piscataway, New Jersey, United States Synechron Full time

    Job Details:Role: Senior Cloud Infrastructure ArchitectLocation: Piscataway, NJ/ HybridWe are seeking a Senior Cloud Infrastructure Architect to lead the design, implementation, and maintenance of our cloud infrastructure. The ideal candidate will have a deep understanding of cloud platforms, including Amazon Web Services (AWS), and experience in leading...


  • Piscataway, United States Synechron Full time

    Job Details:Role: .NET Developer with AWS Cloud experience]Location: Piscataway, NJ/ HybridResponsibilities:Responsible for the development and release of business applications, application integrations, microservices, and support of critical business application systems.They will development, implementation, integration, and maintenance of business...


  • Piscataway, United States Synechron Full time

    Job Details:Role: .NET Developer with AWS Cloud experience]Location: Piscataway, NJ/ HybridResponsibilities:Responsible for the development and release of business applications, application integrations, microservices, and support of critical business application systems.They will development, implementation, integration, and maintenance of business...

  • Software Engineer

    2 weeks ago


    Piscataway, New Jersey, United States First Tek Full time

    We are seeking a highly skilled Software Engineer to join our team at First Tek, Inc. The ideal candidate will have a master's degree in Computer Science or a related field and at least 6 months of experience in developing custom programs and applications using technical skills in Java, J2EE, JSP, JavaScript, Data Engineering, and Data Analytics. Expertise...


  • Piscataway, New Jersey, United States Accord Technologies Inc. Full time

    Job DescriptionAs a seasoned Cloud Engineer, you will lead a team of four members in managing cloud infrastructure, ensuring seamless operations and scalability.Key responsibilities include:Managing cloud infrastructure, including AWS Cloud platforms and servicesLeading a team of cloud engineers in cloud infrastructure management, CI/CD pipeline, security...

  • Data Engineer

    2 weeks ago


    Piscataway, New Jersey, United States Colgate-Palmolive Full time

    Job DescriptionWe are seeking a highly skilled Data Engineer to join our team at Colgate-Palmolive. As an Analytics Engineer, you will be responsible for developing and maintaining digital infrastructure and data pipelines to accelerate product innovation, product design, and product development.You will work closely with cross-functional teams to gather,...