AWS Devops Infrastructure Engineer with EMR cluster
3 weeks ago
Job Summary: We are seeking an AWS EMR Engineer who is passionate about data processing and infrastructure automation. The ideal candidate will have a solid understanding of API calls, experience in writing data pipelines, and familiarity with AWS DevOps tools such as Code Deploy and Jenkins. This role will focus on automating infrastructure deployments, writing validation checks, and enhancing our data processing capabilities using AWS EMR.
Key Responsibilities:
- Design, implement, and manage AWS EMR clusters for large-scale data processing tasks.
- Develop and maintain CI/CD pipelines using tools like Jenkins and Code Deploy to automate deployment processes.
- Write and manage infrastructure as code (IaC) using Terraform, including reading and interpreting Terraform plans for effective infrastructure deployment.
- Create, execute, and optimize data pipelines to run Bash or Python scripts for automating deployments and validation checks.
- Collaborate with cross-functional teams to gather requirements and implement efficient workflows for data processing and infrastructure management.
- Ensure high availability and performance of EMR jobs and troubleshoot any issues that arise.
- Document processes, workflows, and architectural designs for future reference and knowledge sharing.
- Implement best practices for security, governance, and compliance within the AWS environment.
Qualifications:
- Bachelor’s degree in Computer Science, Information Technology, or a related field.
- Proven experience with AWS EMR, including configuration and management of EMR clusters.
- Strong understanding of API development and integration.
- Hands-on experience with AWS DevOps tools, including Code Deploy, Jenkins, or equivalent.
- Familiarity with Terraform for infrastructure provisioning and management, including the ability to read and interpret plans.
- Proficient in scripting languages such as Bash or Python for automation tasks.
- Excellent problem-solving skills, attention to detail, and a proactive approach to challenges.
Preferred Qualifications:
- AWS certifications (e.g., AWS Certified Data Analytics, AWS Certified DevOps Engineer).
- Experience with monitoring and logging tools (e.g., CloudWatch, ELK Stack).
- Familiarity with data processing frameworks (e.g., Apache Spark).
-
Piscataway, NJ, United States Synechron Full timeJob Summary: We are seeking an AWS EMR Engineer who is passionate about data processing and infrastructure automation. The ideal candidate will have a solid understanding of API calls, experience in writing data pipelines, and familiarity with AWS DevOps tools such as Code Deploy and Jenkins. This role will focus on automating infrastructure deployments,...
-
AWS DevOps Engineer
4 weeks ago
Piscataway, United States Synechron Full timeJob Details:Role: AWS DevOps Engineer [EMR Cluster]Location: Piscataway, NJ/ HybridSummary:We are seeking an AWS DevOps Engineer [EMR Cluster] who is passionate about data processing and infrastructure automation. The ideal candidate will have a solid understanding of API calls, experience in writing data pipelines, and familiarity with AWS DevOps tools such...
-
AWS DevOps Engineer
3 weeks ago
Piscataway, United States Synechron Full timeOur Challenge:We are seeking an AWS DevOps Engineer [EMR Cluster] who is passionate about data processing and infrastructure automation. The ideal candidate will have a solid understanding of API calls, experience in writing data pipelines, and familiarity with AWS DevOps tools such as Code Deploy and Jenkins. This role will focus on automating...
-
AWS DevOps Engineer
2 weeks ago
Piscataway, NJ, United States Synechron Full timeJob Details:Role: AWS DevOps Engineer [EMR Cluster]Location: Piscataway, NJ/ HybridSummary:We are seeking an AWS DevOps Engineer [EMR Cluster] who is passionate about data processing and infrastructure automation. The ideal candidate will have a solid understanding of API calls, experience in writing data pipelines, and familiarity with AWS DevOps tools such...
-
AWS Data Engineer
1 month ago
Piscataway, United States Synechron Full timeJob Summary: We are seeking a skilled AWS Data Engineer with experience in managing and optimizing EMR clusters to join our dynamic team. The ideal candidate will have a strong background in data engineering, cloud computing, and big data technologies.Key Responsibilities:Design, implement, and manage data pipelines using AWS services, particularly Amazon...
-
AWS Data Engineer
3 weeks ago
Piscataway, United States Synechron Full timeJob Summary: We are seeking a skilled AWS Data Engineer with experience in managing and optimizing EMR clusters to join our dynamic team. The ideal candidate will have a strong background in data engineering, cloud computing, and big data technologies.Key Responsibilities:Design, implement, and manage data pipelines using AWS services, particularly Amazon...
-
AWS EMR developer
2 weeks ago
Piscataway, United States Synechron Inc. Full timeWe are At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron's progressive technologies and optimization strategies span end-to-end Artificial Intelligence, Consulting, Digital, Cloud &...
-
AWS EMR developer resolve vulnerability in HI
4 weeks ago
Piscataway, United States Synechron Inc. Full timeWe are At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron's progressive technologies and optimization strategies span end-to-end Artificial Intelligence, Consulting, Digital, Cloud &...
-
AWS EMR developer resolve vulnerability in HI
3 weeks ago
Piscataway, United States Synechron Inc. Full timeWe are At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron's progressive technologies and optimization strategies span end-to-end Artificial Intelligence, Consulting, Digital, Cloud &...
-
AWS EMR Security Specialist
4 weeks ago
Piscataway, New Jersey, United States Synechron Full timeJob Title:AWS EMR Security SpecialistJob Description:We are seeking an experienced AWS EMR Security Specialist to join our team in the healthcare informatics sector. The successful candidate will be responsible for identifying and resolving security vulnerabilities within our AWS EMR environment to ensure the protection of sensitive healthcare data.Key...
-
AWS Data Engineer with Big Data Processing
4 weeks ago
Piscataway, New Jersey, United States Accord Technologies Inc. Full timeJob DescriptionData Engineering RoleA highly skilled AWS Data Engineer is required to design and implement robust data pipelines for big data processing. The ideal candidate will have expertise in AWS services such as EMR, S3, RDS, and Redshift, as well as experience with container orchestration using Kubernetes.Key ResponsibilitiesData Pipeline Development:...
-
AWS EMR Developer
2 weeks ago
Piscataway, NJ, United States Saxon Global Full timeJob Description: We are seeking an experienced AWS EMR Developer to join our team in the healthcare informatics sector. The successful candidate will be responsible for identifying and resolving security vulnerabilities within our AWS EMR environment to ensure the protection of sensitive healthcare data.Key Responsibilities:Conduct thorough security...
-
AWS EMR Developer
1 month ago
Piscataway, United States Synechron Full timeJob Details:Job Title: AWS EMR Developer - Healthcare Informatics Vulnerability ResolutionLocation: Piscataway, NJJob Description: We are seeking an experienced AWS EMR Developer to join our team in the healthcare informatics sector. The successful candidate will be responsible for identifying and resolving security vulnerabilities within our AWS EMR...
-
AWS Cloud Engineering Lead
4 weeks ago
Piscataway, New Jersey, United States Synechron Full timeJob Title: AWS Cloud Engineering LeadJob Summary:We are seeking an experienced AWS Cloud Engineering Lead to join our team at Synechron. The successful candidate will be responsible for designing, implementing, and maintaining cloud services for our developers.Key Responsibilities:Develop and maintain cloud infrastructure using Amazon Web Services (AWS)...
-
Lead AWS Cloud Engineer
1 month ago
Piscataway, United States Synechron Full timeJob Details:Role: Lead AWS Cloud EngineerLocation: Piscataway, NJ/ HybridAdditional Information – New Jersey Only*The base salary for this position will vary based on geography and other factors. In accordance with New York law, the base salary for this role if filled within New Jersey is $110-$120k/year & benefits (see below). Summary:We are looking to...
-
Senior Cloud Infrastructure Architect
3 weeks ago
Piscataway, New Jersey, United States Synechron Full timeJob Details:Role: Senior Cloud Infrastructure ArchitectLocation: Piscataway, NJ/ HybridWe are seeking a Senior Cloud Infrastructure Architect to lead the design, implementation, and maintenance of our cloud infrastructure. The ideal candidate will have a deep understanding of cloud platforms, including Amazon Web Services (AWS), and experience in leading...
-
Cloud Engineering Team Lead
1 month ago
Piscataway, New Jersey, United States Accord Technologies Inc. Full timeJob DescriptionAs a seasoned Cloud Engineer, you will lead a team of four members in managing cloud infrastructure, ensuring seamless operations and scalability.Key responsibilities include:Managing cloud infrastructure, including AWS Cloud platforms and servicesLeading a team of cloud engineers in cloud infrastructure management, CI/CD pipeline, security...
-
Software Engineer
4 weeks ago
Piscataway, New Jersey, United States Ventechsoft Inc Full timeAt Ventechsoft Inc, we are seeking a skilled Software Engineer to join our team in developing and maintaining cutting-edge software applications. The ideal candidate will have a strong background in software development and a passion for working with the latest cloud-based technologies.The successful candidate will be responsible for designing, developing,...
-
Senior Software Engineer
4 weeks ago
Piscataway, New Jersey, United States First Tek Full timeAs a Cloud Data Engineer at First Tek, Inc., you will be responsible for developing custom programs and applications using technical skills in Java, J2EE, JSP, JavaScript, Data Engineering, and Data Analytics. You will have expertise in Python, SQL, BigData, and AWS services like S3, Redshift, EMR, Kinesis, and Apache Spark. You will work in a Datawarehouse...
-
Data Engineer
4 weeks ago
Piscataway, New Jersey, United States Colgate-Palmolive Full timeJob SummaryWe are seeking a highly skilled Data Engineer to join our team at Colgate-Palmolive. As a Data Engineer, you will be responsible for developing digital infrastructure and data pipelines to accelerate product innovation, product design, and product development. You will work closely with cross-functional teams to gather, wrangle, cleanse,...