Current jobs related to AWS Cloud engineer with knowledge of Spark - Plano - Compunnel Inc.

  • Data Engineer with Spark and AWS Expertise

    2 weeks ago

    Plano, Texas, United States Calabitek Full time

    Job Title: Data Engineer with Spark and AWS ExpertiseWe are seeking a highly skilled Data Engineer with expertise in Spark and AWS to join our team at Calabitek.Key Responsibilities:Design and develop scalable data pipelines using Spark and AWS.Collaborate with cross-functional teams to integrate data engineering solutions with existing...

  • Data Engineer

    7 days ago

    Plano, Texas, United States Tek Leaders Inc Full time

    We are seeking a highly skilled Data Engineer to join our team at Tek Leaders Inc. The ideal candidate will have expertise in AWS, Abinitio, and Spark, with a strong focus on developing and upgrading infrastructure scripts for blue/green deployment on AWS Dev environment.The successful candidate will be responsible for developing and upgrading Jules pipeline...

  • Data Engineer

    2 weeks ago

    Plano, Texas, United States Kutir Technologies Full time

    Job Title: Data Engineer - AWS Cloud SpecialistJob SummaryKutir Technologies is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data processing systems using AWS cloud services.Key ResponsibilitiesDesign and implement data pipelines using Spark and AWS...

  • Spark AWS Consultant

    3 weeks ago

    Plano, Texas, United States Lorven technologies Full time

    Job Title: Spark AWS ConsultantWe are seeking a highly skilled Spark AWS Consultant to join our team at Lorven technologies.Key Responsibilities:Design and implement scalable Spark infrastructure on AWS.Develop and deploy Spark jobs using Jules pipeline.Execute BLUE / GREEN deployment pipeline using Jules for Spark job.Develop and upgrade AbInitio...

  • Data Engineer

    1 week ago

    Plano, Texas, United States Kutir Technologies Full time

    Job SummaryA Data Engineer at Kutir Technologies is a software engineer with expertise in data engineering and cloud computing. The ideal candidate will design, build, and maintain large-scale data pipelines using Python, Spark, and AWS. The role involves collaborating with cross-functional teams to identify opportunities to leverage data and providing a...

  • AWS Devops with Spark

    3 weeks ago

    Plano, United States Government Systems Technologies Inc. (GSTi) Full time

    Positon - AWS Data EngineerSkills : Devops, Spark, AWS, AbinitioLocation : TX,NY,NJ,DE and OH Candidates should be able toDevelop/upgrade spark Infrastructure scripts (EAC) for blue/green deployment on AWS Dev environment.Develop/Upgrade Jules pipeline to deploy Spark job.Execute pipeline and deploy spark job to AWS Dev environment.Execute BLUE / GREEN...

  • AWS Cloud Engineer

    2 weeks ago

    Plano, Texas, United States Compunnel Inc. Full time

    Job Title: Data EngineerLocation: RemoteKey Responsibilities:Develop and maintain Spark infrastructure scripts for blue/green deployment on AWS Dev environment.Develop and upgrade Jules pipeline to deploy Spark jobs.Execute Jules pipeline and deploy Spark jobs to AWS Dev environment.Execute BLUE / GREEN deployment pipeline using Jules for Spark jobs.Develop...

  • AWS Certified Cloud Engineer

    3 days ago

    Plano, Texas, United States Diverse Lynx Full time

    Key Responsibilities:Manage cloud and on-prem environments with 10+ years of IT experience.Skilled in AWS, cluster design, Jenkins, Git, and CI/CD.Experience with job scheduling tools like Control M and Orchestrator.Proficient in data analysis using SQL.Working knowledge of Big Data components like Hive, Impala, HDFS, and YARN.Cloud infrastructure expertise,...

  • AWS Cloud Engineer

    3 days ago

    Plano, Texas, United States Diverse Lynx Full time

    Job Title: AWS Cloud EngineerWe are seeking an experienced AWS Cloud Engineer to join our team at Diverse Lynx LLC. As a key member of our infrastructure team, you will be responsible for designing, implementing, and managing cloud-based systems and applications.Key Responsibilities:* Design and implement scalable and secure cloud architectures using AWS...

  • AWS Cloud Engineer

    1 week ago

    Plano, Texas, United States Mindteck Full time

    Job Title: AWS DevOps/MLOps EngineerCLIENT is seeking a talented AWS DevOps/MLOps Lead to develop platforms for big data and data science on AWS. As models, apps, and data pipelines are created and operationalized, the big data and data science team requires engineers with understanding of cloud native technology to develop, manage, automate, and facilitate...

  • Spark AWS Consultant

    1 week ago

    Plano, Texas, United States Saransh Inc Full time

    Job Title: Spark AWS ConsultantLocation: RemoteJob Type: ContractRequired Skills:Spark, Abinitio, AWS, TerraformJob Overview:Saransh Inc is seeking a skilled Spark AWS Consultant to develop and upgrade infrastructure scripts for blue/green deployment on AWS Dev environment.Key Responsibilities:Develop and upgrade Spark infrastructure scripts (EAC) for...

  • Spark AWS Consultant

    3 weeks ago

    Plano, United States Resource Informatics Group Full time

    Role: Spark AWS ConsultantLocation: Plano, TX ,NY,NJ,DE,OH(Day 1 Onsite)Duration: Long Term contract Skills:Spark, Abinitio, AWS Essential: Develop/upgrade spark Infrastructure scripts (EAC) for blue/green deployment on AWS Dev environment. Develop/Upgrade Jules pipeline to deploy Spark job. Execute jules pipeline and deploy spark job to AWS Dev...

  • AWS Cloud Engineer with Terraform

    1 week ago

    Plano, Texas, United States Diverse Lynx Full time

    Job Summary: We are seeking an experienced AWS Cloud Engineer with Terraform expertise to join our team at Diverse Lynx LLC. As a key member of our cloud infrastructure team, you will be responsible for designing, building, and maintaining scalable and secure cloud infrastructure on AWS using Terraform. Key Responsibilities: Design and implement cloud...

  • AWS Cloud Engineer

    3 days ago

    Plano, Texas, United States Futran Tech Solutions Pvt. Ltd. Full time

    Job Title: Cloud Database Platform EngineerAbout the Role:We are seeking a highly motivated Cloud Database Platform Engineer to join our Data Platform Team at Futran Tech Solutions Pvt. Ltd. The primary responsibility of this role is to provide best-in-class enterprise Cloud Database platform engineering with cutting-edge technologies guided by principles of...

  • Senior Data Engineer

    1 week ago

    Plano, Texas, United States Calabitek Full time

    Job OverviewWe are seeking a highly skilled Senior Data Engineer to join our team at Calabitek. The ideal candidate will have a strong background in data engineering, with expertise in Python, Spark, and AWS.Key Responsibilities:Design and implement scalable data pipelines using Spark and AWS.Develop and maintain high-quality data processing infrastructure...

  • Spark AWS Consultant

    3 weeks ago

    Plano, United States Saransh Inc Full time

    Role: Spark AWS ConsultantLocation: Plano, TX (Onsite from Day 1)Job Type: ContractRequired Skills:Spark, Abinitio, AWS, TerraformJob Description:Develop/upgrade spark Infrastructure scripts (EAC) for blue/green deployment on AWS Dev environment.Develop/Upgrade Jules pipeline to deploy Spark job.Execute jules pipeline and deploy spark job to AWS Dev...

  • Spark AWS Consultant

    3 weeks ago

    Plano, United States Info Dinamica Inc Full time

    Role: Spark AWS ConsultantLocation: Plano, TX (Onsite from Day 1)Job Type: Contract Required Skills:Spark, Abinitio, AWS, Terraform Job Description:Develop/upgrade spark Infrastructure scripts (EAC) for blue/green deployment on AWS Dev environment.Develop/Upgrade Jules pipeline to deploy Spark job.Execute jules pipeline and deploy spark job to AWS Dev...

  • Spark AWS Consultant

    3 weeks ago

    Plano, United States Saransh Inc Full time

    Role: Spark AWS ConsultantLocation: Plano, TX (Onsite from Day 1)Job Type: ContractRequired Skills:Spark, Abinitio, AWS, TerraformJob Description:Develop/upgrade spark Infrastructure scripts (EAC) for blue/green deployment on AWS Dev environment.Develop/Upgrade Jules pipeline to deploy Spark job.Execute jules pipeline and deploy spark job to AWS Dev...

  • Spark AWS Consultant

    1 week ago

    plano, United States Saransh Inc Full time

    Role: Spark AWS ConsultantLocation: Plano, TX (Onsite from Day 1)Job Type: ContractRequired Skills:Spark, Abinitio, AWS, TerraformJob Description:Develop/upgrade spark Infrastructure scripts (EAC) for blue/green deployment on AWS Dev environment.Develop/Upgrade Jules pipeline to deploy Spark job.Execute jules pipeline and deploy spark job to AWS Dev...

  • Spark AWS Consultant

    3 weeks ago

    Plano, United States Lorven Technologies Inc. Full time

    Job Title: Spark AWS ConsultantLocation: Plano, TX (Day 1 Onsite)Skills:Pyspark, Abinitio, AWS, Terraform.Essential:Develop/upgrade spark Infrastructure scripts (EAC) for blue/green deployment on AWS Dev environment.Develop/Upgrade Jules pipeline to deploy Spark job.Execute jules pipeline and deploy spark job to AWS Dev environment.Execute BLUE / GREEN...

AWS Cloud engineer with knowledge of Spark

2 months ago

Plano, United States Compunnel Inc. Full time

Role: AWS Cloud Engineer with Knowledge of Spark/Python

Location: Plano, TX / Wilmington, DE

Type: Contract / Full time


Key Responsibilities:

Cloud Architecture & Infrastructure:

Design, implement, and manage scalable and reliable cloud infrastructure on AWS.

Utilize AWS services such as EC2, S3, Lambda, EMR, RDS, and Redshift to build and maintain data processing pipelines.

Implement security best practices and ensure compliance with industry standards.

Big Data Processing:

Develop and optimize big data processing workflows using Apache Spark.

Write efficient Spark jobs in Python to process large datasets.

Implement ETL (Extract, Transform, Load) processes to move and transform data across different systems.

Automation & Scripting:

Automate deployment, scaling, and management of applications on AWS using Python and AWS CloudFormation or Terraform.

Create and manage CI/CD pipelines to ensure smooth deployment of code into production.

Performance Optimization:

Monitor and optimize the performance of cloud infrastructure and data processing jobs.

Identify and address bottlenecks in the system to improve processing times and resource utilization.

Collaboration & Documentation:

Work closely with data engineers, data scientists, and other stakeholders to gather requirements and deliver cloud-based solutions.

Document architecture, processes, and configurations for future reference and maintenance.


Required Skills:

  • AWS Cloud Services: Proficiency in AWS services such as EC2, S3, Lambda, EMR, RDS, Redshift, and CloudFormation.
  • Programming: Strong programming skills in Python, with experience in writing and optimizing code for data processing.
  • Big Data Technologies: Hands-on experience with Apache Spark for big data processing.
  • Scripting & Automation: Experience in automation using Python, Shell scripting, and infrastructure as code tools like Terraform or CloudFormation.
  • Security: Knowledge of AWS security best practices, including IAM roles, security groups, and encryption.
  • Problem-Solving: Strong analytical skills to troubleshoot and resolve technical issues in a cloud environment.

Preferred Qualifications:

  • Experience: 5+ years of experience in cloud engineering, big data processing, and Python development.
  • Certifications: AWS Certified Solutions Architect, AWS Certified Big Data - Specialty, or similar certifications.
  • DevOps Tools: Familiarity with DevOps tools like Jenkins, Docker, and Kubernetes.
  • Agile Methodology: Experience working in Agile/Scrum environments.

Education:

  • Bachelor’s degree in Computer Science, Engineering, or a related field.