AWS Data Engineer

11 hours ago

Plano, United States Donato Technologies Inc Full time

Job Title: AWS Data Engineer

Location: Plano, TX - Onsite

Duration: 12+ Months W2

Billing Rate - $53/hr on W2

Job Description

Duties and responsibilities

  • Collaborate with the team to build out features for the data platform and consolidate data assets.
  • Build, maintain and optimize data pipelines built using Spark Advise, consult, and coach other data professionals on standards and practices.
  • Work with the team to define company data assets Migrate CMS data platform into Chase s environment
  • Partner with business analysts and solutions architects to develop technical
    architectures for strategic enterprise projects and initiatives.
  • Build libraries to standardize how we process data Loves to teach and learn, and knows that continuous learning is the cornerstone of every successful engineer.
  • Has a solid understanding of AWS tools such as EMR or Glue, their pros and cons and is able to intelligently convey such knowledge
  • Implement automation on applicable processes.


Mandatory Skills

  • 5+ years of experience in a data engineering position
    Proficiency is Python (or similar) and SQL Strong experience building data pipelines with Spark.
  • Strong verbal & written communication.
  • Strong analytical and problem solving skills
  • Experience with relational datastores, NoSQL datastores and cloud object stores
  • Experience building data processing infrastructure in AWS
  • Bonus: Experience with infrastructure as code solutions, preferably Terraform
  • Bonus: Cloud certification.
  • Bonus: Production experience with ACID compliant formats such as Hudi, Iceberg or Delta Lake.
  • Bonus: Familiar with data observability solutions, data governance frameworks

Requirements

  • Bachelor s Degree in Computer Science/Programming or similar is preferred
    Right to work.
  • Must have legal right to work in the USA.


Job responsibilities

  • Your experience in public cloud migrations of complex systems, anticipating problems, and finding ways to mitigate risk, will be key in leading numerous public cloud initiatives
  • Executes creative software solutions, design, development, and technical troubleshooting with ability to think beyond routine or conventional approaches to build solutions or break down technical problems
  • Own end-to-end platform issues & help provide solutions to platform build and performance issues on the AWS Cloud & ensure the deliverables are bug free
  • Drive, support, and deliver on a strategy to build broad use of Amazon's utility computing web services (e.g., AWS EC2, AWS S3, AWS RDS, AWS CloudFront, AWS EFS, AWS DynamoDB, CloudWatch, EKS, ECS, MFTS, ALB, NLB)
  • Design resilient, secure, and high performing platforms in Public Cloud using JPMC best practices
  • Measure and optimize system performance, with an eye toward pushing our capabilities forward, getting ahead of customer needs, and innovating to continually improve
  • Provide primary operational support and engineering for the public cloud platform and debug and optimize systems and automate routine tasks
  • Collaborate with a cross-functional team to develop real-world solutions and positive user experiences at every interaction
  • Drive Game days, Resiliency tests and Chaos engineering exercises
  • Utilize programming languages like Java, Python, SQL, Node, Go, and Scala, Open Source RDBMS and NoSQL databases, Container Orchestration services including Docker and Kubernetes, and a variety of AWS tools and services
  • Required qualifications, capabilities, and skills
  • Formal training or certification on software engineering concepts and 10+ years applied experience
  • Hands-on practical experience delivering system design, application development, testing, and operational stability
  • Advanced in one or more programming language(s) - Java, Python, Go
  • A strong understanding of business technology drivers and their impact on architecture design, performance and monitoring, best practices
  • Design and building web environments on AWS, which includes working with services like EC2, ALB, NLB, Aurora Postgres, DynamoDB, EKS, ECS fargate, MFTS, SQS/SNS, S3 and Route53
  • Advanced in modern technologies such as: Java version 8+, Spring Boot, Restful Microservices, AWS or Cloud Foundry, Kubernetes.
  • Experience using DevOps tools in a cloud environment, such as Ansible, Artifactory, Docker, GitHub, Jenkins, Kubernetes, Maven, and Sonar Qube
  • Experience and knowledge of writing Infrastructure-as-Code (IaC) and Environment-as-Code (EaC), using tools like CloudFormation or Terraform
  • Experience with high volume, SLA critical applications, and building upon messaging and or event-driven architectures
AWS Data Engineer - W2 Contract

  • AWS Data Engineer

    4 weeks ago

    Plano, United States Mindlance Full time

    Title: AWS Data EngineerDuration: 12 MonthsLocation: Plano, TX (Hybrid)Video InterviewJob Description:Develop scripts and tools for automation of system provisioning, deployment, upgrade, and scaling (Python).Create ETLs to take data from various operational systems.Development solutions on Cloud based architecture.Evangelizing key strategic technologies in...

  • AWS Data Engineer

    4 weeks ago

    Plano, United States Mindlance Full time

    Title: AWS Data EngineerDuration: 12 MonthsLocation: Plano, TX (Hybrid)Video InterviewJob Description:Develop scripts and tools for automation of system provisioning, deployment, upgrade, and scaling (Python).Create ETLs to take data from various operational systems.Development solutions on Cloud based architecture.Evangelizing key strategic technologies in...

  • AWS Data Engineer

    3 days ago

    Plano, United States Compunnel Inc. Full time

    Title: Data EngineerLocation: Plano, TX (Day 1 Onsite)Skills:Spark, Abinitio, AWS, Terraform.Essential:Develop/upgrade spark Infrastructure scripts (EAC) for blue/green deployment on AWS Dev environment.Develop/Upgrade Jules pipeline to deploy Spark job.Execute Jules pipeline and deploy spark job to AWS Dev environment.Execute BLUE / GREEN deployment...

  • Senior Data Engineer

    1 day ago

    Plano, United States NTT DATA Full time

    Req ID:294856NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Data Engineer to join our team in Plano, Texas (US-TX), United States (US).Job Duties: Key...

  • Senior Data Engineer

    4 weeks ago

    Plano, United States NTT DATA Services Full time

    Req ID: 294856  NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Senior Data Engineer to join our team in Plano, Texas (US-TX), United States (US). Job Duties: Key...

  • AWS DevOps Engineer

    6 days ago

    Plano, Texas, United States BCforward Full time

    AWS DevOps/ML Ops Engineer Job DescriptionBCforward is seeking a highly motivated AWS DevOps/ML Ops Engineer to join our team in Plano, TX.Job SummaryWe are looking for a skilled AWS DevOps/ML Ops Engineer to design and implement scalable and secure cloud infrastructure, develop and deploy machine learning models, and ensure the smooth operation of our...

  • AWS DevOps Engineer

    3 weeks ago

    Plano, Texas, United States Pyramid Consulting, Inc Full time

    Job Title: AWS DevOps/MLOps EngineerWe are seeking a highly skilled AWS DevOps/MLOps Engineer to join our team at Pyramid Consulting, Inc. This is a contract opportunity with long-term potential and is located in Plano, TX.Job Summary:The successful candidate will be responsible for designing and implementing scalable cloud infrastructure using AWS services,...

  • AWS DevOps Engineer

    2 weeks ago

    Plano, Texas, United States eTeam Full time

    Job Title: AWS DevOps/MLOps ArchitectWe are seeking a highly skilled AWS DevOps/MLOps Architect to design and develop scalable platforms for big data and data science on AWS. As a key member of our team, you will be responsible for developing, managing, automating, and facilitating the operational capabilities of our big data and data science team.Key...

  • AWS Cloud Engineer

    2 weeks ago

    Plano, Texas, United States Diverse Lynx Full time

    Job Title: AWS Devops EngineerAt Diverse Lynx LLC, we are seeking a highly skilled AWS DevOps Engineer to join our team. As a key member of our IT department, you will be responsible for designing, implementing, and maintaining cloud infrastructure on AWS.Key Responsibilities:Design and implement scalable and secure cloud infrastructure on AWSDevelop and...

  • Big Data/Java/AWS Consultant

    11 hours ago

    Plano, United States Kezan India Private Limited Full time

    Big Data/Java/AWS Consultant Plano, TX (Hybrid role, look for nearby candidates)W2 Candidates HM Notes :Big data engineer with AWS experience / Java Python - combination of both More emphasis on Java side. Spark - EMR and Glue to some extent. Nice to have - Snowflake experience. Blend of the above skills 2 featured teams with 8 people each. with all levels...

  • AWS DevOps/MLOps Engineer

    4 weeks ago

    Plano, United States Pyramid Consulting, Inc Full time

    Immediate need for a talented AWS DevOps/Mlos Engineer. This is a 07+months contract opportunity with long-term potential and is located in Plano, TX (Onsite). Please review the job description below and contact me ASAP if you are interested.Job ID:24-37726 Pay Range: $55 - $60/hour. Employee benefits include, but are not limited to, health insurance...

  • AWS DevOps/MLOps Engineer

    4 weeks ago

    Plano, United States Pyramid Consulting, Inc Full time

    Immediate need for a talented AWS DevOps/Mlos Engineer. This is a 07+months contract opportunity with long-term potential and is located in Plano, TX (Onsite). Please review the job description below and contact me ASAP if you are interested.Job ID:24-37726 Pay Range: $55 - $60/hour. Employee benefits include, but are not limited to, health insurance...

  • AWS Network Engineer

    3 weeks ago

    Plano, United States Thrive IT Systems Ltd Full time

    We have one open position of AWS Networking Engineer with one of our client based at Plano, TX. This is a contract position with minimum duration of 6 Months. Below is the job description for your reference. Please share your application once you are interestedRole: AWS Networking EngineerLocation: Plano, TXMode: Contract 6 Months initially(To Hire)HybridW2...

  • AWS Network Engineer

    2 weeks ago

    Plano, United States Thrive IT Systems Ltd Full time

    We have one open position of AWS Networking Engineer with one of our client based at Plano, TX. This is a contract position with minimum duration of 6 Months. Below is the job description for your reference. Please share your application once you are interestedRole: AWS Networking EngineerLocation: Plano, TXMode: Contract 6 Months initially(To Hire)HybridW2...

  • AWS Network Engineer

    2 weeks ago

    plano, United States Thrive IT Systems Ltd Full time

    We have one open position of AWS Networking Engineer with one of our client based at Plano, TX. This is a contract position with minimum duration of 6 Months. Below is the job description for your reference. Please share your application once you are interestedRole: AWS Networking EngineerLocation: Plano, TXMode: Contract 6 Months initially(To Hire)HybridW2...

  • Data Engineer

    4 weeks ago

    Plano, Texas, United States AIT Global inc. Full time

    Job OverviewAIT Global inc. is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, developing, and maintaining scalable data pipelines using Apache Spark and Java.Key ResponsibilitiesData Pipeline Development: Design and develop efficient data pipelines using Apache Spark and Java to process...

  • Data Engineer

    4 weeks ago

    Plano, United States ConnectedX Inc. Full time

    Client is hiring Highly experienced Full stack Engineer with expertise in cloud engineering, data engineering, and data warehousing, particularly within the AWS and google cloud ecosystem. Success in designing and implementing scalable cloud solutions, data pipelines, optimizing data architectures, and delivering high-quality analytics solutions. Proficient...

  • Data Engineer

    4 weeks ago

    Plano, United States ConnectedX Inc. Full time

    Client is hiring Highly experienced Full stack Engineer with expertise in cloud engineering, data engineering, and data warehousing, particularly within the AWS and google cloud ecosystem. Success in designing and implementing scalable cloud solutions, data pipelines, optimizing data architectures, and delivering high-quality analytics solutions. Proficient...

  • AWS DevOps/MLOps Engineer

    4 weeks ago

    Plano, Texas, United States Pyramid Consulting, Inc Full time

    Job DescriptionWe are seeking a highly skilled AWS DevOps/MLOps Engineer to join our team at Pyramid Consulting, Inc. as a contract position. This is a 07+ months contract opportunity with long-term potential.Key ResponsibilitiesDesign and implement scalable data pipelines and engineering infrastructure to support enterprise machine learning systems.Develop...

  • Python AWS Engineer

    1 day ago

    Plano, United States TEK NINJAS Full time

    Role: Python AWS Engineer Location: Hybrid to Plano, TX, Mclean, VA Contract: W2 Job Description#1 Requirement: CSPM At least 2 years of experience working with a Cloud Security Posture Management tool (Cloud Custodian, Wiz, Aqua Security, Prisma Cloud, etc)#2 and #3 Requirement: Python and AWSProject Scope:Onboard and manage new cloud services, primarily...