PySpark Engineer with AWS

1 week ago


Plano, United States Ccube Full time
Job DescriptionJob DescriptionJob Title: Python PySpark Engineer with AWS
Location : Plano, TX/ Wilmington, DE  (Hybrid 3 Days a Week)
W2/Full Time Highly Preferred

Experience – 6+ years Minimum

Duties and responsibilities:
● Collaborate with the team to build out features for the data platform and consolidate data 
assets
● Build, maintain and optimize data pipelines built using Spark
● Advise, consult, and coach other data professionals on standards and practices
● Work with the team to define company data assets
● Migrate CMS’ data platform into Chase’s environment
● Partner with business analysts and solutions architects to develop technical 
architectures for strategic enterprise projects and initiatives
● Build libraries to standardize how we process data
● Loves to teach and learn, and knows that continuous learning is the cornerstone of every 
successful engineer
● Has a solid understanding of AWS tools such as EMR or Glue, their pros and cons and 
is able to intelligently convey such knowledge
● Implement automation on applicable processes

Mandatory Skills:
● 5+ years of experience in a data engineering position
● Proficiency is Python (or similar) and SQL
● Strong experience building data pipelines with Spark
● Strong verbal & written communication
● Strong analytical and problem solving skills
● Experience with relational datastores, NoSQL datastores and cloud object stores
● Experience building data processing infrastructure in AWS
● Bonus: Experience with infrastructure as code solutions, preferably Terraform
● Bonus: Cloud certification
● Bonus: Production experience with ACID compliant formats such as Hudi, Iceberg or 
Delta Lake

Bachelor’s Degree in Computer Science/Programming or similar is preferred
 Benefits-

Actual compensation is influenced by years of experience, specialized skill sets, and unique qualifications
Ccube provides various benefits such as subsidized medical, dental, vision InsuranceInterested Candidates feel free to DM OR can reach out to "rahul@ccube.com" for more details.

 

 

Powered by JazzHR

HbnSnPdlUM


  • AWS PySpark Developer

    4 weeks ago


    Plano, United States Cognizant Full time

    We are Cognizant Artificial Intelligence Digital technologies, including analytics and AI, give companies a once-in-a-generation opportunity to perform orders of magnitude better than ever before. However, clients need new business models built from analyzing customers and business operations at every angle to really understand them. With the power to apply...


  • Plano, United States Cognizant Full time

    About Cognizant’s AI Practice Digital technologies, including analytics and AI, give companies a once-in-a-generation opportunity to perform orders of magnitude better than ever before. However, clients need new business models built from analyzing customers and business operations at every angle to really understand them. With the power to apply...


  • Plano, United States Compunnel Inc. Full time

    Role: Python PySpark DeveloperLocation: Plano, TX / Wilmingtom, DEType: [Full-time/Contract]Experience Level: 10+ Years Overview:We are seeking a skilled Python PySpark Developer to join our data engineering team. The ideal candidate will be responsible for building and maintaining scalable data processing pipelines using PySpark and Python. This role...


  • Plano, United States Compunnel Inc. Full time

    Role: Python PySpark DeveloperLocation: Plano, TX / Wilmingtom, DEType: [Full-time/Contract]Experience Level: 10+ Years Overview:We are seeking a skilled Python PySpark Developer to join our data engineering team. The ideal candidate will be responsible for building and maintaining scalable data processing pipelines using PySpark and Python. This role...


  • Plano, United States JPMorgan Chase & Co Full time

    Job DescriptionJOB DESCRIPTIONWe have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible.As a Lead Software Engineer at JPMorgan Chase within the Corporate Technology space, you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading technology...


  • Plano, United States JPMorgan Chase & Co Full time

    Job DescriptionJOB DESCRIPTIONWe have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible.As a Lead Software Engineer at JPMorgan Chase within the Corporate Technology space, you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading technology...


  • plano, United States JPMorgan Chase & Co Full time

    Job DescriptionJOB DESCRIPTIONWe have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible.As a Lead Software Engineer at JPMorgan Chase within the Corporate Technology space, you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading technology...


  • Plano, TX, United States JPMorgan Chase & Co Full time

    Job DescriptionJOB DESCRIPTIONWe have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible.As a Lead Software Engineer at JPMorgan Chase within the Corporate Technology space, you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading technology...


  • Plano, United States Artmac Soft LLC Full time

    Job DescriptionJob DescriptionWho we are:Artmac Soft is a technology consulting and service-oriented IT company dedicated to providing innovative technology solutions and services to customers.Job Description:Job Title : Snowflake and PySpark Data Engineer with SQL ExpertiseJob Type : C2CExperience : 8 to 15 yearsLocation : Plano, TexasResponsibilities:4-6...

  • AWS Engineer

    4 days ago


    Plano, United States Zenith services Full time

    Job responsibilities Your experience in public cloud migrations of complex systems anticipating problems and finding ways to mitigate risk will be key in leading numerous public cloud initiatives Executes creative software solutions design development and technical troubleshooting with ability to think beyond routine or conventional approaches to build...

  • Full Stack Engineer

    4 weeks ago


    Plano, United States V-Soft Consulting Group, Inc. Full time

    Position: Full Stack DeveloperLocation: Onsite - Plano, TexasDuration: 6+ Months Contract Description:Our client is looking for a highly experienced Full stack Engineer with expertise in cloud engineering, data engineering, and data warehousing, particularly within the AWS and google cloud ecosystem. Success in designing and implementing scalable cloud...

  • Full Stack Engineer

    4 weeks ago


    Plano, United States V-Soft Consulting Group, Inc. Full time

    Position: Full Stack DeveloperLocation: Onsite - Plano, TexasDuration: 6+ Months Contract Description:Our client is looking for a highly experienced Full stack Engineer with expertise in cloud engineering, data engineering, and data warehousing, particularly within the AWS and google cloud ecosystem. Success in designing and implementing scalable cloud...


  • Plano, United States TechStar Group Full time

    Position: Senior Full Stack EngineerLocation: Plano, TXDuration: 6+ MonthsWe are looking for a Full stack developer who is has strong Java & python (Some Golang exposure) experience plus working exposure with data and analytics platforms. We are Data platform and analytics team.Looking for some one who is familiar with technologies like Glue, Pyspark, and...

  • AWS DevSecOps Engineer

    3 months ago


    Plano, United States Catapult Staffing Full time

    AWS DevSecOps Engineer Hybrid – Plano, TX Contract – W2 12 months + extensions or conversion 40 hours. Weekly We are a North American subsidiary overseeing operations in the United States, Canada, and Mexico. We manage automotive design, engineering, manufacturing, as well as sales and marketing activities across the region. We are committed to...


  • Plano, United States Saxon Global Full time

    Hello Kenneth I Hope you are doing well. I have an immediate Job opportunity with one of my clients. Following are the position details. Job Title :- AWS cloud engineer Job Type :- Contract Location :- Remote till Covid Job Summary :- The Cloud Security Engineer/Architect is an expert in the AWS cloud environment, and cloud computing and...


  • Plano, United States beBee S US Full time

    AWS DevSecOps Engineer Hybrid – Plano, TX Contract – W2 12 months + extensions or conversion 40 hours. Weekly We are a North American subsidiary overseeing operations in the United States, Canada, and Mexico. We manage automotive design, engineering, manufacturing, as well as sales and marketing activities across the region. We are committed...

  • AWS Devops Engineer

    3 weeks ago


    Plano, United States Diverse Lynx Full time

    Position: WS Devops Engineer Location: Plano/Dallas, TX Duration: Contract Required Skill: • AWS certified DevOps engineer with 10+ years of IT Experience in managing Cloud & on prem environments, skilled in AWS, cluster design, Jenkins, Git & CI/CD. • Working experience on Job Scheduling tools such as Control M, Orchestrator[Job Monitoring] etc •...

  • AWS Data Engineer

    2 months ago


    Plano, United States Yoh, A Day & Zimmermann Company Full time

    AWS Data EngineerDirect HirePlano, TXJob Responsibilities:Looking for an AWS Data Engineer that has AI understanding and wants to build on this knowledge!Design, build & maintain scalable data pipelines in AWS to ensure their compliance with up-time, security, and privacy.Actively contribute to both data & application governance initiatives by designing and...

  • AWS Data Engineer

    2 months ago


    Plano, United States Yoh, A Day & Zimmermann Company Full time

    AWS Data EngineerDirect HirePlano, TXJob Responsibilities:Looking for an AWS Data Engineer that has AI understanding and wants to build on this knowledge!Design, build & maintain scalable data pipelines in AWS to ensure their compliance with up-time, security, and privacy.Actively contribute to both data & application governance initiatives by designing and...


  • Plano, Texas, United States Catapult Staffing Full time

    Job DescriptionJob Summary: We are seeking a highly skilled AWS Cloud Security Engineer to join our team at Catapult Staffing. As a DevSecOps Specialist, you will be responsible for designing and implementing secure cloud-based systems, ensuring the confidentiality, integrity, and availability of our data.Key Responsibilities:Design and implement secure...