PySpark Developer

4 weeks ago

Atlanta, United States Spiceorb Full time
Hello, SpiceOrb is hiring for AWS PySpark Developer, please let me know if you are comfortable with the below requirement. Title: AWS PySpark DeveloperLocation -Atlanta, GA/Mason, OH/Richmond, VA/Norfolk, VA/Walling ford, CT(Hybrid)
Mandatory Areas Must Have Skills
Skill 1 8 Yrs of Exp Strong Hands-on in AWS cloud in S3/ATHENA/GLUE/EMR/VPC.
Skill 2 8 Yrs of Exp PySpark Developer
Skill 3 8 Yrs of Exp Scala, Spark or Python.
Skill 4 8 Yrs of Exp -AWS cloud and AWS DocuDB
Skill 5 8 Yrs of Exp big data processing tools
Skill 6 5 Yrs of Exp Kafka topics and K-SQL
Skill 7 5 Yrs of Exp No SQL databases like MongoDB.
Skill 8 5 Yrs of Exp -Agile Methodology/JIRA/Confluence. Overall 6+ years of IT Development experience 5+ years of experience as a PySpark Developer or a related role (Mandatory) Good experience in AWS (Mandatory), AWS Glue, Hudi & Kafka Experience in working with AWS cloud, PostgreSQL and AWS DocuDB Familiarity with big data processing tools and techniques Experience with streaming data platforms Excellent exposure with both relational and non-relation Databases Experience in Nifi will be a plus Excellent analytical and problem-solving skills
Client is looking for a Strong developer who has :
  • Strong Hands-on in AWS cloud in S3/ATHENA/GLUE/EMR/VPC.
  • Creating and Managing Data Pipelines and Streamsets in KAFKA.
  • 5+ yrs of Proven experience as a PySpark Developer or a related role.
  • Strong programming skills in Scala, Spark or Python.
  • Experience in working with AWS cloud and AWS DocuDB.
  • Familiarity with big data processing tools and techniques.
  • Experience with streaming data platforms.
  • Excellent analytical and problem-solving skills.
  • Strong knowledge in Kafka topics and K-SQL.
  • Extensive Unix/FTP/ File Handling.
  • Strong Hands-on in No SQL databases like Mongo DB.
  • Experience with Agile Methodology/JIRA/Confluence.
  • Hands-on in Handling all Processors.
Responsibilities:
  • Extensive knowledge in understanding Data and creating Data Pipelines.
  • Interact with Business to understand the requirement on a daily evolving need and adapt to the needs.
  • Handle streaming data platforms.
  • Able to handle all the database storage and retrieval mechanisms for the MongoDB and extensive experience in handling.
  • Able to understand the business requirements, tech stack involved and guide the team towards Integral solution approach.
  • Provide extensive development support to the Team in achieving the Project Milestones.
  • Dedicated and committed approach with excellent communication skills.
PySpark Developer (AWS Glue, AWS Athena, AWS S3, AWS EMR, AWS VPC)

  • Hadoop and PySpark Developer

    3 weeks ago

    Atlanta, United States Infosys Limited Digital Full time

    Job details Country USA State / Region / Province Georgia, North Carolina, Texas Work Location Atlanta, GA, Charlotte, NC, Plano, TX Domain Delivery Interest Group Infosys Limited Skills Technology|Analytics - Packages|Python - Big Data, Technology|Big Data - Data Processing|Spark, Technology|Big Data - Hadoop|Hadoop Company ITL USA Requisition ID 118688BR...

  • Hadoop and PySpark Developer

    2 days ago

    Atlanta, United States Infosys Limited Digital Full time

    Job details Skills Big Data - Data Processing|Spark, Technology|Big Data - Hadoop|Hadoop|Technology|Analytics - Packages|Python - Big Data, Technology Company ITL USA Requisition ID 119626BR Country USA State / Region / Province Georgia, North Carolina, Texas Work Location Atlanta, GA, Charlotte, NC, Plano, TX Domain Delivery Interest Group Infosys Limited...

  • Hadoop and PySpark Developer

    1 week ago

    Atlanta, United States Infosys Limited Digital Full time

    Job details Country USA State / Region / Province Georgia, North Carolina, Texas Work Location Atlanta, GA, Charlotte, NC, Plano, TX Domain Delivery Interest Group Infosys Limited Skills Technology|Analytics - Packages|Python - Big Data, Technology|Big Data - Data Processing|Spark, Technology|Big Data - Hadoop|Hadoop Company ITL USA Requisition ID 118688BR...

  • Pyspark Developer

    4 weeks ago

    Atlanta, United States Spiceorb Full time

    Title : Pyspark DeveloperLocation : Onsite (Chicago, IL) Duration : Long TermRelevant Experience : 12+YearsMust Have Skills Skill 1 8 Yrs of Exp Strong Hands-on in AWS cloud in S3/ATHENA/GLUE/EMR/VPC.Skill 2 8 Yrs of Exp PySpark DeveloperSkill 3 8 Yrs of Exp Scala, Spark or Python.Skill 4 8 Yrs of Exp -AWS cloud and AWS DocuDBSkill 5 8 Yrs of Exp big data...

  • Senior Azure Databricks developer

    5 days ago

    Atlanta, United States Tech Providers Full time

    Must have hands-on on Azure Databricks, pyspark, blob storage, azure monitor, application insights, azure key vault technologies. Must have development experience on pyspark, apache spark technologies Must have experience on DevOps, docker containers deployment activities. Must have good knowledge on bash script, powershell scripting. Must have hands on on...

  • python and sql developers

    2 months ago

    Atlanta, Georgia, United States Atechstar Full time

    Job DescriptionResponsibilitiesWriting effective and scalable Python codes. Designing and implementing robust applications. Debugging applications to ensure low-latency and high-availability. Writing optimized custom SQL queries Integrate user-facing elements into applications Test and debug programs Improve functionality of existing systems Implement...

  • Python Developer

    2 weeks ago

    Atlanta, United States Purple Drive Technologies Full time

    **Python Developer** **Location: Atlanta,GA // Dallas,TX// Piscataway NJ// or Irvine,CA** **Required Skills**: - 6+ years of full Stack Python development experience with strong knowledge of containerization with Docker and Kubernetes. - Strong OOP's concepts. - Experience building microservices in Python. Django, flask or fast API is a must. - Working...

  • aws developer

    3 weeks ago

    Atlanta, Georgia, United States Atechstar Full time

    Job DescriptionResponsibilitiesWork on S3 storages Data Pipeline EC2 Lambda EMR Athena and AWS Glue Work on RDS DynamoDB Redshift/Spectrum Work on AWS Kinesis DMS Work on Python scripting Spark SQL & PySpark Work on CDC/SCDQualifications/Minimum qualificationsBE/Btech/MCA Good expertise in Data warehousing/Dimensional Modelling Good knowledge on Pyspark and...

  • aws developer

    1 week ago

    Atlanta, Georgia, United States Atechstar Full time

    Job DescriptionResponsibilitiesWork on S3 storages Data Pipeline EC2 Lambda EMR Athena and AWS Glue Work on RDS DynamoDB Redshift/Spectrum Work on AWS Kinesis DMS Work on Python scripting Spark SQL & PySpark Work on CDC/SCDQualifications/Minimum qualificationsBE/Btech/MCA Good expertise in Data warehousing/Dimensional Modelling Good knowledge on Pyspark and...

  • Full Stack Python developer

    1 week ago

    Atlanta, United States Lorven technologies Full time

    Job DescriptionJob DescriptionPosition: Full Stack Python developerLocation: Atlanta, GA or Dallas, TX or New Jersey or Irvine, CADuration: ContractJob Description:Experience - 11+Yrs of Overall IT Experience6+ years of full Stack Python development experience with strong knowledge of containerization with Docker and Kubernetes.Experience building micro...

  • Data Engineer at Atlanta, Georgia

    3 weeks ago

    Atlanta, United States DBSI Services Full time

    Job DescriptionJob DescriptionJob Title: Data EngineerLocation: Atlanta, GeorgiaJob Description: Bs/ Ms in CS / Software / electrical engineering / OTHER with 3+ years experience in data engineering / software development / business intelligence and with manipulating, processing and extracting value from datasetsExperience working with large data sets with...

  • Data Engineer Intern

    3 weeks ago

    Atlanta, Georgia, United States Novelis Full time

    Position OverviewThe Novelis Data Engineering team is seeking a Data Engineering Intern. The ideal candidate will be responsible for helping to convert existing ETL pipelines from Informatica to Python/PySpark pipelines.Responsibilities & QualificationsResponsibilities:Build a solution to migrate from the legacy Informatica DEI based ETL to the cloud based...

  • Data Engineer Intern

    2 weeks ago

    Atlanta, United States Novelis Full time

    Position Overview The Novelis Data Engineering team is seeking a Data Engineering Intern. The ideal candidate will be responsible for helping to convert existing ETL pipelines from Informatica to Python/PySpark pipelines. Responsibilities & Qualifications Responsibilities: Build a solution to migrate from the legacy Informatica DEI based ETL to the cloud...

  • Data Engineer Intern

    2 weeks ago

    Atlanta, United States Novelis Full time

    Position Overview The Novelis Data Engineering team is seeking a Data Engineering Intern. The ideal candidate will be responsible for helping to convert existing ETL pipelines from Informatica to Python/PySpark pipelines. Responsibilities & Qualifications Responsibilities: Build a solution to migrate from the legacy Informatica DEI based ETL to the cloud...

  • Data Engineer Intern

    1 week ago

    Atlanta, Georgia, United States Novelis Full time

    Position OverviewThe Novelis Data Engineering team is seeking a Data Engineering Intern. The ideal candidate will be responsible for helping to convert existing ETL pipelines from Informatica to Python/PySpark pipelines.Responsibilities & QualificationsResponsibilities:Build a solution to migrate from the legacy Informatica DEI based ETL to the cloud based...

  • Lead Software Development Engineer

    2 weeks ago

    Atlanta, United States UPS Full time

    Job Description : The Lead Software Development Engineer applies the principles of software engineering to design, develop, maintain, test, and evaluate computer software that provides business capabilities, solutions, and/or product suites. Provides systems life cycle management (e.g., analyses, technical requirements, design, coding, testing,...

  • Lead Software Development Engineer

    3 weeks ago

    Atlanta, United States UPS Full time

    Job Description : The Lead Software Development Engineer applies the principles of software engineering to design, develop, maintain, test, and evaluate computer software that provides business capabilities, solutions, and/or product suites. Provides systems life cycle management (e.g., analyses, technical requirements, design, coding, testing,...

  • Azure Database Developer

    3 weeks ago

    Atlanta, United States CapLeo Global Full time

    Title-Azure Database Developer Location- Atlanta, Georgia Duration-12 Months Short Description: Developer will be responsible for developing new and modernizing existing applications to Azure Cloud Platform. The ideal candidate must demonstrate in-depth knowledge and understanding of Database concepts. Job Summary: The ideal candidate must demonstrate...

  • Azure Database Developer

    2 weeks ago

    Atlanta, United States Capleo Global Full time

    Title-Azure Database Developer Location- Atlanta, Georgia Duration-12 Months Short Description: Developer will be responsible for developing new and modernizing existing applications to Azure Cloud Platform. The ideal candidate must demonstrate in-depth knowledge and understanding of Database concepts. Job Summary: The ideal candidate must demonstrate...

  • Azure Database Developer

    5 days ago

    Atlanta, United States CapLeo Global Full time

    Title-Azure Database Developer Location- Atlanta, Georgia Duration-12 Months Short Description: Developer will be responsible for developing new and modernizing existing applications to Azure Cloud Platform. The ideal candidate must demonstrate in-depth knowledge and understanding of Database concepts. Job Summary: The ideal candidate must demonstrate...