Python Spark AWS

3 weeks ago


Columbus, United States Diverse Lynx Full time
Title: Python Developer (With Spark, AWS)
Duration: Contract /Full-Time
Location: Columbus, OH (Onsite)
Interview mode: Video Conference/IN- Person
Joining: ASAP
This is the description .
Job Responsibilities:
Develop and maintain data platforms using Python, Spark, and PySpark.
Handle migration to PySpark on AWS.
Design and implement data pipelines.
Work with AWS and Big Data.
Produce unit tests for Spark transformations and helper methods.
Create Scala/Spark jobs for data transformation and aggregation.
Write Scaladoc-style documentation for code.
Optimize Spark queries for performance.
Integrate with SQL databases (e.g., Microsoft, Oracle, Postgres, MySQL).
Understand distributed systems concepts (CAP theorem, partitioning, replication, consistency, and consensus).
Skills:
Proficiency in Python, Scala (with a focus on functional programming), and Spark.
Familiarity with Spark APIs, including RDD, DataFrame, MLlib, GraphX, and Streaming.
Experience working with HDFS, S3, Cassandra, and/or DynamoDB.
Deep understanding of distributed systems.
Experience with building or maintaining cloud-native applications.
Familiarity with serverless approaches using AWS Lambda is a plus

Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
  • Python Spark AWS

    1 month ago


    Columbus, United States Diverse Lynx Full time

    Title: Python Developer (With Spark, AWS) Duration: Contract /Full-Time Location: Columbus, OH (Onsite) Interview mode: Video Conference/IN- Person Joining: ASAP This is the description . Job Responsibilities: Develop and maintain data platforms using Python, Spark, and PySpark. Handle migration to PySpark on AWS. Design and implement data...


  • Columbus, United States Quantum World Technologies Inc. Full time

    Job Title : Python Spark AWSLocation : Columbus, OH (Onsite)Duration :: Contract (W2 only)/ Full timeJob Responsibilities:Develop and maintain data platforms using Python, Spark, and PySpark. Handle migration to PySpark on AWS. Design and implement data pipelines. Work with AWS and Big Data. Produce unit tests for Spark transformations and helper methods....


  • Columbus, United States Quantum World Technologies Inc. Full time

    Job Title : Python Spark AWSLocation : Columbus, OH (Onsite)Duration :: Contract (W2 only)/ Full timeJob Responsibilities:Develop and maintain data platforms using Python, Spark, and PySpark. Handle migration to PySpark on AWS. Design and implement data pipelines. Work with AWS and Big Data. Produce unit tests for Spark transformations and helper methods....

  • Python Spark

    2 months ago


    Columbus, United States Spruce Infotech Full time

    Responsibilities: Develop and maintain data platforms using Python, Spark, and PySpark. Handle migration to PySpark on AWS. Design and implement data pipelines. Work with AWS and Big Data. Produce unit tests for Spark transformations and helper methods. Create Scala/Spark jobs for data transformation and aggregation. Write Scaladoc-style documentation for...


  • Columbus, United States Compunnel Full time

    Responsibilities: Develop and maintain data platforms using Python, Spark, and PySpark. Handle migration to PySpark on AWS. Design and implement data pipelines. Work with AWS and Big Data. Produce unit tests for Spark transformations and helper methods. Create Scala/Spark jobs for data transformation and aggregation. Write Scala doc-style documentation for...


  • Columbus, United States Apptad Inc Full time

    Job DescriptionJob DescriptionJob Title: Apptad - Python Spark DeveloperJob Location: Columbus, OH (Onsite)Job Duration: Long-TermJob Description Job Responsibilities:Develop and maintain data platforms using Python, Spark, and PySpark.Handle migration to PySpark on AWS.Design and implement data pipelines.Work with AWS and Big Data.Produce unit tests for...


  • Columbus, United States AIT Global inc. Full time

    Job DescriptionJob DescriptionJob Title: Python Spark Developer Location: Columbus, OHDuties and responsibilities:Collaborate with the team to build out features for the data platform and consolidate dataassetsBuild, maintain and optimize data pipelines built using SparkAdvise, consult, and coach other data professionals on standards and practicesWork with...


  • Columbus, United States Dice Full time

    Dice is the leading career destination for tech experts at every stage of their careers. Our client, AIT Global, Inc., is seeking the following. Apply via Dice today! Job Title: Python Engineer with AWS Location: Columbus, OH Key Responsibilities: Cloud Engineering: Design, develop, and implement cloud infrastructure and solutions for business intelligence...

  • Python Developer

    3 weeks ago


    Columbus, United States TalentOla Full time

    Job Title: Python PySpark DeveloperLocation: Columbus, OH (Only Onsite Local)Note: Data Engineer with Python, please do not apply for this role.Job Description:• Hands-on object-oriented programming experience using Python is required.• Professional work experience building real-time data streams using Spark and Experience in Spark.• Knowledge or...

  • Python Developer

    3 weeks ago


    Columbus, United States TalentOla Full time

    Job Title: Python PySpark DeveloperLocation: Columbus, OH (Only Onsite Local)Note: Data Engineer with Python, please do not apply for this role.Job Description:• Hands-on object-oriented programming experience using Python is required.• Professional work experience building real-time data streams using Spark and Experience in Spark.• Knowledge or...


  • Columbus, United States Kforce Inc Full time

    RESPONSIBILITIES:Kforce's client, one of the world's largest financial institutions, is seeking a team of Artificial Intelligence Machine Learning Python AWS Engineers in Columbus, OH & Wilmington, DE (Philly area). This is a quick opportunity for fulltime employment with client.Summary:As an expert Machine Learning Engineer, the successful candidate...


  • Columbus, Ohio, United States Kforce Inc Full time

    RESPONSIBILITIES:Kforce's client, one of the world's largest financial institutions, is seeking a team of Artificial Intelligence Machine Learning Python AWS Engineers in Columbus, OH & Wilmington, DE (Philly area). This is a quick opportunity for fulltime employment with client.Summary:As an expert Machine Learning Engineer, the successful candidate will be...

  • AWS Developer

    1 month ago


    Columbus, United States Tata Consultancy Services Full time

    AWS:1. Strong proficiency in Python.2. Experienced in Building S3 file systems via code pipelines.3. Experienced in Creating and using IAM roles.4. Experienced in building and managing Key Management Services5. Experienced in creating and using AWS transfer Family and Storage Gateway mechanism.6. Experienced in building and using CloudFormation templates.7....

  • AWS Developer

    1 month ago


    Columbus, United States Tata Consultancy Services Full time

    AWS:1. Strong proficiency in Python.2. Experienced in Building S3 file systems via code pipelines.3. Experienced in Creating and using IAM roles.4. Experienced in building and managing Key Management Services5. Experienced in creating and using AWS transfer Family and Storage Gateway mechanism.6. Experienced in building and using CloudFormation templates.7....

  • AWS Developer

    3 weeks ago


    Columbus, United States Tata Consultancy Services Full time

    AWS:1. Strong proficiency in Python.2. Experienced in Building S3 file systems via code pipelines.3. Experienced in Creating and using IAM roles.4. Experienced in building and managing Key Management Services5. Experienced in creating and using AWS transfer Family and Storage Gateway mechanism.6. Experienced in building and using CloudFormation templates.7....


  • Columbus, United States Tek Ninjas consulting services Full time

    Looking For Jr Python DeveloperPython Developer with Linux Exp.Duration It’s a long term contract roleLocation Columbus OH.Mode Of Interview Phone and skypeVisa ANYJob Description • Minimum 3 years of experience as a python Developer Linux expPrimary Skills • Python Development• Linux Experience• Java/J2EE Enterprise• Amazon Web Services (AWS)

  • Sr. AWS Architect

    1 week ago


    Columbus, Ohio, United States Derex Technologies Inc Full time

    Company DescriptionDerex Technologies Inc specializes in providing IT consulting, staffing solutions and software services. Globally headquartered in Harrison New Jersey since 1996 Derex delivers the highest quality technology professionals and an array of customized IT talent solutions designed to improve productivity and drive results to global clients...


  • Columbus, United States Tek Ninjas consulting services Full time

    Role Python Developer with Linux Exp.It’s a long term contract roleColumbus OH.Phone and skypeVisa ANYJob Description• Minimum 3 years of experience as a python Developer Linux expPrimary Skills• Python Development• Linux Experience• Java/J2EE Enterprise• Amazon Web Services (AWS)


  • Columbus, Ohio, United States Tek Ninjas consulting services Full time

    Role Python Developer with Linux Exp.It's a long term contract roleColumbus OH.Phone and skypeVisa ANYJob Description Minimum 3 years of experience as a python Developer Linux expPrimary Skills Python Development Linux Experience Java/J2EE Enterprise Amazon Web Services (AWS)

  • Sr AWS Cloud Engineer

    2 months ago


    Columbus, United States Diverse Lynx Full time

    TOP SKILLS: 1. AWS Service and Cloud Technology, virtual private clouds (VPCs), Amazon Elastic Compute Cloud (Amazon EC2), Availability Zones, and AWS Regions. and load balancers 2. Microsoft Azure Cloud skills 3. Programming languages, such as PowerShell, Python RESPONSIBILITES: Develop design & architect solution using AWS foundation services - VPC,...