Python Spark AWS

3 weeks ago


Columbus, United States Diverse Lynx Full time
Title: Python Developer (With Spark, AWS)
Duration: Contract /Full-Time
Location: Columbus, OH (Onsite)
Interview mode: Video Conference/IN- Person
Joining: ASAP
This is the description .
Job Responsibilities:
Develop and maintain data platforms using Python, Spark, and PySpark.
Handle migration to PySpark on AWS.
Design and implement data pipelines.
Work with AWS and Big Data.
Produce unit tests for Spark transformations and helper methods.
Create Scala/Spark jobs for data transformation and aggregation.
Write Scaladoc-style documentation for code.
Optimize Spark queries for performance.
Integrate with SQL databases (e.g., Microsoft, Oracle, Postgres, MySQL).
Understand distributed systems concepts (CAP theorem, partitioning, replication, consistency, and consensus).
Skills:
Proficiency in Python, Scala (with a focus on functional programming), and Spark.
Familiarity with Spark APIs, including RDD, DataFrame, MLlib, GraphX, and Streaming.
Experience working with HDFS, S3, Cassandra, and/or DynamoDB.
Deep understanding of distributed systems.
Experience with building or maintaining cloud-native applications.
Familiarity with serverless approaches using AWS Lambda is a plus

Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
  • Python Spark AWS

    2 days ago


    Columbus, United States Diverse Lynx Full time

    Title: Python Developer (With Spark, AWS) Duration: Contract /Full-Time Location: Columbus, OH (Onsite) Interview mode: Video Conference/IN- Person Joining: ASAP This is the description . Job Responsibilities: Develop and maintain data platforms using Python, Spark, and PySpark. Handle migration to PySpark on AWS. Design and implement data...

  • Python Spark

    4 weeks ago


    Columbus, United States Spruce Infotech Full time

    Responsibilities: Develop and maintain data platforms using Python, Spark, and PySpark. Handle migration to PySpark on AWS. Design and implement data pipelines. Work with AWS and Big Data. Produce unit tests for Spark transformations and helper methods. Create Scala/Spark jobs for data transformation and aggregation. Write Scaladoc-style documentation for...


  • Columbus, United States Compunnel Full time

    Responsibilities: Develop and maintain data platforms using Python, Spark, and PySpark. Handle migration to PySpark on AWS. Design and implement data pipelines. Work with AWS and Big Data. Produce unit tests for Spark transformations and helper methods. Create Scala/Spark jobs for data transformation and aggregation. Write Scala doc-style documentation for...


  • Columbus, United States Apptad Inc Full time

    Job DescriptionJob DescriptionJob Title: Apptad - Python Spark DeveloperJob Location: Columbus, OH (Onsite)Job Duration: Long-TermJob Description Job Responsibilities:Develop and maintain data platforms using Python, Spark, and PySpark.Handle migration to PySpark on AWS.Design and implement data pipelines.Work with AWS and Big Data.Produce unit tests for...


  • Columbus, United States Apptad Inc Full time

    Job DescriptionJob DescriptionJob Title: Apptad - Python Spark DeveloperJob Location: Columbus, OH (Onsite)Job Duration: Long-TermJob Description Job Responsibilities:Develop and maintain data platforms using Python, Spark, and PySpark.Handle migration to PySpark on AWS.Design and implement data pipelines.Work with AWS and Big Data.Produce unit tests for...

  • Spark/Python Lead

    2 weeks ago


    Columbus, United States Virtusa Full time

    Spark/Python Lead - CREQ191398 Description Experience in building SparkStreaming process. Proficient in understanding distributed computing principles. Experience in managing Hadoop cluster with all services. Experience with Nosql Databases and Messaging systems like Kafka. Designing building installing configuring and supporting Hadoop Perform analysis of...

  • Spark/Python Lead

    3 weeks ago


    Columbus, Ohio, United States Virtusa Full time

    Spark/Python Lead CREQ191398 Description Experience in building SparkStreaming process. Proficient in understanding distributed computing principles. Experience in managing Hadoop cluster with all services. Experience with Nosql Databases and Messaging systems like Kafka. Designing building installing configuring and supporting Hadoop Perform analysis of...

  • Data Engineer

    4 weeks ago


    Columbus, United States SoftPathTechnologies Full time

    Job DescriptionJob DescriptionData Engineer (Java/Spark/AWS/ETL)Position ResponsibilitiesData Engineer (Java/Spark/AWS/ETL)Work Location: Columbus, OH ( need local to OH) Hybrid (3 days onsite 2 days Remote)Experience: looking for a junior profile Minimum 2+ years Required Must Have Skills : (Java/Spark/AWS/ETL)MUST have - Teradata, DBMS knowledge - Cloud...


  • Columbus, United States Mphasis Full time

    Job Description:Job Title: Python Developer with SparkLocation: Columbus OH - HybridNeed 9+ Years of exp.• Hands-on object-oriented programming experience using Python is required.• Professional work experience building real-time data streams using Spark and Experience in Spark.• Knowledge or experience in architectural best practices in building data...


  • Columbus, United States Mphasis Full time

    Job Description:Job Title: Python Developer with SparkLocation: Columbus OH - HybridNeed 9+ Years of exp.• Hands-on object-oriented programming experience using Python is required.• Professional work experience building real-time data streams using Spark and Experience in Spark.• Knowledge or experience in architectural best practices in building data...


  • Columbus, United States Radish Consultants Full time

    Job DescriptionJob DescriptionTitle: Python Engineer with AWS Location: Columbus, OH / Plano, TX / Wilmington, DE / Jersey City, NJ Experience: 10+ years Duration: 12+ months Domain Experience Required: Banking Job Description:- Developing and maintaining Python-based applications deployed on AWS infrastructure, with a focus on banking domain expertise....


  • Columbus, Ohio, United States Dice Full time

    Dice is the leading career destination for tech experts at every stage of their careers. Our client, AIT Global, Inc., is seeking the following. Apply via Dice today Job Title: Python Engineer with AWS Location: Columbus, OH Key Responsibilities:Cloud Engineering: Design, develop, and implement cloud infrastructure and solutions for business intelligence and...


  • Columbus, United States Virtusa Full time

    Roles and Responsibilities - Lead Developer 12+ years of technical and/or management consulting experience architecting enterprise and application solutions w.r.t designing, developing, and implementing business applications on AWS based solutions Solid knowledge of Java/Open Source and Cloud Native Application development, including hands-on software...


  • Columbus, United States Dice Full time

    Dice is the leading career destination for tech experts at every stage of their careers. Our client, AIT Global, Inc., is seeking the following. Apply via Dice today! Job Title: Python Engineer with AWS Location: Columbus, OH Key Responsibilities: Cloud Engineering: Design, develop, and implement cloud infrastructure and solutions for business intelligence...


  • Columbus, United States JobRialto Full time

    Description Key Responsibilities: Cloud Engineering: Design, develop, and implement cloud infrastructure and solutions for business intelligence and data transformation tools. Data source connectivity from Business Intelligence and Data Transformation tools: Develop secure and efficient connectivity's to cloud data sources, including AWS services and SaaS...


  • Columbus, United States Diverse Lynx Full time

    Key Responsibilities: Cloud Engineering: Design, develop, and implement cloud infrastructure and solutions for business intelligence and data transformation tools. Data source connectivity from Business Intelligence and Data Transformation tools: Develop secure and efficient connectivity's to cloud data sources, including AWS services and SaaS solutions....

  • Python Developer

    3 days ago


    Columbus, United States TalentOla Full time

    Job Title: Python PySpark DeveloperLocation: Columbus, OH (Only Onsite Local)Note: Data Engineer with Python, please do not apply for this role.Job Description:• Hands-on object-oriented programming experience using Python is required.• Professional work experience building real-time data streams using Spark and Experience in Spark.• Knowledge or...

  • Python Developer

    3 days ago


    Columbus, United States TalentOla Full time

    Job Title: Python PySpark DeveloperLocation: Columbus, OH (Only Onsite Local)Note: Data Engineer with Python, please do not apply for this role.Job Description:• Hands-on object-oriented programming experience using Python is required.• Professional work experience building real-time data streams using Spark and Experience in Spark.• Knowledge or...

  • Python/Spark Lead

    3 weeks ago


    Columbus, United States Virtusa Full time

    Experience in building SparkStreaming process. Proficient in understanding distributed computing principles. Experience in managing Hadoop cluster with all services. Experience with Nosql Databases and Messaging systems like Kafka. Designing building installing configuring and supporting Hadoop Perform analysis of vast data stores. Good understanding of...

  • Python Developer

    1 month ago


    Columbus, United States TalentOla Full time

    Role: Python Engineer with AWS Location: Columbus, OH (Local-Onsite) Note: Local candidate within 50 miles Key Responsibilities: Cloud Engineering: Design, develop, and implement cloud infrastructure and solutions for business intelligence and data transformation tools. Data source connectivity from Business Intelligence and Data Transformation tools:...