Python Spark Developer/PySpark Developer

1 month ago


Columbus, United States Ccube Full time
Job DescriptionJob Description

Hello Connections,

Hope you all are doing well

We are Hiring a "Python Spark Developer"

Python Spark Developer/PySpark Developer

Columbus, OH (Onsite Day 1/Hybrid 3 Days a Week)

W2/Full Time (Preferred)/ C2C is also Open If Candidate is Local & Ready for F2F Interview

*** (Local Candidates Only/In-Person Interview Mandatory)***

Job Description:-

Develop and maintain data platforms using Python, Spark, and PySpark.

Handle migration to PySpark on AWS.

Design and implement data pipelines.

Work with AWS and Big Data.

Produce unit tests for Spark transformations and helper methods.

Create Scala/Spark jobs for data transformation and aggregation.

Write Scaladoc-style documentation for code.

Optimize Spark queries for performance.

Integrate with SQL databases (e.g., Microsoft, Oracle, Postgres, MySQL).

Understand distributed systems concepts (CAP theorem, partitioning, replication, consistency, and consensus).

Skills:

Proficiency in Python, Scala (with a focus on functional programming), and Spark.

Familiarity with Spark APIs, including RDD, DataFrame, MLlib, GraphX, and Streaming.

Experience working with HDFS, S3, Cassandra, and/or DynamoDB.

Deep understanding of distributed systems.

Experience with building or maintaining cloud-native applications.

Familiarity with serverless approaches using AWS Lambda is a plus

Qualification:-

Bachelor’s Degree in Computer Science/Programming or similar is preferred

Powered by JazzHR

qtHKG7awxQ



  • Columbus, United States TalentOla Full time

    Job Title : Python Pyspark DeveloperLocation : Columbus OHJob Description:Responsibilities:Develop and maintain data platforms using Python, Spark, and PySpark.Handle migration to PySpark on AWS.Design and implement data pipelines.Work with AWS and Big Data.Produce unit tests for Spark transformations and helper methods.Create Scala/Spark jobs for data...


  • Columbus, United States TalentOla Full time

    Job Title : Python Pyspark DeveloperLocation : Columbus OHJob Description:Responsibilities:Develop and maintain data platforms using Python, Spark, and PySpark.Handle migration to PySpark on AWS.Design and implement data pipelines.Work with AWS and Big Data.Produce unit tests for Spark transformations and helper methods.Create Scala/Spark jobs for data...

  • Python Developer

    1 month ago


    Columbus, United States TalentOla Full time

    New Contract RolePlease send profiles at pratiksha@talentola.comRole- Job Title: Python Pyspark DeveloperLocation :Columbus Ohio (Local or within 55 miles only)• Hands-on object-oriented programming experience using Python is required.• Professional work experience building real-time data streams using Spark and Experience in Spark.• Knowledge or...

  • Python Developer

    1 month ago


    Columbus, United States TalentOla Full time

    New Contract RolePlease send profiles at pratiksha@talentola.comRole- Job Title: Python Pyspark DeveloperLocation :Columbus Ohio (Local or within 55 miles only)• Hands-on object-oriented programming experience using Python is required.• Professional work experience building real-time data streams using Spark and Experience in Spark.• Knowledge or...


  • Columbus, Ohio, United States TalentOla Full time

    Position: Python Pyspark DeveloperLocation: RemoteJob Overview:We are seeking a skilled Python Pyspark Developer to enhance our data platforms. The ideal candidate will be responsible for:Key Responsibilities:Developing and sustaining data infrastructures utilizing Python, Spark, and PySpark.Facilitating the transition to PySpark on cloud platforms.Designing...


  • Columbus, United States Cloudious LLC Full time

    Job DescriptionJob DescriptionDuties and responsibilities Collaborate with the team to build out features for the data platform and consolidate data assets Build, maintain and optimize data pipelines built using Spark Advise, consult, and coach other data professionals on standards and practices Work with the team to define company data assets Migrate...


  • Columbus, Ohio, United States TalentOla Full time

    Contract OpportunityPosition: Python Pyspark DeveloperKey Responsibilities:Demonstrate strong expertise in object-oriented programming utilizing Python.Develop and maintain real-time data processing streams leveraging Spark technology.Apply architectural best practices in the creation and management of data lakes.Utilize two or more scripting languages,...

  • Python Spark

    1 month ago


    Columbus, United States AIT Global inc. Full time

    Job DescriptionJob DescriptionJob Title: Python SparkLocation: Columbus, OHDuties and responsibilities:Collaborate with the team to build out features for the data platform and consolidate data assets Build, maintain and optimize data pipelines built using Spark Advise, consult, and coach other data professionals on standards and practices Work with the team...

  • Python Developer

    4 weeks ago


    Columbus, United States TalentOla Full time

    Job Title: Python Spark DeveloperLocation: Columbus, OH (State local candidate)Duties and responsibilities: ● Collaborate with the team to build out features for the data platform and consolidate data assets ● Build, maintain, and optimize data pipelines built using Spark ● Advise, consult, and coach other data professionals on standards and practices...

  • Python Developer

    2 weeks ago


    Columbus, United States TalentOla Full time

    Job Title: Python Spark DeveloperLocation: Columbus, OH (State local candidate)Duties and responsibilities: ● Collaborate with the team to build out features for the data platform and consolidate data assets ● Build, maintain, and optimize data pipelines built using Spark ● Advise, consult, and coach other data professionals on standards and practices...


  • Columbus, Ohio, United States Primus Software Corporation Full time

    Job OverviewGreetings from Primus Software Corporation,We are seeking a talented professional to join our team as a Senior Python Spark Engineer. This role involves collaborating with a dynamic team to enhance our data platform and streamline data management processes.Key Responsibilities:Work closely with team members to develop and implement features for...


  • Columbus, Ohio, United States VMC Soft Technologies, Inc Full time

    About the Role:VMC Soft Technologies, Inc is seeking a highly skilled Senior Data Analyst to join our team. As a Senior Data Analyst, you will be responsible for developing and maintaining data platforms using Python, Spark, and PySpark.Key Responsibilities:Design and implement data pipelines to handle migration to PySpark on AWS.Develop and maintain data...


  • Columbus, Ohio, United States VMC Soft Technologies, Inc Full time

    About the Role:VMC Soft Technologies, Inc is seeking a highly skilled Senior Data Analyst to join our team. As a Senior Data Analyst, you will be responsible for developing and maintaining data platforms using Python, Spark, and PySpark.Key Responsibilities:Design and implement data pipelines to handle migration to PySpark on AWS.Develop and maintain data...

  • Data Engineer

    2 weeks ago


    Columbus, United States Mindteck Full time

    Duties and responsibilities Collaborate with the team to build out features for the data platform and consolidate data assets Build, maintain and optimize data pipelines built using Spark Advise, consult, and coach other data professionals on standards and practices Work with the team to define company data assets Migrate CMS' data platform into Chase's...

  • Data Analyst

    1 week ago


    Columbus, United States VMC Soft Technologies, Inc Full time

    Job Title: Data AnalystLocation: Columbus, OhioW2 Contract OnlyJob Description:Responsibilities: Develop and maintain data platforms using Python, Spark, and PySpark. Handle migration to PySpark on AWS. Design and implement data pipelines. Work with AWS and Big Data. Produce unit tests for Spark transformations and helper methods. Create Scala/Spark jobs for...

  • Data Analyst

    7 days ago


    Columbus, United States VMC Soft Technologies, Inc Full time

    Job Title: Data AnalystLocation: Columbus, OhioW2 Contract OnlyJob Description:Responsibilities: Develop and maintain data platforms using Python, Spark, and PySpark. Handle migration to PySpark on AWS. Design and implement data pipelines. Work with AWS and Big Data. Produce unit tests for Spark transformations and helper methods. Create Scala/Spark jobs for...


  • Columbus, Ohio, United States VMC Soft Technologies, Inc Full time

    About the Role:VMC Soft Technologies, Inc is seeking a highly skilled Senior Data Analyst to join our team. As a Senior Data Analyst, you will be responsible for developing and maintaining data platforms using Python, Spark, and PySpark.Key Responsibilities:Design and implement data pipelines to extract, transform, and load data from various sources.Develop...

  • Python Developer

    2 months ago


    Columbus, Ohio, United States Atechstar Full time

    Responsibilities Develop back-end components to improve responsiveness and overall performance. Improve functionality of existing systems. Implement security and data protection solutions. Assess and prioritize feature requests.Requirements Work experience as a Python Developer. Expertise in at least one popular Python framework. Knowledge of...

  • Senior Data Analyst

    1 week ago


    Columbus, United States VMC Soft Technologies, Inc Full time

    **********************ONLY W2******************NOC2CFull AWS Environment || Good understanding about Teradata, Glue || Data MigrationResponsibilities: Develop and maintain data platforms using Python, Spark, and PySpark. Handle migration to PySpark on AWS. Design and implement data pipelines. Work with AWS and Big Data. Produce unit tests for Spark...

  • Python Developer

    3 months ago


    Columbus, Ohio, United States Atechstar Full time

    Job description Mandatory Python Django Postgres strong logical skills strong operating system concepts strong data structure concepts multi-threading concepts. Good to have Knowledge of REDIS micro-service architecture MQTT Message queues like Rabbit MQ Kafka 3rd party API integrations like payment gateways email APIs SMS API's. Experience with Pandas NumPy...