Python Spark AWS developer

1 month ago


Columbus, United States Cortex consultants LLC Full time
Job DescriptionJob Description

Job Title : Python Spark AWS

Location : Columbus, OH non local candidates accepted

Job Responsibilities:

Develop and maintain data platforms using Python, Spark, and PySpark.
Handle migration to PySpark on AWS.
Design and implement data pipelines.
Work with AWS and Big Data.
Produce unit tests for Spark transformations and helper methods.
Create Scala/Spark jobs for data transformation and aggregation.
Write Scaladoc-style documentation for code.
Optimize Spark queries for performance.
Integrate with SQL databases (e.g., Microsoft, Oracle, Postgres, MySQL).
Understand distributed systems concepts (CAP theorem, partitioning, replication, consistency, and consensus).

Skills:
Proficiency in Python, Scala (with a focus on functional programming), and Spark.
Familiarity with Spark APIs, including RDD, DataFrame, MLlib, GraphX, and Streaming.
Experience working with HDFS, S3, Cassandra, and/or DynamoDB.
Deep understanding of distributed systems.
Experience with building or maintaining cloud-native applications.
Familiarity with serverless approaches using AWS Lambda is a plus



  • Columbus, United States Ccube Full time

    Job DescriptionJob DescriptionHello Connections,Hope you all are doing well!We are Hiring a "Python Spark Developer"Python Spark Developer/PySpark DeveloperColumbus, OH (Onsite Day 1/Hybrid 3 Days a Week)W2/Full Time (Preferred)/ C2C is also Open If Candidate is Local & Ready for F2F Interview*** (Local Candidates Only/In-Person Interview Mandatory)***Job...


  • Columbus, United States Cloudious LLC Full time

    Job DescriptionJob DescriptionDuties and responsibilities Collaborate with the team to build out features for the data platform and consolidate data assets Build, maintain and optimize data pipelines built using Spark Advise, consult, and coach other data professionals on standards and practices Work with the team to define company data assets Migrate...

  • Python Spark

    4 weeks ago


    Columbus, United States AIT Global inc. Full time

    Job DescriptionJob DescriptionJob Title: Python SparkLocation: Columbus, OHDuties and responsibilities:Collaborate with the team to build out features for the data platform and consolidate data assets Build, maintain and optimize data pipelines built using Spark Advise, consult, and coach other data professionals on standards and practices Work with the team...


  • Columbus, United States TalentOla Full time

    Job Title : Python Pyspark DeveloperLocation : Columbus OHJob Description:Responsibilities:Develop and maintain data platforms using Python, Spark, and PySpark.Handle migration to PySpark on AWS.Design and implement data pipelines.Work with AWS and Big Data.Produce unit tests for Spark transformations and helper methods.Create Scala/Spark jobs for data...


  • Columbus, United States TalentOla Full time

    Job Title : Python Pyspark DeveloperLocation : Columbus OHJob Description:Responsibilities:Develop and maintain data platforms using Python, Spark, and PySpark.Handle migration to PySpark on AWS.Design and implement data pipelines.Work with AWS and Big Data.Produce unit tests for Spark transformations and helper methods.Create Scala/Spark jobs for data...


  • Columbus, Ohio, United States Primus Software Corporation Full time

    Job OverviewGreetings from Primus Software Corporation,We are seeking a talented professional to join our team as a Senior Python Spark Engineer. This role involves collaborating with a dynamic team to enhance our data platform and streamline data management processes.Key Responsibilities:Work closely with team members to develop and implement features for...

  • Data Engineer

    7 days ago


    Columbus, United States Mindteck Full time

    Duties and responsibilities Collaborate with the team to build out features for the data platform and consolidate data assets Build, maintain and optimize data pipelines built using Spark Advise, consult, and coach other data professionals on standards and practices Work with the team to define company data assets Migrate CMS' data platform into Chase's...

  • Python Developer

    4 weeks ago


    Columbus, United States TalentOla Full time

    Job Title: Python Spark DeveloperLocation: Columbus, OH (State local candidate)Duties and responsibilities: ● Collaborate with the team to build out features for the data platform and consolidate data assets ● Build, maintain, and optimize data pipelines built using Spark ● Advise, consult, and coach other data professionals on standards and practices...

  • Python Developer

    2 weeks ago


    Columbus, United States TalentOla Full time

    Job Title: Python Spark DeveloperLocation: Columbus, OH (State local candidate)Duties and responsibilities: ● Collaborate with the team to build out features for the data platform and consolidate data assets ● Build, maintain, and optimize data pipelines built using Spark ● Advise, consult, and coach other data professionals on standards and practices...

  • Python Developer

    1 month ago


    Columbus, United States TalentOla Full time

    New Contract RolePlease send profiles at pratiksha@talentola.comRole- Job Title: Python Pyspark DeveloperLocation :Columbus Ohio (Local or within 55 miles only)• Hands-on object-oriented programming experience using Python is required.• Professional work experience building real-time data streams using Spark and Experience in Spark.• Knowledge or...

  • Python Developer

    1 month ago


    Columbus, United States TalentOla Full time

    New Contract RolePlease send profiles at pratiksha@talentola.comRole- Job Title: Python Pyspark DeveloperLocation :Columbus Ohio (Local or within 55 miles only)• Hands-on object-oriented programming experience using Python is required.• Professional work experience building real-time data streams using Spark and Experience in Spark.• Knowledge or...


  • Columbus, Ohio, United States TalentOla Full time

    Position: Python Pyspark DeveloperLocation: RemoteJob Overview:We are seeking a skilled Python Pyspark Developer to enhance our data platforms. The ideal candidate will be responsible for:Key Responsibilities:Developing and sustaining data infrastructures utilizing Python, Spark, and PySpark.Facilitating the transition to PySpark on cloud platforms.Designing...


  • Columbus, Ohio, United States Zenith Services Inc. Full time

    Key Responsibilities● Collaborate with colleagues to enhance features for the data platform and integrate data resources.● Develop, sustain, and refine data pipelines utilizing Spark technology.● Provide guidance, consultation, and mentorship to fellow data professionals regarding best practices and standards.● Work alongside the team to establish...


  • Columbus, Ohio, United States Zenith Services Inc. Full time

    Key Responsibilities● Collaborate with colleagues to enhance features for the data infrastructure and unify data resources.● Develop, sustain, and refine data pipelines utilizing Spark technology.● Provide guidance, consultation, and mentorship to fellow data professionals regarding best practices and standards.● Engage with the team to outline the...


  • Columbus, Ohio, United States Zenith Services Inc. Full time

    Key Responsibilities● Collaborate with cross-functional teams to enhance features for the data infrastructure and unify data resources.● Design, develop, and optimize data workflows utilizing Spark technology.● Provide guidance, consultation, and mentorship to fellow data professionals on best practices and standards.● Work alongside the team to...


  • Columbus, Ohio, United States Zenith Services Inc. Full time

    Key Responsibilities● Collaborate with colleagues to enhance features for the data platform and integrate data resources● Develop, sustain, and optimize data pipelines utilizing Spark technology● Provide guidance, consultation, and mentorship to fellow data professionals on best practices and standards● Work alongside the team to establish the...


  • Columbus, Ohio, United States Zenith Services Inc. Full time

    Position OverviewAs a key member of the data engineering team at Zenith Services Inc., you will play a vital role in enhancing our data platform and ensuring the integrity of our data assets.Key Responsibilities● Collaborate with cross-functional teams to develop and implement features for our data infrastructure.● Design, construct, and optimize data...


  • Columbus, United States Tek Ninjas consulting services Full time

    Looking For Jr Python DeveloperPython Developer with Linux Exp.Duration It’s a long term contract roleLocation Columbus OH.Mode Of Interview Phone and skypeVisa ANYJob Description • Minimum 3 years of experience as a python Developer Linux expPrimary Skills • Python Development• Linux Experience• Java/J2EE Enterprise• Amazon Web Services (AWS)


  • Columbus, Ohio, United States Zenith Services Inc. Full time

    Position OverviewAs a key member of our team at Zenith Services Inc., you will play a crucial role in enhancing our data platform and integrating data resources effectively.Key Responsibilities● Collaborate with cross-functional teams to develop and implement features for our data infrastructure.● Design, maintain, and optimize data workflows utilizing...


  • Columbus, Ohio, United States Zenith Services Inc. Full time

    Position OverviewAs a pivotal member of the engineering team at Zenith Services Inc., you will be responsible for enhancing our data platform and ensuring the integrity of our data assets.Key ResponsibilitiesCollaborate with cross-functional teams to develop and implement features for our data platform.Design, construct, and optimize data pipelines utilizing...