Python Spark

1 month ago


Columbus, United States AIT Global inc. Full time
Job DescriptionJob DescriptionJob Title: Python SparkLocation: Columbus, OHDuties and responsibilities:Collaborate with the team to build out features for the data platform and consolidate data
assets
Build, maintain and optimize data pipelines built using Spark
Advise, consult, and coach other data professionals on standards and practices
Work with the team to define company data assets
Migrate CMS' data platform into Chase's environment
Partner with business analysts and solutions architects to develop technical
architectures for strategic enterprise projects and initiatives
Build libraries to standardize how we process data
Loves to teach and learn, and knows that continuous learning is the cornerstone of every
successful engineer
Has a solid understanding of AWS tools such as EMR or Glue, their pros and cons and
is able to intelligently convey such knowledge
Implement automation on applicable processesMandatory Skills:5+ years of experience in a data engineering position
Proficiency is Python (or similar) and SQL
Strong experience building data pipelines with Spark
Strong verbal & written communication
Strong analytical and problem solving skills
Experience with relational datastores, NoSQL datastores and cloud object stores
Experience building data processing infrastructure in AWS
Bonus: Experience with infrastructure as code solutions, preferably Terraform
Bonus: Cloud certification
Bonus: Production experience with ACID compliant formats such as Hudi, Iceberg or
Delta Lake
Bonus: Familiar with data observability solutions, data governance frameworksRequirements:Bachelor's Degree in Computer Science/Programming or similar is preferred
Right to work
Must have legal right to work in the USA


  • Columbus, United States Ccube Full time

    Job DescriptionJob DescriptionHello Connections,Hope you all are doing well!We are Hiring a "Python Spark Developer"Python Spark Developer/PySpark DeveloperColumbus, OH (Onsite Day 1/Hybrid 3 Days a Week)W2/Full Time (Preferred)/ C2C is also Open If Candidate is Local & Ready for F2F Interview*** (Local Candidates Only/In-Person Interview Mandatory)***Job...


  • Columbus, United States Cloudious LLC Full time

    Job DescriptionJob DescriptionDuties and responsibilities Collaborate with the team to build out features for the data platform and consolidate data assets Build, maintain and optimize data pipelines built using Spark Advise, consult, and coach other data professionals on standards and practices Work with the team to define company data assets Migrate...


  • Columbus, Ohio, United States Primus Software Corporation Full time

    Job OverviewGreetings from Primus Software Corporation,We are seeking a talented professional to join our team as a Senior Python Spark Engineer. This role involves collaborating with a dynamic team to enhance our data platform and streamline data management processes.Key Responsibilities:Work closely with team members to develop and implement features for...

  • Data Engineer

    2 weeks ago


    Columbus, United States Mindteck Full time

    Duties and responsibilities Collaborate with the team to build out features for the data platform and consolidate data assets Build, maintain and optimize data pipelines built using Spark Advise, consult, and coach other data professionals on standards and practices Work with the team to define company data assets Migrate CMS' data platform into Chase's...

  • Python Developer

    1 month ago


    Columbus, United States TalentOla Full time

    New Contract RolePlease send profiles at pratiksha@talentola.comRole- Job Title: Python Pyspark DeveloperLocation :Columbus Ohio (Local or within 55 miles only)• Hands-on object-oriented programming experience using Python is required.• Professional work experience building real-time data streams using Spark and Experience in Spark.• Knowledge or...

  • Python Developer

    1 month ago


    Columbus, United States TalentOla Full time

    New Contract RolePlease send profiles at pratiksha@talentola.comRole- Job Title: Python Pyspark DeveloperLocation :Columbus Ohio (Local or within 55 miles only)• Hands-on object-oriented programming experience using Python is required.• Professional work experience building real-time data streams using Spark and Experience in Spark.• Knowledge or...


  • Columbus, United States TalentOla Full time

    Job Title : Python Pyspark DeveloperLocation : Columbus OHJob Description:Responsibilities:Develop and maintain data platforms using Python, Spark, and PySpark.Handle migration to PySpark on AWS.Design and implement data pipelines.Work with AWS and Big Data.Produce unit tests for Spark transformations and helper methods.Create Scala/Spark jobs for data...


  • Columbus, United States TalentOla Full time

    Job Title : Python Pyspark DeveloperLocation : Columbus OHJob Description:Responsibilities:Develop and maintain data platforms using Python, Spark, and PySpark.Handle migration to PySpark on AWS.Design and implement data pipelines.Work with AWS and Big Data.Produce unit tests for Spark transformations and helper methods.Create Scala/Spark jobs for data...


  • Columbus, Ohio, United States TalentOla Full time

    Contract OpportunityPosition: Python Pyspark DeveloperKey Responsibilities:Demonstrate strong expertise in object-oriented programming utilizing Python.Develop and maintain real-time data processing streams leveraging Spark technology.Apply architectural best practices in the creation and management of data lakes.Utilize two or more scripting languages,...


  • Columbus, Ohio, United States TalentOla Full time

    Position: Python Pyspark DeveloperLocation: RemoteJob Overview:We are seeking a skilled Python Pyspark Developer to enhance our data platforms. The ideal candidate will be responsible for:Key Responsibilities:Developing and sustaining data infrastructures utilizing Python, Spark, and PySpark.Facilitating the transition to PySpark on cloud platforms.Designing...

  • Python Developer

    2 weeks ago


    Columbus, United States TalentOla Full time

    Job Title: Python Spark DeveloperLocation: Columbus, OH (State local candidate)Duties and responsibilities: ● Collaborate with the team to build out features for the data platform and consolidate data assets ● Build, maintain, and optimize data pipelines built using Spark ● Advise, consult, and coach other data professionals on standards and practices...

  • Python Developer

    4 weeks ago


    Columbus, United States TalentOla Full time

    Job Title: Python Spark DeveloperLocation: Columbus, OH (State local candidate)Duties and responsibilities: ● Collaborate with the team to build out features for the data platform and consolidate data assets ● Build, maintain, and optimize data pipelines built using Spark ● Advise, consult, and coach other data professionals on standards and practices...


  • Columbus, Ohio, United States Zenith Services Inc. Full time

    Key Responsibilities● Collaborate with colleagues to enhance features for the data platform and integrate data resources● Develop, sustain, and optimize data pipelines utilizing Spark technology● Provide guidance, consultation, and mentorship to fellow data professionals on best practices and standards● Work alongside the team to establish the...


  • Columbus, Ohio, United States Zenith Services Inc. Full time

    Key Responsibilities● Collaborate with colleagues to enhance features for the data platform and integrate data resources.● Develop, sustain, and refine data pipelines utilizing Spark technology.● Provide guidance, consultation, and mentorship to fellow data professionals regarding best practices and standards.● Work alongside the team to establish...


  • Columbus, Ohio, United States Zenith Services Inc. Full time

    Key Responsibilities● Collaborate with colleagues to enhance features for the data infrastructure and unify data resources.● Develop, sustain, and refine data pipelines utilizing Spark technology.● Provide guidance, consultation, and mentorship to fellow data professionals regarding best practices and standards.● Engage with the team to outline the...


  • Columbus, Ohio, United States Zenith Services Inc. Full time

    Key Responsibilities● Collaborate with cross-functional teams to enhance features for the data infrastructure and unify data resources.● Design, develop, and optimize data workflows utilizing Spark technology.● Provide guidance, consultation, and mentorship to fellow data professionals on best practices and standards.● Work alongside the team to...


  • Columbus, Ohio, United States Zenith Services Inc. Full time

    Position OverviewAs a key member of our team at Zenith Services Inc., you will play a crucial role in enhancing our data platform and integrating data resources effectively.Key Responsibilities● Collaborate with cross-functional teams to develop and implement features for our data infrastructure.● Design, maintain, and optimize data workflows utilizing...


  • Columbus, Ohio, United States Zenith Services Inc. Full time

    Position OverviewAs a key member of the data engineering team at Zenith Services Inc., you will play a vital role in enhancing our data platform and ensuring the integrity of our data assets.Key Responsibilities● Collaborate with cross-functional teams to develop and implement features for our data infrastructure.● Design, construct, and optimize data...


  • Columbus, Ohio, United States Zenith Services Inc. Full time

    Position OverviewAs a pivotal member of the engineering team at Zenith Services Inc., you will be responsible for enhancing our data platform and ensuring the integrity of our data assets.Key ResponsibilitiesCollaborate with cross-functional teams to develop and implement features for our data platform.Design, construct, and optimize data pipelines utilizing...


  • Columbus, Ohio, United States Zenith Services Inc. Full time

    Position OverviewAs a key member of Zenith Services Inc., you will be responsible for enhancing our data platform and optimizing our data assets. Your expertise will guide the team in building robust data pipelines and implementing best practices across the organization.Key Responsibilities● Collaborate with cross-functional teams to develop features for...