Senior Python and PySpark Engineer

2 weeks ago


Columbus, Ohio, United States TalentOla Full time

Position: Python Pyspark Developer

Location: Remote

Job Overview:

We are seeking a skilled Python Pyspark Developer to enhance our data platforms. The ideal candidate will be responsible for:

Key Responsibilities:

  • Developing and sustaining data infrastructures utilizing Python, Spark, and PySpark.
  • Facilitating the transition to PySpark on cloud platforms.
  • Designing and executing data workflows.
  • Collaborating with AWS and Big Data technologies.
  • Creating unit tests for Spark transformations and auxiliary functions.
  • Building Scala/Spark jobs for data manipulation and aggregation.
  • Documenting code with Scaladoc-style guidelines.
  • Enhancing Spark queries for optimal performance.
  • Integrating with various SQL databases (e.g., Microsoft SQL Server, Oracle, PostgreSQL, MySQL).
  • Grasping concepts of distributed systems (including CAP theorem, partitioning, replication, consistency, and consensus).

Required Skills:

  • Expertise in Python, Scala (emphasizing functional programming), and Spark.
  • Familiarity with Spark APIs, such as RDD, Data Frame, MLlib, GraphX, and Streaming.
  • Experience with HDFS, S3, Cassandra, and/or DynamoDB.
  • In-depth knowledge of distributed systems.
  • Experience in developing or managing cloud-native applications.
  • Understanding of serverless architectures using AWS Lambda is advantageous.


  • Columbus, Ohio, United States TalentOla Full time

    Contract OpportunityPosition: Python Pyspark DeveloperKey Responsibilities:Demonstrate strong expertise in object-oriented programming utilizing Python.Develop and maintain real-time data processing streams leveraging Spark technology.Apply architectural best practices in the creation and management of data lakes.Utilize two or more scripting languages,...


  • Columbus, Ohio, United States VMC Soft Technologies, Inc Full time

    About the Role:VMC Soft Technologies, Inc is seeking a highly skilled Senior Data Analyst to join our team. As a Senior Data Analyst, you will be responsible for developing and maintaining data platforms using Python, Spark, and PySpark.Key Responsibilities:Design and implement data pipelines to handle migration to PySpark on AWS.Develop and maintain data...


  • Columbus, Ohio, United States BCforward Full time

    Senior Software Engineer - Java/PythonCompany Overview:BCforward is a leading IT solutions and staffing firm, dedicated to providing exceptional services tailored to our clients' needs. With a robust presence across North America and India, we pride ourselves on our extensive experience and commitment to excellence.Position Overview:We are seeking a highly...


  • Columbus, Ohio, United States g2o Full time

    About g2oAt g2o, we're passionate about helping clients build strong relationships with their customers. Our team of experts collaborates with clients to deliver technology expertise, human-centered design, and industry experience that drives real business results.Job SummaryWe're seeking a highly skilled Senior Data Engineer to join our team. As a key...


  • Columbus, Ohio, United States g2o Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at g2o. As a key member of our data engineering team, you will play a critical role in designing, developing, and deploying scalable data pipelines using Spark and Python.Key ResponsibilitiesCollaborate with technical team members to develop, deploy, and production support...


  • Columbus, Ohio, United States Primus Software Corporation Full time

    Job OverviewGreetings from Primus Software Corporation,We are seeking a talented professional to join our team as a Senior Python Spark Engineer. This role involves collaborating with a dynamic team to enhance our data platform and streamline data management processes.Key Responsibilities:Work closely with team members to develop and implement features for...


  • Columbus, Ohio, United States VMC Soft Technologies, Inc Full time

    About the Role:VMC Soft Technologies, Inc is seeking a highly skilled Senior Data Analyst to join our team. As a Senior Data Analyst, you will be responsible for developing and maintaining data platforms using Python, Spark, and PySpark.Key Responsibilities:Design and implement data pipelines to handle migration to PySpark on AWS.Develop and maintain data...


  • Columbus, Ohio, United States Zenith Services Inc. Full time

    Key Responsibilities● Collaborate with colleagues to enhance features for the data platform and integrate data resources● Develop, sustain, and optimize data pipelines utilizing Spark technology● Provide guidance, consultation, and mentorship to fellow data professionals on best practices and standards● Work alongside the team to establish the...


  • Columbus, Ohio, United States Zenith Services Inc. Full time

    Key Responsibilities● Collaborate with colleagues to enhance features for the data infrastructure and unify data resources.● Develop, sustain, and refine data pipelines utilizing Spark technology.● Provide guidance, consultation, and mentorship to fellow data professionals regarding best practices and standards.● Engage with the team to outline the...


  • Columbus, Ohio, United States Zenith Services Inc. Full time

    Key Responsibilities● Collaborate with colleagues to enhance features for the data platform and integrate data resources.● Develop, sustain, and refine data pipelines utilizing Spark technology.● Provide guidance, consultation, and mentorship to fellow data professionals regarding best practices and standards.● Work alongside the team to establish...


  • Columbus, Ohio, United States Zenith Services Inc. Full time

    Key Responsibilities● Collaborate with cross-functional teams to enhance features for the data infrastructure and unify data resources.● Design, develop, and optimize data workflows utilizing Spark technology.● Provide guidance, consultation, and mentorship to fellow data professionals on best practices and standards.● Work alongside the team to...


  • Columbus, Ohio, United States Zenith Services Inc. Full time

    Position OverviewAs a pivotal member of the engineering team at Zenith Services Inc., you will be responsible for enhancing our data platform and ensuring the integrity of our data assets.Key ResponsibilitiesCollaborate with cross-functional teams to develop and implement features for our data platform.Design, construct, and optimize data pipelines utilizing...


  • Columbus, Ohio, United States Zenith Services Inc. Full time

    Position OverviewAs a key member of the data engineering team at Zenith Services Inc., you will play a vital role in enhancing our data platform and ensuring the integrity of our data assets.Key Responsibilities● Collaborate with cross-functional teams to develop and implement features for our data infrastructure.● Design, construct, and optimize data...


  • Columbus, Ohio, United States Zenith Services Inc. Full time

    Position OverviewAs a key member of Zenith Services Inc., you will be responsible for enhancing our data platform and optimizing our data assets. Your expertise will guide the team in building robust data pipelines and implementing best practices across the organization.Key Responsibilities● Collaborate with cross-functional teams to develop features for...


  • Columbus, Ohio, United States Zenith Services Inc. Full time

    Position OverviewAs a key member of our team at Zenith Services Inc., you will play a crucial role in enhancing our data platform and integrating data resources effectively.Key Responsibilities● Collaborate with cross-functional teams to develop and implement features for our data infrastructure.● Design, maintain, and optimize data workflows utilizing...


  • Columbus, Ohio, United States The Cigna Group Full time

    The job profile for this position is Software Engineering Senior Advisor, which is a Band 4 Senior Contributor Career Track Role.Excited to grow your career?We value our talented employees, and whenever possible strive to help one of our associates grow professionally before recruiting new talent to our open positions. If you think the open position you see...


  • Columbus, Ohio, United States VMC Soft Technologies, Inc Full time

    About the Role:VMC Soft Technologies, Inc is seeking a highly skilled Senior Data Analyst to join our team. As a Senior Data Analyst, you will be responsible for developing and maintaining data platforms using Python, Spark, and PySpark.Key Responsibilities:Design and implement data pipelines to extract, transform, and load data from various sources.Develop...

  • Data Engineer

    3 days ago


    Columbus, Ohio, United States Beacon Hill Full time

    Job Summary:We are seeking a talented Junior Data Engineer to join our team at Beacon Hill. This individual will be part of a Data Engineering team responsible for building and maintaining a new Data Warehouse.Key Responsibilities:Develop and implement SQL queries to extract and manipulate dataWork with ETL tools to design and implement data...


  • Columbus, Ohio, United States Wipro Full time

    About Wipro:Wipro Limited (NYSE: WIT, BSE: 507685, NSE: WIPRO) stands as a premier technology services and consulting organization dedicated to crafting innovative solutions that meet the intricate digital transformation demands of our clients. Our extensive portfolio encompasses consulting, design, engineering, operations, and emerging technologies,...

  • Senior Java Engineer

    2 weeks ago


    Columbus, Ohio, United States Evolve Esolutions LLC Full time

    Position: Senior Java EngineerWork Arrangement: Hybrid (3 Days Onsite)Eligibility: Local Candidates OnlyVisa Status: USC, GC, and GC-EADContract Type: W2 Contract OnlyKey Responsibilities:We are seeking a highly skilled Senior Java Engineer with a strong background in software development. The ideal candidate will possess:A Bachelor's degree in Computer...