Senior Python Spark Engineer

2 weeks ago


Columbus, Ohio, United States Primus Software Corporation Full time
Job Overview

Greetings from Primus Software Corporation,

We are seeking a talented professional to join our team as a Senior Python Spark Engineer. This role involves collaborating with a dynamic team to enhance our data platform and streamline data management processes.

Key Responsibilities:

  • Work closely with team members to develop and implement features for our data infrastructure.
  • Design, maintain, and optimize data pipelines utilizing Spark technology.
  • Provide guidance and mentorship to fellow data professionals on best practices and standards.
  • Assist in defining and managing the company’s data assets.
  • Facilitate the migration of data platforms into our operational environment.
  • Collaborate with business analysts and solutions architects to create technical frameworks for enterprise-level projects.
  • Develop libraries to standardize data processing methodologies.
  • Embrace a culture of continuous learning and knowledge sharing.
  • Possess a solid understanding of AWS tools, including EMR and Glue, and communicate their advantages and disadvantages effectively.
  • Implement automation for relevant processes.

Essential Qualifications:

  • Minimum of 5 years of experience in a data engineering role.
  • Proficient in Python (or similar languages) and SQL.
  • Extensive experience in building data pipelines with Spark.
  • Excellent verbal and written communication skills.
  • Strong analytical and problem-solving abilities.
  • Experience with relational databases, NoSQL databases, and cloud storage solutions.
  • Experience in developing data processing infrastructure within AWS.
  • Preferred: Familiarity with infrastructure as code solutions, ideally Terraform.
  • Preferred: Cloud certification.
  • Preferred: Experience with ACID-compliant formats such as Hudi, Iceberg, or Delta Lake.
  • Preferred: Knowledge of data observability solutions and data governance frameworks.

Educational Requirements:

A Bachelor’s Degree in Computer Science, Programming, or a related field is preferred.

Eligibility:

Must have the legal right to work in the USA.

Thank you for considering this opportunity with Primus Software Corporation.



  • Columbus, Ohio, United States TalentOla Full time

    Position: Python Pyspark DeveloperLocation: RemoteJob Overview:We are seeking a skilled Python Pyspark Developer to enhance our data platforms. The ideal candidate will be responsible for:Key Responsibilities:Developing and sustaining data infrastructures utilizing Python, Spark, and PySpark.Facilitating the transition to PySpark on cloud platforms.Designing...


  • Columbus, Ohio, United States TalentOla Full time

    Contract OpportunityPosition: Python Pyspark DeveloperKey Responsibilities:Demonstrate strong expertise in object-oriented programming utilizing Python.Develop and maintain real-time data processing streams leveraging Spark technology.Apply architectural best practices in the creation and management of data lakes.Utilize two or more scripting languages,...


  • Columbus, Ohio, United States Zenith Services Inc. Full time

    Key Responsibilities● Collaborate with colleagues to enhance features for the data platform and integrate data resources● Develop, sustain, and optimize data pipelines utilizing Spark technology● Provide guidance, consultation, and mentorship to fellow data professionals on best practices and standards● Work alongside the team to establish the...


  • Columbus, Ohio, United States Zenith Services Inc. Full time

    Key Responsibilities● Collaborate with colleagues to enhance features for the data platform and integrate data resources.● Develop, sustain, and refine data pipelines utilizing Spark technology.● Provide guidance, consultation, and mentorship to fellow data professionals regarding best practices and standards.● Work alongside the team to establish...


  • Columbus, Ohio, United States Zenith Services Inc. Full time

    Key Responsibilities● Collaborate with colleagues to enhance features for the data infrastructure and unify data resources.● Develop, sustain, and refine data pipelines utilizing Spark technology.● Provide guidance, consultation, and mentorship to fellow data professionals regarding best practices and standards.● Engage with the team to outline the...


  • Columbus, Ohio, United States Zenith Services Inc. Full time

    Key Responsibilities● Collaborate with cross-functional teams to enhance features for the data infrastructure and unify data resources.● Design, develop, and optimize data workflows utilizing Spark technology.● Provide guidance, consultation, and mentorship to fellow data professionals on best practices and standards.● Work alongside the team to...


  • Columbus, Ohio, United States Zenith Services Inc. Full time

    Position OverviewAs a key member of the data engineering team at Zenith Services Inc., you will play a vital role in enhancing our data platform and ensuring the integrity of our data assets.Key Responsibilities● Collaborate with cross-functional teams to develop and implement features for our data infrastructure.● Design, construct, and optimize data...


  • Columbus, Ohio, United States Zenith Services Inc. Full time

    Position OverviewAs a pivotal member of the engineering team at Zenith Services Inc., you will be responsible for enhancing our data platform and ensuring the integrity of our data assets.Key ResponsibilitiesCollaborate with cross-functional teams to develop and implement features for our data platform.Design, construct, and optimize data pipelines utilizing...


  • Columbus, Ohio, United States Zenith Services Inc. Full time

    Position OverviewAs a key member of Zenith Services Inc., you will be responsible for enhancing our data platform and optimizing our data assets. Your expertise will guide the team in building robust data pipelines and implementing best practices across the organization.Key Responsibilities● Collaborate with cross-functional teams to develop features for...


  • Columbus, Ohio, United States Zenith Services Inc. Full time

    Position OverviewAs a key member of our team at Zenith Services Inc., you will play a crucial role in enhancing our data platform and integrating data resources effectively.Key Responsibilities● Collaborate with cross-functional teams to develop and implement features for our data infrastructure.● Design, maintain, and optimize data workflows utilizing...


  • Columbus, Ohio, United States VMC Soft Technologies, Inc Full time

    About the Role:VMC Soft Technologies, Inc is seeking a highly skilled Senior Data Analyst to join our team. As a Senior Data Analyst, you will be responsible for developing and maintaining data platforms using Python, Spark, and PySpark.Key Responsibilities:Design and implement data pipelines to handle migration to PySpark on AWS.Develop and maintain data...


  • Columbus, Ohio, United States BCforward Full time

    Senior Software Engineer - Java/PythonCompany Overview:BCforward is a leading IT solutions and staffing firm, dedicated to providing exceptional services tailored to our clients' needs. With a robust presence across North America and India, we pride ourselves on our extensive experience and commitment to excellence.Position Overview:We are seeking a highly...


  • Columbus, Ohio, United States g2o Full time

    About g2oAt g2o, we're passionate about helping clients build strong relationships with their customers. Our team of experts collaborates with clients to deliver technology expertise, human-centered design, and industry experience that drives real business results.Job SummaryWe're seeking a highly skilled Senior Data Engineer to join our team. As a key...


  • Columbus, Ohio, United States g2o Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at g2o. As a key member of our data engineering team, you will play a critical role in designing, developing, and deploying scalable data pipelines using Spark and Python.Key ResponsibilitiesCollaborate with technical team members to develop, deploy, and production support...


  • Columbus, Ohio, United States Infinity Consulting Solutions Full time

    Infinity Consulting Solutions is seeking a talented Senior Java Software Engineer to join our dynamic team.Key ResponsibilitiesEngage with business stakeholders to collaborate with various technology teams in the design, development, and testing of comprehensive cloud-based data solutions.• Take ownership of the quality, security, availability, resilience,...


  • Columbus, Ohio, United States VMC Soft Technologies, Inc Full time

    About the Role:VMC Soft Technologies, Inc is seeking a highly skilled Senior Data Analyst to join our team. As a Senior Data Analyst, you will be responsible for developing and maintaining data platforms using Python, Spark, and PySpark.Key Responsibilities:Design and implement data pipelines to handle migration to PySpark on AWS.Develop and maintain data...


  • Columbus, Ohio, United States Wipro Full time

    About Wipro:Wipro Limited (NYSE: WIT, BSE: 507685, NSE: WIPRO) stands as a premier technology services and consulting organization dedicated to crafting innovative solutions that meet the intricate digital transformation demands of our clients. Our extensive portfolio encompasses consulting, design, engineering, operations, and emerging technologies,...


  • Columbus, Ohio, United States VMC Soft Technologies, Inc Full time

    About the Role:VMC Soft Technologies, Inc is seeking a highly skilled Senior Data Analyst to join our team. As a Senior Data Analyst, you will be responsible for developing and maintaining data platforms using Python, Spark, and PySpark.Key Responsibilities:Design and implement data pipelines to extract, transform, and load data from various sources.Develop...


  • Columbus, Ohio, United States The Cigna Group Full time

    The job profile for this position is Software Engineering Senior Advisor, which is a Band 4 Senior Contributor Career Track Role.Excited to grow your career?We value our talented employees, and whenever possible strive to help one of our associates grow professionally before recruiting new talent to our open positions. If you think the open position you see...

  • Senior Java Engineer

    2 weeks ago


    Columbus, Ohio, United States Evolve Esolutions LLC Full time

    Position: Senior Java EngineerWork Arrangement: Hybrid (3 Days Onsite)Eligibility: Local Candidates OnlyVisa Status: USC, GC, and GC-EADContract Type: W2 Contract OnlyKey Responsibilities:We are seeking a highly skilled Senior Java Engineer with a strong background in software development. The ideal candidate will possess:A Bachelor's degree in Computer...