See more Collapse

Python/Spark Lead

1 month ago

Columbus, United States Virtusa Full time

Experience in building SparkStreaming process. Proficient in understanding distributed computing principles. Experience in managing Hadoop cluster with all services. Experience with Nosql Databases and Messaging systems like Kafka. Designing building installing configuring and supporting Hadoop Perform analysis of vast data stores. Good understanding of cloud technology. Must have strong technical experience in Design Mapping specifications HLD LLD. Must have the ability to relate to both business and technical members of the team and possess excellent communication skills. Leverage internal tools and SDKs, utilize AWS services such as S3, Athena, and Glue, and integrate with our internal Archival Service Platform for efficient data purging. Lead the integration efforts with the internal Archival Service Platform for seamless data purging4 and lifecycle management. Collaborate with the data engineering team to continuously improve data integration pipelines, ensuring adaptability to evolving business needs.

Experience in building SparkStreaming process. Proficient in understanding distributed computing principles. Experience in managing Hadoop cluster with all services. Experience with Nosql Databases and Messaging systems like Kafka. Designing building installing configuring and supporting Hadoop Perform analysis of vast data stores. Good understanding of cloud technology. Must have strong technical experience in Design Mapping specifications HLD LLD. Must have the ability to relate to both business and technical members of the team and possess excellent communication skills. Leverage internal tools and SDKs, utilize AWS services such as S3, Athena, and Glue, and integrate with our internal Archival Service Platform for efficient data purging. Lead the integration efforts with the internal Archival Service Platform for seamless data purging4 and lifecycle management. Collaborate with the data engineering team to continuously improve data integration pipelines, ensuring adaptability to evolving business needs.

We have other current jobs related to this field that you can find below

  • Python Spark

    2 months ago

    Columbus, United States Spruce Infotech Full time

    Responsibilities: Develop and maintain data platforms using Python, Spark, and PySpark. Handle migration to PySpark on AWS. Design and implement data pipelines. Work with AWS and Big Data. Produce unit tests for Spark transformations and helper methods. Create Scala/Spark jobs for data transformation and aggregation. Write Scaladoc-style documentation for...

  • Python Spark Developer

    3 weeks ago

    Columbus, United States Diverse Lynx Full time

    Job Title : Python Spark Developer Location : Columbus, OH (Onsite day 1) Job Responsibilities: Develop and maintain data platforms using Python, Spark, and PySpark. Handle migration to PySpark on AWS. Design and implement data pipelines. Work with AWS and Big Data. Produce unit tests for Spark transformations and helper methods. Create Scala/Spark jobs...

  • Python Spark AWS

    3 weeks ago

    Columbus, United States Diverse Lynx Full time

    Title: Python Developer (With Spark, AWS) Duration: Contract /Full-Time Location: Columbus, OH (Onsite) Interview mode: Video Conference/IN- Person Joining: ASAP This is the description . Job Responsibilities: Develop and maintain data platforms using Python, Spark, and PySpark. Handle migration to PySpark on AWS. Design and implement data...

  • Python Spark AWS

    1 month ago

    Columbus, United States Diverse Lynx Full time

    Title: Python Developer (With Spark, AWS) Duration: Contract /Full-Time Location: Columbus, OH (Onsite) Interview mode: Video Conference/IN- Person Joining: ASAP This is the description . Job Responsibilities: Develop and maintain data platforms using Python, Spark, and PySpark. Handle migration to PySpark on AWS. Design and implement data...

  • Python Spark Developer

    1 month ago

    Columbus, United States Compunnel Full time

    Responsibilities: Develop and maintain data platforms using Python, Spark, and PySpark. Handle migration to PySpark on AWS. Design and implement data pipelines. Work with AWS and Big Data. Produce unit tests for Spark transformations and helper methods. Create Scala/Spark jobs for data transformation and aggregation. Write Scala doc-style documentation for...

  • Apptad - Python Spark Developer

    2 months ago

    Columbus, United States Apptad Inc Full time

    Job DescriptionJob DescriptionJob Title: Apptad - Python Spark DeveloperJob Location: Columbus, OH (Onsite)Job Duration: Long-TermJob Description Job Responsibilities:Develop and maintain data platforms using Python, Spark, and PySpark.Handle migration to PySpark on AWS.Design and implement data pipelines.Work with AWS and Big Data.Produce unit tests for...

  • Python Developer with AWS Spark

    2 weeks ago

    Columbus, United States Quantum World Technologies Inc. Full time

    Job Title : Python Spark AWSLocation : Columbus, OH (Onsite)Duration :: Contract (W2 only)/ Full timeJob Responsibilities:Develop and maintain data platforms using Python, Spark, and PySpark. Handle migration to PySpark on AWS. Design and implement data pipelines. Work with AWS and Big Data. Produce unit tests for Spark transformations and helper methods....

  • Python Developer with AWS Spark

    2 weeks ago

    Columbus, United States Quantum World Technologies Inc. Full time

    Job Title : Python Spark AWSLocation : Columbus, OH (Onsite)Duration :: Contract (W2 only)/ Full timeJob Responsibilities:Develop and maintain data platforms using Python, Spark, and PySpark. Handle migration to PySpark on AWS. Design and implement data pipelines. Work with AWS and Big Data. Produce unit tests for Spark transformations and helper methods....

  • Python Spark Developer

    2 weeks ago

    Columbus, United States AIT Global inc. Full time

    Job DescriptionJob DescriptionJob Title: Python Spark Developer Location: Columbus, OHDuties and responsibilities:Collaborate with the team to build out features for the data platform and consolidate dataassetsBuild, maintain and optimize data pipelines built using SparkAdvise, consult, and coach other data professionals on standards and practicesWork with...

  • Python Developer

    3 weeks ago

    Columbus, United States TalentOla Full time

    Job Title: Python PySpark DeveloperLocation: Columbus, OH (Only Onsite Local)Note: Data Engineer with Python, please do not apply for this role.Job Description:• Hands-on object-oriented programming experience using Python is required.• Professional work experience building real-time data streams using Spark and Experience in Spark.• Knowledge or...

  • Python Developer

    3 weeks ago

    Columbus, United States TalentOla Full time

    Job Title: Python PySpark DeveloperLocation: Columbus, OH (Only Onsite Local)Note: Data Engineer with Python, please do not apply for this role.Job Description:• Hands-on object-oriented programming experience using Python is required.• Professional work experience building real-time data streams using Spark and Experience in Spark.• Knowledge or...

  • Databricks Tech Lead

    3 months ago

    Columbus, United States Diverse Lynx Full time

    Job Title: Databricks Tech Lead Duration: Full Time/ Permanent Job Location: Columbus, OHJob Description Python, Databricks, perl, spark , Kubernetes, dockers and other cloud native tools and technologies. Data warehousing, AWS Cloud Business, Intelligence, Informatica and Databricks(data flow design, development, enhancement and maintenance). Real time data...

  • Python Engineer with AWS

    3 weeks ago

    Columbus, United States Dice Full time

    Dice is the leading career destination for tech experts at every stage of their careers. Our client, AIT Global, Inc., is seeking the following. Apply via Dice today! Job Title: Python Engineer with AWS Location: Columbus, OH Key Responsibilities: Cloud Engineering: Design, develop, and implement cloud infrastructure and solutions for business intelligence...

  • Senior Machine Learning Engineer

    2 weeks ago

    Columbus, United States The Hartford Full time

    Responsibilities: Work closely with Tech leads, Product Manager and Product Owner to deliver MLOPs platform solution in AWS using Python and other tools for the Actuarial community. Work with data engineers/Data Scientist to tackle challenging AIOps problems. Maintain and manage current CI/CD ecosystem and tools. Find ways to automate and continually improve...

  • Java Big data Engineer

    2 weeks ago

    Columbus, United States Corporate Solutions Tech Full time

    Job DescriptionJob DescriptionJava Big data EngineerColumbus OH (Hybrid role)Must have skills : Java, Big data, Python (nice to have) BS/BA degree or equivalent experience 5+ years of experience in application development using any of these programming languages: Java, Scala, Python. Experience working in financial industry is preferred. 3+ years of...

  • Java J2EE

    1 month ago

    Columbus, United States Pinnacle Group Full time

    "Must be able to work on W2 without sponsorship."Job Description: Prefer 2 to 7 years of Spark on Cloud development experience Required 4 to 7 years of strong SQL skills; Teradata is preference but experience in any other RDBMS Required Core Java Development for 5-8 years experience Any experience in understanding requirement related to extraction,...

  • Java J2EE

    2 months ago

    Columbus, United States Pinnacle Group Full time

    "Must be able to work on W2 without sponsorship."Job Description: Prefer 2 to 7 years of Spark on Cloud development experience Required 4 to 7 years of strong SQL skills; Teradata is preference but experience in any other RDBMS Required Core Java Development for 5-8 years experience Any experience in understanding requirement related to extraction,...

  • Nas Infrastructure Storage Engineer

    2 weeks ago

    Columbus, United States Pyramid Consulting Full time

    Immediate need for a talented NAS Infrastructure Storage Engineer - NetApp + Python Scripting . This is a 6+ months Contract opportunity with long-term potential and is located in Columbus, Ohio (Hybrid) . Please review the job description below and contact me ASAP if you are interested. Job ID: 24-25501 Pay Range: $60 - $62/hour. Employee benefits include,...

  • Java Big data Engineer

    2 weeks ago

    Columbus, United States Accord Technologies Inc. Full time

    Job DescriptionJob DescriptionJava Big data EngineerColumbus OH (Hybrid role)Look for nearby candidate Must have skills : Java, Big data, Python (nice to have) BS/BA degree or equivalent experience 5+ years of experience in application development using any of these programming languages: Java, Scala, Python. Experience working in financial industry is...

  • Senior Data Engineer

    2 months ago

    Columbus, United States g2o Full time

    Your future starts here Imagine being part of a team that helps clients build better relationships with customers. When you join us, you'll help top-notch clients to execute the digital strategies of the future. Every day, we collaborate with clients and each other to provide technology expertise, human-centered design and industry experience to...