Current jobs related to Python Spark Developer - Columbus - Cloudious LLC

  • Senior Data Engineer

    1 week ago

    Columbus, Ohio, United States Diverse Lynx Full time

    Job Role: As a Senior Data Engineer, you will design and implement data pipelines using Python, Spark, and PySpark. You will handle migration to PySpark on AWS, develop and maintain data platforms, and work with AWS and Big Data. You will also produce unit tests for Spark transformations and helper methods, create Scala/Spark jobs for data transformation and...

  • Senior Data Engineer

    1 week ago

    Columbus, Ohio, United States Diverse Lynx Full time

    Job Title :Senior Data Engineer - Python Spark AWSLocation : Columbus, OH - non local candidates acceptedJob Responsibilities:Develop and maintain scalable data platforms using Python, Spark, and PySpark on AWS. Handle migration to PySpark and design data pipelines. Work with distributed systems, AWS, and Big Data. Produce unit tests for Spark...

  • Senior Data Engineer

    1 week ago

    Columbus, Ohio, United States Diverse Lynx Full time

    Job Summary:Diverse Lynx LLC is seeking a highly skilled Data Platform Developer to join our team. As a Data Platform Developer, you will be responsible for designing and implementing data pipelines using Python, Spark, and PySpark.Key Responsibilities:Develop and maintain data platforms using Python, Spark, and PySpark.Handle migration to PySpark on...

  • Senior Data Engineer

    3 days ago

    Columbus, Ohio, United States Diverse Lynx Full time

    Job Title :Senior Data Engineer - Python Spark AWSLocation :Columbus, OH - non local candidates acceptedJob Responsibilities:Develop and maintain scalable data platforms using Python, Spark, and PySpark. Handle migration to PySpark on AWS. Design and implement efficient data pipelines. Work with AWS and Big Data. Produce unit tests for Spark transformations...

  • Senior Data Engineer

    3 days ago

    Columbus, Ohio, United States Diverse Lynx Full time

    Job Summary: We are seeking a highly skilled Senior Data Engineer to join our team at Diverse Lynx LLC. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data platforms using Python, Spark, and PySpark. Key Responsibilities: Develop and maintain data platforms using Python, Spark,...

  • Spark Developer

    3 weeks ago

    Columbus, United States Cynosure Technologies LLC Full time

    We are looking for a Spark Developer as a Hybrid job. Please find below the job details and get back to us at your earliest convenience for a detailed discussion.Title : Spark Developer Duration : 6+ Months Job Description :Cascading/MapReduce SparkBig Data, Kubernetes , Spark 3

  • Senior Spark Developer

    3 weeks ago

    Columbus, United States Cynosure Technologies LLC Full time

    We are looking for a Senior Spark Developer for a Columbus, OH, hybrid job. Please find the below job details.Job Title: Senior Spark DeveloperLocation: Columbus, Ohio Local candidates preferred.Duration: 6 Months PlusJob Description:Looking for Sr Software Engineer skilled in conversion of Cascading/MapReduce to Spark. This individual will be responsible...

  • Senior Spark Developer

    3 weeks ago

    Columbus, United States Cynosure Technologies LLC Full time

    Job Title: Senior Spark DeveloperLocation: Columbus, Ohio (Hybrid Onsite - 3 Days/Week) Local candidates preferred. Duration: 6 Months Plus Job Description:Looking for Sr Software Engineer skilled in conversion of Cascading/MapReduce to Spark. This individual will be responsible for migrating Big Data workloads to Kubernetes/Spark 3. Will lead the...

  • Senior Spark Developer

    3 days ago

    Columbus, Ohio, United States Eateam Full time

    Job Summary:We are seeking a highly skilled Sr/Lead Spark3 Developer to join our team at Eateam. The ideal candidate will have expertise in converting Cascading/MapReduce to Spark and leading the migration of Big Data workloads to Kubernetes/Spark 3.Key Responsibilities: Migrate Big Data workloads to Kubernetes/Spark 3 Lead the conversion of...

  • Python Developer

    1 week ago

    Columbus, Ohio, United States Omni Inclusive Full time

    Job Title: Python ConsultantAt Omni Inclusive, we are seeking a highly skilled Python Consultant to join our team. As a key member of our development team, you will be responsible for designing, developing, and implementing scalable and efficient software solutions using Python.Key Responsibilities:Design and develop high-quality Python code for our...

  • Python Developer

    3 weeks ago

    Columbus, Ohio, United States Omni Inclusive Full time

    Job Description:We are seeking a highly skilled Python Consultant to join our team at Omni Inclusive. As a key member of our development team, you will be responsible for designing, developing, and implementing scalable and efficient software solutions using Python.Key Responsibilities:Design and develop high-quality Python code for our...

  • Python Developer

    4 weeks ago

    Columbus, Ohio, United States Omni Inclusive Full time

    Job Description:We are seeking a highly skilled Python Consultant to join our team at Omni Inclusive. As a key member of our development team, you will be responsible for designing, developing, and implementing scalable and efficient software solutions using Python.Key Responsibilities:Design and develop high-quality Python code for our...

  • Data Engineer

    6 days ago

    Columbus, Ohio, United States Tekgence Private Ltd Full time

    Job TitleData Engineer - AWS and SparkA Data Engineer at Tekgence Private Ltd is a software engineer with expertise in data engineering. The data engineer will build and maintain the company's data warehouse, which is used for both reporting and analytics across the organization. The individual works cross-functionally with technical and business teams to...

  • Python Pyspark

    6 days ago

    Columbus, United States Centraprise Full time

    Job Title : Python PysparkJob Location : Columbus, OH (Fully ONSITE from Day1)Job Type : Long term Contract-W2Job Description:Position summary A Data Engineer at CMS is a software engineer with proficiency in data. The data engineer will build and maintain the CMS data warehouse which is used for both reporting and analytics across the company. The...

  • Python Pyspark

    7 days ago

    Columbus, United States Centraprise Full time

    Job Title : Python PysparkJob Location : Columbus, OH (Fully ONSITE from Day1)Job Type : Long term Contract-W2Job Description:Position summary A Data Engineer at CMS is a software engineer with proficiency in data. The data engineer will build and maintain the CMS data warehouse which is used for both reporting and analytics across the company. The...

  • Python Pyspark

    6 days ago

    columbus, United States Centraprise Full time

    Job Title : Python PysparkJob Location : Columbus, OH (Fully ONSITE from Day1)Job Type : Long term Contract-W2Job Description:Position summary A Data Engineer at CMS is a software engineer with proficiency in data. The data engineer will build and maintain the CMS data warehouse which is used for both reporting and analytics across the company. The...

  • Senior Python Developer

    6 days ago

    Columbus, Ohio, United States Insight Global Full time

    Job OpportunityA company in the Nashville area is seeking a skilled Python developer to join their team. The ideal candidate will have extensive experience with Python, mathematical skills, and the ability to convert legacy code to Python.We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic...

  • SPARK Parent Partner

    2 days ago

    Columbus, Ohio, United States YMCA OF CENTRAL OHIO Full time

    Job SummaryAs a SPARK Parent Partner, you will play a vital role in supporting the development of young children and their families in our community. This position requires a passionate and dedicated individual who can think critically and communicate effectively with diverse groups of people.Key ResponsibilitiesComplete intake process for children,...

  • Python Consultant: Expert Developer for Omni Inclusive

    2 days ago

    Columbus, Georgia, United States Omni Inclusive Full time

    Job Title: Python ConsultantJob Description: At Omni Inclusive, we are seeking a skilled Python Consultant to join our team. As a Python Consultant, you will be responsible for developing back-end components to improve responsiveness and overall performance of our applications. Your expertise in Python will enable you to integrate user-facing elements into...

  • Snowflake Developer

    1 week ago

    Columbus, Ohio, United States TechnoGen Full time

    Snowflake DeveloperTechnoGen is seeking a highly skilled Snowflake Developer to join our team. As a Snowflake Developer, you will be responsible for designing and developing reliable, efficient, and scalable solutions for various projects on Snowflake.Key Responsibilities:Provide technical support for Snowflake database developmentDesign and develop Snowpark...

Python Spark Developer

2 months ago

Columbus, United States Cloudious LLC Full time
Job DescriptionJob DescriptionDuties and responsibilities
Collaborate with the team to build out features for the data platform and consolidate data
assets
Build, maintain and optimize data pipelines built using Spark
Advise, consult, and coach other data professionals on standards and practices
Work with the team to define company data assets
Migrate CMS' data platform into Chase's environment
Partner with business analysts and solutions architects to develop technical
architectures for strategic enterprise projects and initiatives
Build libraries to standardize how we process data
Loves to teach and learn, and knows that continuous learning is the cornerstone of every
successful engineer
Has a solid understanding of AWS tools such as EMR or Glue, their pros and cons and
is able to intelligently convey such knowledge
Implement automation on applicable processesMandatory Skills:
5+ years of experience in a data engineering position
Proficiency is Python (or similar) and SQL
Strong experience building data pipelines with Spark
Strong verbal & written communication
Strong analytical and problem solving skills
Experience with relational datastores, NoSQL datastores and cloud object stores
Experience building data processing infrastructure in AWS
Bonus: Experience with infrastructure as code solutions, preferably Terraform
Bonus: Cloud certification
Bonus: Production experience with ACID compliant formats such as Hudi, Iceberg or
Delta Lake
Bonus: Familiar with data observability solutions, data governance frameworks
Requirements
Bachelor's Degree in Computer Science/Programming or similar is preferred
Right to work
Must have legal right to work in the USA