Senior Data Engineer

3 days ago


Columbus, Ohio, United States Diverse Lynx Full time
Job Role:
As a Senior Data Engineer, you will design and implement data pipelines using Python, Spark, and PySpark. You will handle migration to PySpark on AWS, develop and maintain data platforms, and work with AWS and Big Data. You will also produce unit tests for Spark transformations and helper methods, create Scala/Spark jobs for data transformation and aggregation, and write Scaladoc-style documentation for code. Additionally, you will optimize Spark queries for performance and integrate with SQL databases. You will have a deep understanding of distributed systems concepts, including the CAP theorem, partitioning, replication, consistency, and consensus.

Requirements:
Proficiency in Python, Scala, and Spark. Familiarity with Spark APIs, including RDD, Data Frame, MLlib, GraphX, and Streaming. Experience working with HDFS, S3, Cassandra, and/or DynamoDB. Deep understanding of distributed systems. Experience with building or maintaining cloud-native applications. Familiarity with serverless approaches using AWS Lambda is a plus.

Company Culture:
Diverse Lynx LLC is an Equal Employment Opportunity employer. We promote and support a diverse workforce across all levels in the company. All qualified applicants will receive due consideration for employment without any discrimination.

We evaluate all applicants solely on the basis of their ability, competence, and proven capability to perform the functions outlined in the corresponding role.



  • Columbus, Ohio, United States Vaco Full time

    Job Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at Vaco. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems and architectures.Key Responsibilities:Design and implement data warehouses and data lakesDevelop and maintain ETL processes and...

  • Senior Data Engineer

    3 weeks ago


    Columbus, Ohio, United States g2o Full time

    Unlock Your Potential as a Senior Data EngineerAt g2o, we're on a mission to help clients build better relationships with their customers. As a Senior Data Engineer, you'll play a crucial role in executing our clients' digital strategies and driving real business results.Key Responsibilities:Collaborate with technical teams to develop, deploy, and support...


  • Columbus, Ohio, United States Insight Global Full time

    Job SummaryThe Senior Data Engineer is responsible for designing, constructing, installing, testing, and maintaining highly scalable data management systems. This role collaborates closely with analysts and IT professionals to ensure efficient data modeling, ETL processes, and overall data architecture that supports business needs. The Senior Data Engineer...


  • Columbus, Ohio, United States Hispanic Technology Executive Council Full time

    Job Title: Data Engineering Senior AnalystWe are seeking a highly skilled Data Engineering Senior Analyst to join our team at the Hispanic Technology Executive Council. As a key member of our organization, you will play a critical role in shaping our data engineering strategy and driving business growth through data-driven insights.About the Role:The Data...


  • Columbus, Ohio, United States Amazon Data Services, Inc. Full time

    About the RoleWe are seeking a highly skilled Mechanical Engineer to join our team as a Fleet Remediation Project Design Engineer. As a key member of our team, you will be responsible for leading design projects in operational data centers, remediating issues, upgrading existing infrastructure, and adding new services.Key ResponsibilitiesOwn the design for...

  • Senior Data Engineer

    2 weeks ago


    Columbus, Ohio, United States Worldpay Full time

    Job Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our Cloud Data Platform team. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining scalable data engineering pipelines using Python, AWS, and Airflow technologies.About the RoleThe Senior Data Engineer will work closely with...

  • Senior Data Engineer

    20 minutes ago


    Columbus, Ohio, United States Ohio State University Wexner Medical Center Full time

    Job SummaryContribute to the development of strategic data initiatives and serve as a top-level technical expert for complex data and analytics projects. Collaborate with cross-functional teams to align IT solutions with business objectives and drive innovation in data-driven solutions.As a Senior Data Engineer, you will be responsible for designing,...


  • Columbus, Ohio, United States Virtual Full time

    Job Summary:We are seeking a highly skilled Senior Data Engineer to join our team at Virtual. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining our enterprise data warehouse. This is a direct-hire position with a salary range of $118,000 - $125,000.Key Responsibilities:Design and implement ETL...


  • Columbus, Ohio, United States Pinnacle Group Full time

    Job Summary:As a Senior Data Engineer at Pinnacle Group, you will be responsible for designing and developing data ingestion pipelines using AWS services and Databricks platform. This will enable downstream applications and Tableau Dashboards that drive business value across different parts of Employee Platform functions.Key Responsibilities:- Design and...


  • Columbus, Ohio, United States Artmac Soft LLC Full time

    Job Title: Senior Snowflake Data EngineerAt Artmac Soft LLC, we are seeking a highly skilled Senior Snowflake Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, implementing, and managing Snowpipe to automate and streamline the ingestion of data files from Amazon S3 into Snowflake.Key...

  • Senior Data Engineer

    16 hours ago


    Columbus, Ohio, United States Centraprise Full time

    Job Overview:Centraprise is seeking a highly skilled Senior Data Engineer to join our team. The ideal candidate will have 14-16 years of experience in big data tools, infrastructure, and related technologies. The successful candidate will be responsible for analyzing and finding impacts of technical changes on migration efforts or business needs, performing...


  • Columbus, Ohio, United States Fiserv Full time

    Job Title: Senior Data Protection EngineerFiserv is seeking a highly skilled Senior Data Protection Engineer to join our dynamic Cybersecurity team. As a key member of our team, you will be responsible for safeguarding our technology infrastructure from potential threats and developing robust security measures to meet the latest challenges.Key...


  • Columbus, Ohio, United States Fiserv Full time

    Job Title: Senior Data Protection EngineerFiserv is seeking a highly skilled Senior Data Protection Engineer to join our Cybersecurity team. As a key member of our team, you will be responsible for designing and implementing robust security measures to safeguard our technology infrastructure from potential threats.Key Responsibilities:Lead the implementation...


  • Columbus, Ohio, United States Hispanic Technology Executive Council Full time

    Job DescriptionWe are the Advanced Technology Centers (ATCs), the engine for reinvention in our clients' transformation journey. With over 255,000 people across 24 countries, we provide seamless access to industry insights and innovative technology solutions.As a Senior Data Engineer, you will be part of a highly collaborative and growing network of...

  • Mechanical Engineer

    3 weeks ago


    Columbus, Ohio, United States Amazon Data Services, Inc. Full time

    About the RoleWe are seeking a highly skilled Mechanical Engineer to join our team as a Fleet Remediation Project Design Engineer. In this role, you will lead design projects in operational data centers, remediate issues, upgrade our existing infrastructure, or add new services.You will be the 'go to' engineering resource for these projects and will provide...


  • Columbus, Ohio, United States Worldpay Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our Cloud Data Platform team. As a key member of our team, you will be responsible for designing, developing, and maintaining scalable workflows and orchestration systems using Astronomer and Airflow.Key ResponsibilitiesDevelop and implement strategies for data engineering initiatives...


  • Columbus, Ohio, United States g2o Full time

    Unlock Your Potential as a Cloud Data EngineerAt g2o, we're on a mission to revolutionize the way our clients interact with their customers. As a Senior Data Engineer, you'll play a crucial role in helping us achieve this vision.Key Responsibilities:Collaborate with our technical team to design, develop, and deploy data engineering jobs and pipelines using...


  • Columbus, Ohio, United States Hispanic Technology Executive Council Full time

    Unlock the Power of Data with Our TeamWe are the Hispanic Technology Executive Council, and we are seeking a highly skilled Data Engineer to join our team. As a key member of our Advanced Technology Centers, you will play a critical role in helping our clients transform their businesses through innovative data solutions.About the RoleThis is a unique...

  • Senior Data Engineer

    4 weeks ago


    Columbus, Ohio, United States BJSS Full time

    About UsBJSS is a leading tech consultancy that has been delivering innovative solutions to top organizations since 1993. Our team of creative problem solvers has a proven track record of finding better, more sustainable ways to solve complex technology challenges.We have a strong presence in the United States, with offices in New York City, Columbus, Ohio,...


  • Columbus, Ohio, United States Zodiac Solutions, Inc Full time

    About Zodiac Solutions, Inc.We are a leading IT staffing agency that connects talented professionals with exciting opportunities. Currently, we are hiring a Data Engineer for our client, a multinational finance company.About the RoleJob Title: Data EngineerLocation: Remote (with occasional on-site visits)Employment Type: ContractKey...