Senior Data Engineer

2 days ago


Columbus, Ohio, United States Diverse Lynx Full time
Job Title: Senior Data Engineer - Big Data

We are seeking a highly skilled Senior Data Engineer to join our team at Diverse Lynx LLC in Columbus, OH. As a key member of our data engineering team, you will design and implement scalable data platforms using Python, Spark, and PySpark.

**Responsibilities:**
• Develop and maintain large-scale data systems for real-time data processing and analytics.
• Collaborate with cross-functional teams to integrate data pipelines with cloud-native applications.
• Design and implement efficient data storage solutions using HDFS, S3, Cassandra, and/or DynamoDB.
• Optimize Spark queries for performance and ensure scalability.
• Work with SQL databases such as Microsoft, Oracle, Postgres, and MySQL for data integration.
• Participate in code reviews to ensure high-quality code and adherence to best practices.

**Requirements:**
• Proficiency in Python, Scala, and Spark with a focus on functional programming.
• Experience working with distributed systems concepts (CAP theorem, partitioning, replication, consistency, and consensus).
• Strong understanding of cloud-native architectures and serverless approaches using AWS Lambda.
• Familiarity with Scaladoc-style documentation for code.
• Excellent problem-solving skills and attention to detail.

**What We Offer:**
• Competitive salary: $120,000 - $150,000 per year.
• Opportunity to work on cutting-edge projects with a talented team.
• Comprehensive benefits package including health insurance, 401(k) matching, and paid time off.

  • Columbus, Ohio, United States Beacon Hill Staffing Group Full time

    Beacon Hill Staffing Group is seeking a Senior Data Quality Engineer to support our clients in the healthcare industry.About the RoleThe Senior Data Quality Engineer will be responsible for ensuring the accuracy, completeness, and integrity of data sets for use in internal data systems and for delivery from internal systems. This includes designing,...

  • Senior Data Engineer

    3 weeks ago


    Columbus, Ohio, United States Diverse Lynx Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team in Columbus, OH. As a key member of our data engineering team, you will play a critical role in building and maintaining our data platforms using Python Spark AWS.ResponsibilitiesCollaborate with cross-functional teams to design and implement data pipelines that drive...


  • Columbus, Ohio, United States Abbott Laboratories Full time

    Job SummaryWe are seeking a skilled Senior OT Systems Engineer to join our team at Abbott Laboratories. As a key member of our operations team, you will be responsible for developing, deploying, and maintaining manufacturing operation data systems.About UsAbbott is a global healthcare leader that helps people live more fully at all stages of life. Our...


  • Columbus, Ohio, United States Maintec Technologies Full time

    Job Title: Data EngineerExperience: 11 to 13 YearsAt Maintec Technologies, we are seeking a highly skilled Data Engineer with 6-8 years of experience in PySpark and AWS. The ideal candidate will have a strong background in data acquisition, processing, and integration.Key Responsibilities:Data Acquisition and Processing: Develop and implement robust data...

  • Data Engineer

    2 weeks ago


    Columbus, Ohio, United States Resource Informatics Group Full time

    Job Description:We are seeking a highly skilled Senior Data Engineer to join our team at Resource Informatics Group. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data pipelines using Azure Data Factory (ADF), Azure Data Lake (ADLS), Azure Databricks, SQL Server, and Data...


  • Columbus, Ohio, United States Jobs for Humanity Full time

    Job DescriptionAbout UsJobs for Humanity is a collaborative platform that aims to build an inclusive and just employment ecosystem. We strive to provide opportunities for individuals from diverse backgrounds.About the RoleWe are seeking a highly skilled Data Engineer to join our team at Safelite, a leading auto glass company. As a Senior Data Analytics...


  • Columbus, Ohio, United States Noblis Full time

    OverviewNoblis is a leading provider of innovative solutions to the US government. Our team of experts works on cutting-edge projects in data science, aerospace engineering, and software development.Job DescriptionWe are seeking an Aerospace Software Engineer for Aeronautics and Data Science to join our team. The ideal candidate will have a strong background...


  • Columbus, Ohio, United States MAPSYS Inc. Full time

    Job DescriptionMAPSYS Inc. is seeking a highly skilled Senior Data Quality Analyst to join our dynamic team in supporting business object migration to Power BI.The ideal candidate will be responsible for analyzing and understanding existing reports, data mapping, identifying any data gaps, validating data quality & metrics, and ensuring a smooth...


  • Columbus, Ohio, United States JobRialto Full time

    Job Overview:The Senior Data Migration and Synchronization Specialist will lead the development and execution of performance and functional test plans for data migration and synchronization applications at JobRialto. This role involves collaborating with cross-functional teams to design, develop, and execute comprehensive testing strategies.About You:We are...


  • Columbus, Ohio, United States Tiger Analytics Full time

    Senior Analytics Engineer - Reporting Solutions Job Description:Tiger Analytics is seeking a Senior Analytics Engineer to join our Business Intelligence team. As a Technical Product Owner, you will be responsible for delivering innovation and tools to global business teams.About the Role:This is a cross-functional role that requires strong interpersonal...


  • Columbus, Ohio, United States LER TechForce Full time

    Job Title: Senior Software Quality Assurance Engineer.Overview: At LER TechForce, we seek a highly skilled and experienced Senior Software Quality Assurance Engineer to join our team in Columbus, Indiana. The successful candidate will be responsible for ensuring the quality of software products, collaborating with cross-functional teams, and developing and...


  • Columbus, Ohio, United States GATE Insight, Inc. Full time

    Cloud Data Engineer with Snowflake ExpertiseGATE Insight, Inc. seeks a skilled Cloud Data Engineer with expertise in Snowflake and AWS to join our team.Responsibilities:Design, implement, and manage Snowpipe to automate data ingestion from Amazon S3 into Snowflake.Ensure reliability and timeliness of data ingestion processes, and monitor performance.Utilize...


  • Columbus, Ohio, United States Saxon Global Full time

    **Job Overview**We are seeking a highly skilled Senior Java Software Engineer to join our team at Saxon Global. As a key member of our development team, you will be responsible for designing, developing, and implementing high-quality software solutions using Java and Spring Boot.The ideal candidate will have 7+ years of experience in software development,...

  • Senior Data Architect

    2 weeks ago


    Columbus, Ohio, United States Centraprise Full time

    As a Senior Data Architect at Centraprise, you will be responsible for designing and implementing the company's data architecture. This includes selecting and integrating big data tools and frameworks, ETL process implementation, and monitoring performance to advise necessary infrastructure changes. The ideal candidate will have 15+ years of hands-on...

  • Senior Cloud Engineer

    3 weeks ago


    Columbus, Ohio, United States BCforward Full time

    Job Title: Senior Cloud EngineerAbout the Company:BCforward is a leading IT business solutions and staffing firm with over 25 years of experience in delivering uniquely configured IT staffing and project solutions to our customers. Our team of experts has a deep understanding of the latest technologies and trends, enabling us to provide innovative solutions...


  • Columbus, Ohio, United States Women Impact Tech Full time

    Job Title: Senior Data EngineerJob Overview:Data Engineers at Women Impact Tech should have expertise in designing and implementing scalable and secure data solutions on Azure. This includes understanding Azure's data services ecosystem, such as Azure Data Lake, Azure Synapse Analytics, and Azure Data Bricks.The successful candidate will be able to architect...


  • Columbus, Ohio, United States RIT Solutions, Inc. Full time

    Job SummaryWe are seeking a talented Data Engineer to join our team at RIT Solutions, Inc. As a Data Engineer, you will be responsible for developing life sciences content curation and delivery systems, as well as data transformation and integration pipelines. If you have a strong background in software development and data engineering, combined with a...


  • Columbus, Ohio, United States Seamless Full time

    Job OverviewAt Seamless.AI, we're seeking a highly skilled Principal Data Engineer to lead our data engineering efforts.Key ResponsibilitiesDesign and develop scalable ETL pipelines using Python and AWS Glue.Collaborate with cross-functional teams to understand data requirements and develop efficient data acquisition and integration strategies.Implement data...


  • Columbus, Ohio, United States JPMorganChase Full time

    Job OverviewWe are seeking a highly skilled Senior Manager of Software Engineering to lead our technical teams in delivering trusted, turn-key Systems, Applications and Products in Data Processing technology products.About the RoleLeverage advancements in AI/ML, automation, and chatbot innovations to enhance, build, and deliver systems.Collaborate with...


  • Columbus, Ohio, United States Prime Therapeutics Full time

    We're looking for a seasoned professional to lead our data integration team at Prime Therapeutics. This is a great opportunity to work with a talented group of engineers on challenging projects and contribute to the company's mission of improving healthcare outcomes.Job Overview:We are seeking an experienced Cloud Engineer Lead who can drive our cloud...