Senior Data Engineer

4 months ago


Columbus, United States g2o Full time

Your future starts here

Imagine being part of a team that helps clients build better relationships with customers. When you join us, you'll help top-notch clients to execute the digital strategies of the future. Every day, we collaborate with clients and each other to provide technology expertise, human-centered design and industry experience to deliver real business results.

Position description

Work collaboratively with technical team members to develop, deploy and production support data engineering jobs and pipelines - spark structured stream processing jobs across one or more streams, persisted to a data lake. Work with leads and architects to prototype designs and technologies. Design and develop data engineering jobs with an eye on quality attributes (and trade-offs) such as simplicity, reliability, scalability, extensibility, performance. Build or reuse common frameworks where possible. Set and adhere to coding and style guides to ensure consistency. Ensure code quality through mechanisms including code coverage, peer reviews, pair programming. Create and deploy streaming data quality checks with remediation runbooks. Adhere to data governance and compliance requirements and standards. Provide recommendations for and help curate technical backlogs for technical debt management and continuous improvement.

Required qualifications

5+ years of total experience working with data and data pipeline technologies at scale. 3+ years of solid Python development experience – including: Robust unit and integration testing and Git driven CI/CD to production 2+ years of proven experience developing streaming data processing tasks using pySpark and SparkSQL Solid understanding of Spark, preferably Databricks Spark and Apache Delta Read streaming data from Kafka, Apache Delta or similar, merge /enrich /qualify data inline, capture operations metrics, persist to target, debug and optimize At scale and in production Experience leveraging public cloud data and analytics services. Azure preferred, but AWS/GCP also works. Nice to have: Super user experience with reporting tools such a PowerBI.

Required education and experience

College/University Degree or equivalent.
  • Senior Data Engineer

    4 months ago


    Columbus, United States Resource Informatics Group Full time

    The client is looking for a solid Senior Data Engineer with strong zure Data Factory (ADF) , zure Data Lake (ADLS), Azure Databricks, SQL Server, Data Warehouse and REST API call and SFTP. Please let me know if you have anyone else that has at least the 10 years of required experience? Role: Senior Data Engineer Pay Rate: $Market Duration: 6+ Months:...


  • Columbus, Ohio, United States Saxon Global Full time

    Job SummaryThe Senior Data Engineer will play a key role in designing, developing, and implementing data transformation solutions to support business needs. This individual will work closely with cross-functional teams to identify data requirements, design and implement data pipelines, and ensure data quality and integrity.Key ResponsibilitiesData Design and...


  • Columbus, Ohio, United States The Hartford Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our Feature Integration team within Data Science Enablement organization at The Hartford. As a key member of our team, you will be responsible for designing, building, and delivering high-quality code to support our Entity Resolution tech stack.Key ResponsibilitiesEstimate, design,...

  • Senior Data Engineer

    4 weeks ago


    Columbus, United States BJSS Full time

    About Us We're an award-winning innovative tech consultancy - a team of creative problem solvers. Since 1993 we've been finding better, more sustainable ways to solve complex technology problems for some of the world's leading organizations and delivered solutions that millions of people use every day. In the last 30 years we won several awards, including...


  • Columbus, Ohio, United States g2o Full time

    Unlock Your Potential as a Data EngineerAt g2o, we're on a mission to help clients build better relationships with their customers. As a Senior Data Engineer, you'll play a crucial role in executing our clients' digital strategies. You'll collaborate with our technical team to develop, deploy, and support data engineering jobs and pipelines, leveraging Spark...

  • Senior Data Engineer

    2 weeks ago


    Columbus, Ohio, United States g2o Full time

    About g2oAt g2o, we're passionate about helping clients build strong relationships with their customers. Our team of experts collaborates with clients to deliver technology expertise, human-centered design, and industry experience that drives real business results.Job SummaryWe're seeking a highly skilled Senior Data Engineer to join our team. As a key...

  • Senior Data Engineer

    3 months ago


    Columbus, United States BJSS Full time

    About UsWe’re an award-winning innovative tech consultancy - a team of creative problem solvers. Since 1993 we’ve been finding better, more sustainable ways to solve complex technology problems for some of the world’s leading organizations and delivered solutions that millions of people use every day.In the last 30 years we won several awards,...

  • Senior Data Engineer

    3 months ago


    Columbus, United States BJSS Full time

    About UsWe’re an award-winning innovative tech consultancy - a team of creative problem solvers. Since 1993 we’ve been finding better, more sustainable ways to solve complex technology problems for some of the world’s leading organizations and delivered solutions that millions of people use every day.In the last 30 years we won several awards,...

  • Senior Data Engineer

    3 weeks ago


    Columbus, Ohio, United States g2o Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at g2o. As a key member of our data engineering team, you will play a critical role in designing, developing, and deploying scalable data pipelines using Spark and Python.Key ResponsibilitiesCollaborate with technical team members to develop, deploy, and production support...

  • Senior Data Engineer

    17 hours ago


    Columbus, Ohio, United States BJSS Full time

    About UsBJSS is a leading tech consultancy that has been delivering innovative solutions to top organizations for over 30 years. Our team of creative problem solvers has a proven track record of success, with numerous awards and recognition in the industry.We operate globally, with offices in 26 locations, and have a strong presence in the United States. Our...

  • Senior Data Engineer

    3 weeks ago


    Columbus, Ohio, United States VMC Soft Technologies, Inc Full time

    About the Role:VMC Soft Technologies, Inc is seeking a highly skilled Senior Data Analyst to join our team. As a Senior Data Analyst, you will be responsible for developing and maintaining data platforms using Python, Spark, and PySpark.Key Responsibilities:Design and implement data pipelines to handle migration to PySpark on AWS.Develop and maintain data...

  • Senior Data Engineer

    2 weeks ago


    Columbus, Ohio, United States BJSS Full time

    About UsWe're a leading tech consultancy - a team of innovative problem solvers. Since 1993 we've been finding better, more sustainable ways to solve complex technology problems for some of the world's leading organizations and delivered solutions that millions of people use every day.In the last 30 years we've won several awards, including our most recent...

  • Senior Data Engineer

    2 weeks ago


    Columbus, Ohio, United States Jobs for Humanity Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our Data Led Decisions team at Jobs for Humanity. As a key member of our team, you will play a critical role in innovatively optimizing data centralization methods and data pipelines using API and ETL tools to deliver business value from the use of data and analytics.Key...

  • Senior Data Architect

    2 weeks ago


    Columbus, Ohio, United States Comtech Global Inc Full time

    Job Title: Senior Data ModelerJob Summary:Comtech Global Inc is seeking a highly skilled Senior Data Modeler to join our team. As a Senior Data Modeler, you will be responsible for designing and implementing data models that support business decision-making and operational workflows.Key Responsibilities:Design and implement comprehensive data models that...


  • Columbus, United States Robert Half Full time

    Job DescriptionJob DescriptionWe are offering an exciting opportunity for a Data Engineer to join our team in Columbus, Ohio, United States. The successful candidate will play a pivotal role in our IT team, providing data solutions that support business strategies. This role involves working closely with the corporate business intelligence teams to develop,...


  • Columbus, Ohio, United States Great American Insurance Group Full time

    About the RoleThe Senior Data Architect is a key position within the Data Strategy & Enterprise Architecture organization that partners to define and operationalize the data domain strategy, roadmap, and best practices in alignment with Reference Architecture and the business strategy, objectives, and EA standards with a focus on business value creation.The...


  • Columbus, Ohio, United States Amazon Full time

    About the RoleWe are seeking a highly skilled Senior Mechanical Engineer to join our AWS Infrastructure Services team. As a key member of our team, you will be responsible for designing, planning, and delivering data center infrastructure solutions that meet the highest standards of safety, security, and efficiency.Key ResponsibilitiesDesign and develop data...


  • Columbus, Ohio, United States Gilbane Full time

    OverviewGilbane is seeking a highly skilled Senior Data Scientist to join our Information Technology Team.Job SummaryWe are looking for a talented data scientist to lead our predictive modeling efforts and drive business insights. The ideal candidate will have a strong background in statistics, machine learning, and data mining, with experience in developing...

  • Senior Data Modeler

    2 weeks ago


    Columbus, United States Comtech Global Inc Full time

    Urgent Senior Data Modeler 100% Remote Job Description: We are seeking a senior Data Modeler to join our dynamic team in a fastpaced enterprise environment. With 7 years of expertise the ideal candidate will bring a wealth of knowledge in constructing and implementing sophisticated data models using industrystandard tools such as ERwin ER/Studio and...

  • Data Engineer

    3 days ago


    Columbus, Ohio, United States Beacon Hill Full time

    Job Title: Jr. Data EngineerWe are seeking a skilled Jr. Data Engineer to contribute to the development of our new Data Warehouse. The ideal candidate will have hands-on experience with Data Engineering, SQL queries, and ETL practices.Key Responsibilities:Develop and implement SQL queries to extract and transform dataWork with ETL tools to design and execute...