Cloud Data Engineer

1 month ago


Kirksville, United States Saxon Global Full time

This is a 12 month contract with Washington University. 100% remote. Only EST/CST candidates. Only submit American USC/GC o W2. Rate is 60-70/HR-W2,

Exp with data utilization our platform and ingest that data & the other will support Databricks and our product implementation at Tulane.

Required

  • 5+ years Data Engineering
  • Java or Scala Development experience
  • use cases with data structures and algorithms
  • extensive experience with Apache Spark, Data Plan Storage, Delta Lake, Delta Pipelines, Performance Engineering, in addition to standard database/ETL knowledge
  • building cloud data pipelines, architectures, data sets with advanced knowledge of stream-based, API data extraction processes (bulk API is a must)
  • Building data models, DB schemas for read and write performance optimization
  • Supporting data transformation in serverless, overseeing metadata automation, management in a multitenant cloud environment
Role

The Data & Artificial Intelligence (DAI) practice is an exciting solutions consulting group within the well-established Technology Partners' organization. This growing team is obsessed with solving the hardest problems through enabling data teams, analysts, and business users. Our work leveraging delta technologies and AI allow our customers to focus on high-ceiling work critical their overall mission (clinical cancer outcomes, education, biomedical research, precision shopper analytics, etc).

Our team is well aligned with Microsoft and Databricks as channel partners - as a result, most technical work takes place within Azure and leverages Databricks' Apache Spark engine; along with our own proprietary enhancements. The responsibilities below require extensive knowledge in Apache Spark, Data Plan Storage, Delta Lake, Delta Pipelines, and Performance Engineering, in addition to standard database/ETL knowledge.

Requirements

- BS in Computer Science (preferable MS or PhD in distributed data systems or quantitative fields)

- Understands the working nature of a multi-year effort of iterative deliverables within both client and product environments

- Driven by delivering value and impact daily

- 3+ years of full stack engineering experience (java or scala)

- 3+ years of experience in real-world use cases with data structures and algorithms

- 2+ years of experience in distributed systems, databases, and Spark

- 5+ years of experience in a data engineering role

- 5+ yeas of SQL experience working with relation relational databases, writing complex queries for a variety of databases

- 3+ years of experience building cloud data pipelines, architectures, and data sets with advanced knowledge of stream-based, API data extraction processes (bulk API is a must)

- 3+ years of experience building data models, DB schemas for read and write performance optimization

- 2+ years of experience supporting data transformation in serverless and overseeing metadata automation and management in a multitenant cloud environment

- Experience of BI tools is a plus

.

  • Kirksville, United States Socket Full time

    Job Type Full-timeDescriptionSocket is a leader in business telecommunications providing business customers with a value-driven, customer centric alternative to the incumbent service providers. With our corporate headquarters in Columbia, MO, we serve locations across Missouri, including Columbia, Jefferson City, Sedalia, Warrensburg, Rolla, Warrenton, Troy,...


  • Kirksville, United States Socket Full time

    Job Type Full-timeDescriptionSocket is a leader in business telecommunications providing business customers with a value-driven, customer centric alternative to the incumbent service providers. With our corporate headquarters in Columbia, MO, we serve locations across Missouri, including Columbia, Jefferson City, Sedalia, Warrensburg, Rolla, Warrenton, Troy,...


  • Kirksville, United States Socket Full time

    Job Type Full-time Description Socket is a leader in business telecommunications providing business customers with a value-driven, customer centric alternative to the incumbent service providers. With our corporate headquarters in Columbia, MO, we serve locations across Missouri, including Columbia, Jefferson City, Sedalia, Warrensburg, Rolla, Warrenton,...


  • Kirksville, United States Socket Full time

    Job Type Full-time Description Socket is a leader in business telecommunications providing business customers with a value-driven, customer centric alternative to the incumbent service providers. With our corporate headquarters in Columbia, MO, we serve locations across Missouri, including Columbia, Jefferson City, Sedalia, Warrensburg, Rolla, Warrenton,...


  • Kirksville, United States Gpac Full time

    Residential Construction Land Development ManagerOne of my top home builders is on the search for a Land Development Manager! They are well-respected in the area and emphasize growth, mentorship, and development of their employees.The Land Development Manager will acquire undeveloped land or finished lots for development. Work with property owners,...


  • Kirksville, United States Gpac Full time

    Residential Construction Land Development ManagerOne of my top home builders is on the search for a Land Development Manager! They are well-respected in the area and emphasize growth, mentorship, and development of their employees.The Land Development Manager will acquire undeveloped land or finished lots for development. Work with property owners,...

  • Civil Superintendent

    3 weeks ago


    Kirksville, United States Black & Veatch Family of Companies Full time

    At Black & Veatch, our employee-owners go beyond the project. For over a century, we have been breaking down social, economic and geographic barriers by making life's critical resources accessible to all. Working with us, you will help provide critical expertise as we, along with our valued clients, deliver solutions that positively impact communities around...

  • Civil Superintendent

    3 weeks ago


    Kirksville, United States Black & Veatch Family of Companies Full time

      At Black & Veatch, our employee-owners go beyond the project. For over a century, we have been breaking down social, economic and geographic barriers by making life's critical resources accessible to all. Working with us, you will help provide critical expertise as we, along with our valued clients, deliver solutions that positively impact...


  • Kirksville, United States Black & Veatch Family of Companies Full time

      At Black & Veatch, our employee-owners go beyond the project. For over a century, we have been breaking down social, economic and geographic barriers by making life's critical resources accessible to all. Working with us, you will help provide critical expertise as we, along with our valued clients, deliver solutions that positively impact...


  • Kirksville, United States Black & Veatch Family of Companies Full time

    At Black & Veatch, our employee-owners go beyond the project. For over a century, we have been breaking down social, economic and geographic barriers by making life's critical resources accessible to all. Working with us, you will help provide critical expertise as we, along with our valued clients, deliver solutions that positively impact communities around...

  • Civil Superintendent

    3 weeks ago


    Kirksville, United States Black & Veatch Family of Companies Full time

    Together, we own our company, our future, and our shared success. As an employee-owned company, our people are Black & Veatch. We put them at the center of everything we do and empower them to grow, explore new possibilities and use their diverse talents and perspectives to solve humanity's biggest challenges in an ever-evolving world. With over 100 years of...


  • Kirksville, United States Black & Veatch Family of Companies Full time

    Together, we own our company, our future, and our shared success. As an employee-owned company, our people are Black & Veatch. We put them at the center of everything we do and empower them to grow, explore new possibilities and use their diverse talents and perspectives to solve humanity's biggest challenges in an ever-evolving world. With over 100 years of...

  • Civil Superintendent

    3 weeks ago


    Kirksville, United States Black & Veatch Family of Companies Full time

    Together, we own our company, our future, and our shared success. As an employee-owned company, our people are Black & Veatch. We put them at the center of everything we do and empower them to grow, explore new possibilities and use their diverse talents and perspectives to solve humanity's biggest challenges in an ever-evolving world. With over 100 years of...


  • Kirksville, United States Black & Veatch Family of Companies Full time

    Together, we own our company, our future, and our shared success. As an employee-owned company, our people are Black & Veatch. We put them at the center of everything we do and empower them to grow, explore new possibilities and use their diverse talents and perspectives to solve humanity's biggest challenges in an ever-evolving world. With over 100 years of...