Staff Data Engineer

2 weeks ago


Chicago, United States Motion Recruitment Full time
We are looking for a Staff Data Engineer to join one of the 100 Best Companies to Work For, with offices in the Chicagoland area and remote flexibility, on a full-time basis. This leading supplier of maintenance, repair, and operating products for businesses and a wide range of industries across the globe has a focus on sustainability, social responsibility, and community engagement, serving more than 4.5 million customers worldwide.

As a Staff Data Engineer, you will help the team by ingesting flat files and multimodal files like PDFs, videos, voice recordings, and images to help improve their AI/ML platform that uses LLM technologies. This platform will help how the organization is servicing their various customers. In this role you’ll be contributing to ongoing architecture, development, and mentor junior engineers. The ideal candidate will have a strong background in data engineering, with a focus on Databricks, and have experience implementing real-time streaming technologies. Having experience IaC will be an added bonus.

We encourage you to apply for this exciting opportunity and be part of a company that values sustainability, social responsibility, community engagement, innovation, and growth. Required Skills & Experience
  • As the technical lead and architect, your primary responsibility will be to design and implement highly efficient, reusable, and scalable data processing systems and pipelines in Databricks and Snowflake.
  • Design and implement technical solutions and processes to ensure data reliability and accuracy.
  • Develop data models and mappings and build new data assets required by users. Perform exploratory data analysis on existing products and datasets. 
  • Educate data engineering teams in adopting new data patterns and tools. 
  • Function as SME within this area when engaging with our AI, Platform, and Business Analytics teams to build useful pipelines and data assets. Desired Skills & Experience
    • Experience in batch and streaming ETL using Spark, Python, Scala, Snowflake or Databricks for Data Engineering or Machine Learning workloads.
    • Experience orchestrating and implementing pipelines with workflow tools like Databricks Workflows, Apache Airflow, or Luigi
    • Experience prepping structured and unstructured data for data science models.
    • Experience with containerization and orchestration technologies (Docker, Kubernetes) and experience with shell scripting in Bash, Unix or windows shell is preferable.
    • Implemented CI/CD with automated testing in Jenkins, Github Actions, or Gitlab CI/CD
    • Familiarity with AWS Services not limited to Glue, Athena, Lambda, S3, and DynamoDB
    • Demonstrated experience implementing data management life cycle, using data quality functions like standardization, transformation, rationalization, linking and matching. The Offer
      • Bonus eligible You will receive the following benefits:
        • Medical, dental, vision, and life insurance plans
        • Paid time off (PTO) and 6 company holidays per year
        • Automatic 6% 401(k) company contribution each pay period
        • Employee discounts, parental leave, 3:1 match on donations and tuition reimbursement
        • A comprehensive set of emotional, financial, physical and social wellbeing programs
          Applicants must be currently authorized to work in the US on a full-time basis now and in the future.

          #LI-EM1


  • Chicago, United States NTT DATA Full time

    **Req ID**: 283299 We are currently seeking a Azure Kubernetes Services Data Developer - REMOTE or HYBRID to join our team in Chicago, Illinois (US-IL), United States (US). **Day to Day Responsibilities**: - Design, Architect, and Develop solutions leveraging cloud big data technology to ingest, process and analyze large, disparate data sets to exceed...


  • Chicago, Illinois, United States Orion Group Full time

    Orion Project Services LLC and Big Pharma is the best combination in Northern Illinois Are you a Data Engineer that specializes Curation? I have the a tremendous opportunity for you right now Accept the challenge and begin your career with a Market Leading Pharmaceutical company if your skills exceed the description below 1 year initial contract (extension...

  • Data Engineer

    7 days ago


    Chicago, United States UNITED STATES SOCCER FEDERATION 1 Full time

    Job DescriptionJob DescriptionDescription:U.S. Soccer OverviewWe are U.S. Soccer and we are the future of sport in the United States. Our mission is to make soccer the preeminent sport in the United States. We embrace diversity, technology and global connections to drive the growth of our sport and serve our athletes and fans. We seek motivated, passionate,...

  • Data Engineer

    6 days ago


    Chicago, Illinois, United States CapTech Full time

    Company DescriptionCapTech is an award-winning consulting firm that collaborates with clients to achieve what's possible through the power of technology. At CapTech, we're passionate about the work we do and the results we achieve for our clients. From the outset, our founders shared a collective passion to create a consultancy centered on strong...

  • Systems Engineer

    4 weeks ago


    Chicago, United States Data Theorem Full time

    Job DescriptionJob DescriptionData Theorem is an exciting company focused on creating a more secure world for data. Rooted in a strong engineer first culture, every employee has an impact on product and direction. We are searching for exceptional talent pursuing an opportunity to grow and take ownership of the projects that resonate most with them.Our...

  • Systems Engineer

    1 month ago


    Chicago, United States Data Theorem Full time

    Job DescriptionJob DescriptionData Theorem is an exciting company focused on creating a more secure world for data. Rooted in a strong engineer first culture, every employee has an impact on product and direction. We are searching for exceptional talent pursuing an opportunity to grow and take ownership of the projects that resonate most with them.Our...

  • Staff Engineer

    5 days ago


    Chicago, United States Staff-Point Recruitment Full time

    Tegus is the leading market intelligence platform for key decision makers. We power some of the world’s most well-respected institutional investors, corporations, and consultancies through the largest and most comprehensive database of primary and market information. Our products and services enable clients to discover unmatched insights and answers to the...

  • Data Engineer

    7 days ago


    Chicago, United States SPECTRAFORCE Full time

    Job Title: Data Engineer Duration: 6-month Contract to Hire possibility Location: Chicago, IL 60604 - Must be onsite 3 days per weekDay to day:The client is seeking a highly skilled and motivated Data Engineer to join the team. The ideal candidate will have expertise in data engineering with a strong focus on Incorta, Power BI development and SQL. As a Data...

  • Data Engineer

    1 day ago


    Chicago, United States Verano Full time

    Verano is seeking an innovative Data Engineer to join our team within IT Applications. You will be responsible for designing and building data pipelines using Python and Google cloud infrastructure. This role requires a strong understanding of data engineering principles and the ability to work effectively with both technical and non-technical stakeholders....

  • Data Engineer

    2 hours ago


    Chicago, United States Verano Full time

    Verano is seeking an innovative Data Engineer to join our team within IT Applications. You will be responsible for designing and building data pipelines using Python and Google cloud infrastructure. This role requires a strong understanding of data engineering principles and the ability to work effectively with both technical and non-technical stakeholders....

  • Data Engineer

    6 days ago


    Chicago, Illinois, United States United Airlines Full time

    Our Marketing and Loyalty team is the strategic force behind United's industry-leading brand and experience, supporting revenue growth by turning customers into lifelong United flyers. Our marketing communications, market research and brand teams drive travelers' familiarity and engagement with the United brand. Our product, design and service teams bring...

  • Senior Data Engineer

    1 month ago


    Chicago, United States Green Thumb Full time

    The Role As a Senior Data Engineer, you will be responsible for developing and implementing data pipelines, focusing on efficient extraction, transformation, and loading (ETL) processes. Your role will involve creating scalable services for data tracking, translating complex requirements into detailed designs, and exploring alternatives for streamlined data...

  • Data Engineer

    1 month ago


    Chicago, United States Optomi Full time

    Optomi, is in partnership with an Enterprise Automotive Repair Company, is seeking a Mid-Senior Level Data Engineer to join and grow the Data/BI Team in the Chicago Area.What The Right Professional Will Enjoy!The ability to work with emerging technologies in the data engineering and cloud spaceA company that harbors internal growth and leadership...

  • Data Engineer

    1 month ago


    Chicago, United States Optomi Full time

    Optomi, is in partnership with an Enterprise Automotive Repair Company, is seeking a Mid-Senior Level Data Engineer to join and grow the Data/BI Team in the Chicago Area.What The Right Professional Will Enjoy!The ability to work with emerging technologies in the data engineering and cloud spaceA company that harbors internal growth and leadership...

  • Data Engineer

    1 month ago


    Chicago, United States Optomi Full time

    Optomi, is in partnership with an Enterprise Automotive Repair Company, is seeking a Mid-Senior Level Data Engineer to join and grow the Data/BI Team in the Chicago Area.What The Right Professional Will Enjoy!The ability to work with emerging technologies in the data engineering and cloud spaceA company that harbors internal growth and leadership...

  • Data Engineer

    7 days ago


    Chicago, Illinois, United States Danaher Full time

    Leica Biosystems' mission of "Advancing Cancer Diagnostics, Improving Lives" is at the heart of our corporate culture. We're a global leader in cancer diagnostics with the most comprehensive portfolio from biopsy to diagnosis. Our easy-to-use and consistently reliable offerings help improve workflow efficiency and diagnostic confidence.Our associates know...

  • Data Engineer

    7 days ago


    Chicago, United States NinjaTrader Full time

    Job DescriptionJob DescriptionNinjaTrader is an investor-backed, growth-stage FinTech company with an award-winning platform and over 1 million users. We are building products and services which empower active traders to easily analyze and react to data from the world's leading financial markets. Located in Chicago, our unique employee-centric company...


  • Chicago, United States Luxus Full time

    Job Description: The Staff Process Engineer will play a pivotal role within project teams, contributing to the creation of cutting-edge designs for new projects, alterations, and redevelopments across diverse sectors such as power, process, corporate, healthcare, pipeline airports, institutional, industrial, manufacturing, government, and military...


  • Chicago, United States Burns & McDonnell Full time

    Recruitment Fraud: If you suspect a job offer claiming to be from Burns & McDonnell or its affiliates may be illegitimate, please notify us . Start your next chapter. We're hiring. Job Information Burns & McDonnell Staff Chemical Engineer in Chicago , Illinois Description The Staff Chemical Engineer will work on project teams to create world class designs...


  • Chicago, United States Amazon Data Services, Inc. Full time

    1+ in a Data Center Environment. - 1+ years experience in participating in on-call rotations, and providing after-hours support in an environment that operates 24/7 - 1+ years of experience with Networking, or Computer hardware. AWS Infrastructure Services owns the design, planning, delivery, and operation of all AWS global infrastructure. In other words,...