Lead Data Engineer

2 weeks ago


Chicago, Illinois, United States Motion Recruitment Full time

An esteemed investment firm based in Chicago is on the lookout for a Lead Data Engineer to join their innovative team in a hybrid capacity. Specializing in fostering growth for businesses across technology, healthcare, and consumer sectors, this company is renowned for its strategic approach to investment and operational support. With a focus on driving market success and maximizing value for portfolio companies, they are seeking a skilled Senior Data Engineer to contribute to their data-driven strategies and drive innovation forward. This role presents an exciting opportunity to collaborate with visionary entrepreneurs and make a significant impact in the world of investment.

As a Lead Data Engineer, you will play a pivotal role in creating, designing, and deploying ETL and ELT flows for consuming data from disparate sources of 3rd party data. Your responsibilities will also include building tooling to monitor data pipelines, performing troubleshooting and debugging to identify and resolve data quality and performance issues, and collaborating with data scientists, analysts, and other stakeholders to understand their data requirements and translate them into technical specification. Additionally, you will collaborate with software and data engineers to help build a highly valuable software product and work closely with ML Engineers to deploy, monitor, and maintain ML models in production environments. Your leadership will be instrumental in integrating ML workflows with CI/CD pipelines, ensuring consistent and seamless model versioning, testing, and rollout.

Required Skills & Experience:

  • 5+ years of professional data experience
  • Proficiency in Python
  • Experience Dockerizing containers and working with Kubernetes
  • Experience with Prefect or Airflow
  • Data warehousing experience, preferably with BigQuery, Snowflake or Postgres
  • B.S. in Computer Science or related field
    Desired Skills & Experience:
    • Cloud experience, preferably with GCP
      Applicants must be currently authorized to work in the United States on a full-time basis now and in the future.

      #LI-GF1

  • Lead Engineer Data

    6 days ago


    Chicago, Illinois, United States AbbVie Full time

    Company DescriptionAbbVie's mission is to discover and deliver innovative medicines and solutions that solve serious health issues today and address the medical challenges of tomorrow. We strive to have a remarkable impact on people's lives across several key therapeutic areas immunology, oncology, neuroscience, and eye care and products and services in our...


  • Chicago, Illinois, United States Democratic Data Exchange Full time

    Job descriptionThe Democratic Data Exchange (DDx) is looking for an experienced Technical Lead – MIG to oversee the development of the Movement Infrastructure Working Group's (MIG) new API for real-time sharing of data between the various tools Democratic political campaigns (e.g., Presidential, Senate, Down Ballot) and movement groups use.The MIG API will...

  • Data Engineer

    6 days ago


    Chicago, Illinois, United States United Airlines Full time

    Our Marketing and Loyalty team is the strategic force behind United's industry-leading brand and experience, supporting revenue growth by turning customers into lifelong United flyers. Our marketing communications, market research and brand teams drive travelers' familiarity and engagement with the United brand. Our product, design and service teams bring...


  • Chicago, Illinois, United States S4 Market Data Full time

    Summary:**PLEASE NOTE - This is NOT a technical role for a Data Analyst, Data Scientist or someone with an IT background. Candidates MUST have experience in the Market Data realm and be able to administer Market Data contracts. Please read the description before you apply**The Market Data Administrator at S4 Market Data will oversee the administrative...

  • Data Engineer

    6 days ago


    Chicago, Illinois, United States Baker Tilly US Full time

    OverviewBaker Tilly US, LLP (Baker Tilly) is a leading advisory CPA firm, providing clients with a genuine coast-to-coast and global advantage in major regions of the U.S. and in many of the world's leading financial centers - New York, London, San Francisco, Los Angeles and Chicago. Baker Tilly is an independent member of Baker Tilly International, a...

  • Data Engineer

    6 days ago


    Chicago, Illinois, United States Danaher Full time

    Leica Biosystems' mission of "Advancing Cancer Diagnostics, Improving Lives" is at the heart of our corporate culture. We're a global leader in cancer diagnostics with the most comprehensive portfolio from biopsy to diagnosis. Our easy-to-use and consistently reliable offerings help improve workflow efficiency and diagnostic confidence.Our associates know...


  • Chicago, Illinois, United States Orion Group Full time

    Orion Project Services LLC and Big Pharma is the best combination in Northern Illinois Are you a Data Engineer that specializes Curation? I have the a tremendous opportunity for you right now Accept the challenge and begin your career with a Market Leading Pharmaceutical company if your skills exceed the description below 1 year initial contract (extension...


  • Chicago, Illinois, United States Caterpillar Full time

    Career Area: Business Technologies, Digital and Data Job Description: Your Work Shapes the World at Caterpillar Inc. When you join Caterpillar, you're joining a global team who cares not just about the work we do - but also about each other. We are the makers, problem solvers, and future world builders who are creating stronger, more sustainable...

  • Data Engineer

    6 days ago


    Chicago, Illinois, United States Double Good Full time

    Double Good's mission is to create joy. We create joy with our delectable and award-winning popcorn. We create joy with our easy-to-use fundraising platform that raises a meaningful amount of money for youth sports and activities, empowering kids to pursue their dreams. We create joy through our Kids Foundation which hosts Double Good Days events across the...


  • Chicago, Illinois, United States Homeward Health Full time

    Homeward is a technology-enabled healthcare provider delivering quality, affordable and comprehensive care to those who don't have it. Starting in rural America. Today, 60 million Americans living in rural communities are facing a crisis of access to care. In the U.S. healthcare system, rural Americans experience significantly poorer clinical outcomes. This...

  • Sr. Data Engineer

    6 days ago


    Chicago, Illinois, United States Inspira Financial Full time

    Take the next step in your journey at Inspira Financial. You will help businesses and individuals thrive today, tomorrow, and into retirement. Become part of a company that is people centric and client obsessed in every interaction; a community of forward-thinking individuals focused on driving results to deliver our mission with an unwavering commitment to...


  • Chicago, Illinois, United States AbbVie Full time

    Company DescriptionAbbVie's mission is to discover and deliver innovative medicines and solutions that solve serious health issues today and address the medical challenges of tomorrow. We strive to have a remarkable impact on people's lives across several key therapeutic areas immunology, oncology, neuroscience, and eye care and products and services in our...

  • Data Engineer

    6 days ago


    Chicago, Illinois, United States CapTech Full time

    Company DescriptionCapTech is an award-winning consulting firm that collaborates with clients to achieve what's possible through the power of technology. At CapTech, we're passionate about the work we do and the results we achieve for our clients. From the outset, our founders shared a collective passion to create a consultancy centered on strong...


  • Chicago, Illinois, United States Center for Research in Security Prices (CRSP) Full time

    About UsCRSP is a leader in providing research-quality data to scholars and investors, advancing the body of knowledge in finance, economics, and related disciplines for over 60 years. Nearly 500 leading academic institutions in 35 countries around the world rely on CRSP data for quality and timely academic securities research.Current projects include...


  • Chicago, Illinois, United States Center for Research in Security Prices (CRSP) Full time

    All applicants must currently be living in Illinois. No relocation. About UsCRSP is a leader in providing research-quality data to scholars and investors, advancing the body of knowledge in finance, economics, and related disciplines for over 60 years. Nearly 500 leading academic institutions in 35 countries around the world rely on CRSP data for quality and...


  • Chicago, Illinois, United States AbbVie Full time

    Company DescriptionAbbVie's mission is to discover and deliver innovative medicines and solutions that solve serious health issues today and address the medical challenges of tomorrow. We strive to have a remarkable impact on people's lives across several key therapeutic areas – immunology, oncology, neuroscience, and eye care – and products and services...

  • Data Quality Lead

    1 month ago


    Chicago, Illinois, United States IMC Trading Full time

    As lead of our Data Quality Team, you will play a pivotal role in shaping the future of our systematic trading operations. This role offers an excellent opportunity for an ambitious and entrepreneurial mind that wants to build and grow a team that operates at the core of our trading operations. You will have the ability to play an active part in defining the...


  • Chicago, Illinois, United States Intelligent Medical Objects Full time

    At IMO, a core team of clinicians, software developers, and data scientists combine computer science and medical expertise to help patients and healthcare professionals access high quality health information quickly and easily to improve total patient health. We are currently in need of a Data Engineer to join this team The hire will be responsible for...


  • Chicago, Illinois, United States Kin Insurance Full time

    Kin is on a mission to change home insurance from what it is to what it should be. Whether we're leveraging data to create customizable coverage or providing claims service that goes above and beyond expectations, our members are at the heart of everything we do. In the face of ever-growing climate risk, they deserve an insurance company that cares about...


  • Chicago, Illinois, United States Grainger Full time

    About Grainger:Grainger is a leading broad line distributor with operations primarily in North America, Japan and the United Kingdom. We achieve our purpose, We Keep the World Working, by serving more than 4.5 million customers with a wide range of products that keep their operations running and their people safe. Grainger also delivers services and...