We have other current jobs related to this field that you can find below

  • Snowflake Data Engineer

    4 weeks ago

    Jersey City, United States Data Piper Full time

    Job Description Job Description: Please note : We cannot sponsor visa and C2C Design develop test deploy and maintain enterprise level applications using the Snowflake platform Work with a variety of stakeholders to understand requirements and deliver solutions Take ownership of a project and see it through to completion Experience with the Snowflake...

  • Snowflake Data Engineer

    4 weeks ago

    Jersey City, New Jersey, United States Data Piper Full time

    Job DescriptionJob Description: Please note : We cannot sponsor visa and C2CDesign develop test deploy and maintain enterprise level applications using the Snowflake platformWork with a variety of stakeholders to understand requirements and deliver solutionsTake ownership of a project and see it through to completionExperience with the Snowflake...

  • Data Engineer

    2 days ago

    Kansas City, Missouri, United States EquipmentShare Full time

    Unlock the Power of Data with EquipmentShareWe are seeking a talented Data Engineer to join our team at EquipmentShare, a leading innovator in the construction industry. As a Data Engineer, you will play a crucial role in driving business growth and decision-making through data-driven insights.About the RoleThe ideal candidate will have a strong background...

  • Data Engineer

    3 months ago

    Kansas City, United States HART, INC. Full time

    Job DescriptionJob DescriptionDescription:Company Overview:We are a leading healthcare technology company dedicated to transforming the way healthcare organizations leverage data to improve patient care and operational efficiency. As a Healthcare Data Engineer, you will play a vital role in developing and executing data transformation activities, enabling...

  • Data Engineer

    4 days ago

    Kansas City, United States C2FO Full time

    ** Data Engineer - Warehouse** **Job Category****:** Engineering **Requisition Number****:** DATAE001513 Showing 1 location **Job Details** **Description** Data is the lifeblood of any technology company. At C2FO, we know the best way to ensure our success is to provide our decision-makers with the most accurate, most relevant data possible. Our Data...

  • Sr. Data Engineer

    4 days ago

    Kansas City, United States UMB Financial Corporation Full time

    UMB Bank NA seeks three Sr. Data Engineers for Kansas City, MO, with option to telecommute or work from anywhere within US. The Enterprise Data Warehouse & Analyticsteam provides support of our data warehouse environment and analytics tools. This allows our business leaders access to business intelligence data in order to develop strategies for our...

  • Sr. Data Engineer

    4 days ago

    Kansas City, United States TEKsystems Full time

    Description: TEKsystems' Client is seeking a strong and experienced Senior Data Engineer. As a Senior Data Engineer, you will be responsible for developing and maintaining data pipelines across multiple platforms and managing a data warehouse to support business intelligence and business operations. This role will also assist with defining and implementing...

  • Fiber Engineer

    1 month ago

    Kansas City, United States Client Full time

    Field Fiber Engineer (Data Center / Telecoms / Fiber) $75'000 + Car allowance + Overtime Time & Half + 401(k) + Healthcare + Fuel card Kansas City - Field basedAre you a field engineer from the data center and telecom industry and looking to join a high growth and stable telecom organization offering steady and secure long term career prospects?Here is a...

  • Project Civil Engineer

    4 weeks ago

    Kansas City, United States Olsson Full time

    We are Olsson, a team-based, purpose-driven engineering and design firm. Our solutions improve communities and our people make it possible. Our most meaningful asset is our people, and we are dedicated to providing an environment where they can continue to learn, grow, and thrive. Our entrepreneurial spirit is what has allowed us — and will continue to...

  • Project Civil Engineer

    2 months ago

    Kansas City, United States Olsson Full time

    Company Description We are Olsson, a team-based, purpose-driven engineering and design firm. Our solutions improve communities and our people make it possible. Our most meaningful asset is our people, and we are dedicated to providing an environment where they can continue to learn, grow, and thrive. Our entrepreneurial spirit is what has allowed us...

  • Project Mechanical Engineer

    1 month ago

    Kansas City, United States Olsson Full time

    Project Mechanical Engineer - Data Center Full-time We are Olsson, a team-based, purpose-driven engineering and design firm. Our solutions improve communities and our people make it possible. Our most meaningful asset is our people, and we are dedicated to providing an environment where they can continue to learn, grow, and thrive. Our entrepreneurial spirit...

  • Staff Piping Engineer

    2 months ago

    Salt Lake City, United States CHEMICAL & INDUSTRIAL ENGINEER Full time

    Job DescriptionJob DescriptionDescription:C&I is looking for a talented and driven individual to join our team!About the opportunity: Staff Piping EngineerWe are currently seeking a Staff Piping Engineer to help us achieve our company mission. The Plant Design team is responsible for preparing studies, sketches, drawings and models of equipment arrangements...

  • Senior Mechanical Engineer

    3 months ago

    Kansas City, United States Olsson Full time

    Job DescriptionJob DescriptionCompany DescriptionWe are Olsson, a team-based, purpose-driven engineering and design firm. Our solutions improve communities and our people make it possible.Our most meaningful asset is our people, and we are dedicated to providing an environment where they can continue to learn, grow, and thrive. Our entrepreneurial spirit is...

  • Data Engineer

    2 weeks ago

    Jersey City, United States Glocomms Full time

    The Role: Staff Data Engineer We love our customers, and we love data that tells their story. And while we’re happy to say that we have a lot of both, we need help bringing it together, managing it, and making it useful -- to us and to our customers. This is where you come in: we’re building our business on this foundation of data, and you’ll make sure...

  • Data Engineer

    2 weeks ago

    Jersey City, United States Glocomms Full time

    The Role: Staff Data Engineer We love our customers, and we love data that tells their story. And while we’re happy to say that we have a lot of both, we need help bringing it together, managing it, and making it useful -- to us and to our customers. This is where you come in: we’re building our business on this foundation of data, and you’ll make sure...

  • Data Engineer

    3 weeks ago

    Jersey City, United States Princeton IT Services Full time

    Job DescriptionJob DescriptionJob Title: Data Engineer / Data ArchitectLocation: Jersey city,NJExperience: 10+ Years Expert levelJob Type: Full-Time contract (W2 preferred)Job Summary: We are seeking an experienced Data Engineer/ Architect with expertise in Python, PySpark, and Databricks to join our dynamic team. You will be responsible for designing,...

  • Data Engineer

    4 weeks ago

    Oklahoma City, United States Meta Full time

    Summary: At Meta, we have many opportunities to work with data each and every day. In this role as a Data Engineer on the Meta Data Center’s Data Science team, your primary responsibility will be to partner with key stakeholders, data scientists and software engineers to support and enable the continued growth critical to Meta's Data Center...

  • Data Engineer

    3 weeks ago

    Culver City, United States Robert Half Full time

    Please reach out to Valerie Nielsen on LinkedIn and email directly for immediate response! Don't want you to get lost and the sea of applicants!The Role: Data EngineerLocation: Culver City (hybrid)Salary: 110-120k baseData EngineerExciting opportunity to work with our client in the Ad Tech space that is growing rapidly! Looking to bring on 2 Data Engineers!...

  • Data Engineer

    3 weeks ago

    Culver City, United States Robert Half Full time

    Please reach out to Valerie Nielsen on LinkedIn and email directly for immediate response! Don't want you to get lost and the sea of applicants!The Role: Data EngineerLocation: Culver City (hybrid)Salary: 110-120k baseData EngineerExciting opportunity to work with our client in the Ad Tech space that is growing rapidly! Looking to bring on 2 Data Engineers!...

  • Data Engineer

    4 weeks ago

    Jersey City, United States Norgate Technology Full time

    Long Term W2 Contract Position in Jersey City, NJ. Hybrid Position. Financial Experience Required. 5+ years in similar rolesHigher education in IT field or relevant previous work experienceProficient in data engineering practices and using design and architectural patterns4+ years' experience as a Data Engineer or in a similar role, in Extract, Transform,...

Data Engineer

2 months ago

Kansas City, United States Catalytic Data Science Full time

Data Engineer III (Large Language Models)

About Catalytic Data Science (CDS):

Catalytic Data Science is a groundbreaking cloud R&D platform designed to integrate volumes of scientific resources, data, and analytic tools while providing the ability to network with colleagues in one secure and scalable environment.

By enabling R&D teams to work more collaboratively and improving productivity company-wide, the Catalytic platform helps teams achieve key R&D milestones faster and with greater accuracy.

Our customers are passionate about making the world a better place, and we are inspired by the opportunity to help them.

The Role

You are a Data Engineer with experience in processing terabytes of data and working with large language models (LLMs). You have experience in creating and automating scalable, fault-tolerant, and reproducible data pipelines for natural language processing (NLP) using Amazon AWS technologies. You will design and implement data ingestion, processing, and storage solutions that can handle massive amounts of text data from various sources. You are interested in helping to create a platform completely built on top of AWS. You are eager to join a team of Life Scientists and Software Engineers that believe the brightest minds in research should have the best tools to drive innovation.

What You’ll Do

Build, test, and operate automated

Extract, Transform, and Load (

ETL) pipelines that process terabytes of text data nightly

Develop service frontends around our various backend data stores (AWS Aurora, MySQL, Elasticsearch, S3)

Rapidly protype, test, and deploy data pipelines for LLMs using AWS.

Collaborate with data scientists and NLP engineers to understand the data requirements and specifications for LLMs and related tasks such as text summarization, translation, and question answering.

Optimize the performance, reliability, and scalability of the data pipelines and LLMs by applying best practices and techniques such as data partitioning, caching, compression, and monitoring.

Ensure the quality, integrity, and security of the data by implementing data validation, cleaning, and governance policies and procedures.

Research and evaluate new technologies and methods for data engineering and LLMs and stay updated with the latest trends and developments in the field.

Participate in data architecture and engineering decisions, bringing your strong experience and knowledge to bear.

Qualifications

Bachelor's degree or higher in computer science, engineering, or a related field.

3+ years of experience in data engineering, preferably with large-scale text data and LLMs and 6+ years of any software engineering experience (including data engineering).

Proficient in Python 3 or Java, preferably both.

Experience with data modeling, ETL, and data warehouse design and implementation.

Expertise with ETL schedulers such as Airflow, Prefect or similar frameworks.

Familiar with LLMs and NLP concepts and frameworks such as Transformers, BERT, GPT, PaLM, and LLaMA.

Day-to-day experience using AWS technologies such as Lambda, ECS Fargate, SQS, & SNS

Experience extracting, processing, storing, and querying of petabyte-scale datasets

Familiarity with building and using containers

Familiarity with event-based microservices

Strong communication, collaboration, and problem-solving skills.

Core Skills:

ETL Processes

Data Modeling and Database Design

Proficiency in Large Language Models

Data Pipeline Optimization

Cross-functional Collaboration

Problem-solving and Analytical Skills

Nice-to-Haves

Prior experience with Elasticsearch (custom development and/or administration) is a huge plus

Knowledge of Graph databases

What Do We Love in Team Members?

Your specialization is less important than your ability to learn fast and adapt to shifting technologies. We’re especially fond of people who:

Focus on customer’s needs and our company’s goals, not just writing code

Iterate until customers love what you’ve built

Self-start and initiate

Self-organize

Strive to grow personally and professionally, beyond just expanding technical abilities

Love to experiment with new technology and share knowledge with the team

In compliance with federal law, all persons hired will be required to verify identity and eligibility to work in the United States and to complete the required employment eligibility verification document form upon hire.

#J-18808-Ljbffr