We have other current jobs related to this field that you can find below
-
Snowflake Data Engineer
4 weeks ago
Jersey City, United States Data Piper Full timeJob Description Job Description: Please note : We cannot sponsor visa and C2C Design develop test deploy and maintain enterprise level applications using the Snowflake platform Work with a variety of stakeholders to understand requirements and deliver solutions Take ownership of a project and see it through to completion Experience with the Snowflake...
-
Snowflake Data Engineer
4 weeks ago
Jersey City, New Jersey, United States Data Piper Full timeJob DescriptionJob Description: Please note : We cannot sponsor visa and C2CDesign develop test deploy and maintain enterprise level applications using the Snowflake platformWork with a variety of stakeholders to understand requirements and deliver solutionsTake ownership of a project and see it through to completionExperience with the Snowflake...
-
Data Engineer
2 days ago
Kansas City, Missouri, United States EquipmentShare Full timeUnlock the Power of Data with EquipmentShareWe are seeking a talented Data Engineer to join our team at EquipmentShare, a leading innovator in the construction industry. As a Data Engineer, you will play a crucial role in driving business growth and decision-making through data-driven insights.About the RoleThe ideal candidate will have a strong background...
-
Data Engineer
3 months ago
Kansas City, United States HART, INC. Full timeJob DescriptionJob DescriptionDescription:Company Overview:We are a leading healthcare technology company dedicated to transforming the way healthcare organizations leverage data to improve patient care and operational efficiency. As a Healthcare Data Engineer, you will play a vital role in developing and executing data transformation activities, enabling...
-
Data Engineer
4 days ago
Kansas City, United States C2FO Full time** Data Engineer - Warehouse** **Job Category****:** Engineering **Requisition Number****:** DATAE001513 Showing 1 location **Job Details** **Description** Data is the lifeblood of any technology company. At C2FO, we know the best way to ensure our success is to provide our decision-makers with the most accurate, most relevant data possible. Our Data...
-
Sr. Data Engineer
4 days ago
Kansas City, United States UMB Financial Corporation Full timeUMB Bank NA seeks three Sr. Data Engineers for Kansas City, MO, with option to telecommute or work from anywhere within US. The Enterprise Data Warehouse & Analyticsteam provides support of our data warehouse environment and analytics tools. This allows our business leaders access to business intelligence data in order to develop strategies for our...
-
Sr. Data Engineer
4 days ago
Kansas City, United States TEKsystems Full timeDescription: TEKsystems' Client is seeking a strong and experienced Senior Data Engineer. As a Senior Data Engineer, you will be responsible for developing and maintaining data pipelines across multiple platforms and managing a data warehouse to support business intelligence and business operations. This role will also assist with defining and implementing...
-
Fiber Engineer
1 month ago
Kansas City, United States Client Full timeField Fiber Engineer (Data Center / Telecoms / Fiber) $75'000 + Car allowance + Overtime Time & Half + 401(k) + Healthcare + Fuel card Kansas City - Field basedAre you a field engineer from the data center and telecom industry and looking to join a high growth and stable telecom organization offering steady and secure long term career prospects?Here is a...
-
Project Civil Engineer
4 weeks ago
Kansas City, United States Olsson Full timeWe are Olsson, a team-based, purpose-driven engineering and design firm. Our solutions improve communities and our people make it possible. Our most meaningful asset is our people, and we are dedicated to providing an environment where they can continue to learn, grow, and thrive. Our entrepreneurial spirit is what has allowed us — and will continue to...
-
Project Civil Engineer
2 months ago
Kansas City, United States Olsson Full timeCompany Description We are Olsson, a team-based, purpose-driven engineering and design firm. Our solutions improve communities and our people make it possible. Our most meaningful asset is our people, and we are dedicated to providing an environment where they can continue to learn, grow, and thrive. Our entrepreneurial spirit is what has allowed us...
-
Project Mechanical Engineer
1 month ago
Kansas City, United States Olsson Full timeProject Mechanical Engineer - Data Center Full-time We are Olsson, a team-based, purpose-driven engineering and design firm. Our solutions improve communities and our people make it possible. Our most meaningful asset is our people, and we are dedicated to providing an environment where they can continue to learn, grow, and thrive. Our entrepreneurial spirit...
-
Staff Piping Engineer
2 months ago
Salt Lake City, United States CHEMICAL & INDUSTRIAL ENGINEER Full timeJob DescriptionJob DescriptionDescription:C&I is looking for a talented and driven individual to join our team!About the opportunity: Staff Piping EngineerWe are currently seeking a Staff Piping Engineer to help us achieve our company mission. The Plant Design team is responsible for preparing studies, sketches, drawings and models of equipment arrangements...
-
Senior Mechanical Engineer
3 months ago
Kansas City, United States Olsson Full timeJob DescriptionJob DescriptionCompany DescriptionWe are Olsson, a team-based, purpose-driven engineering and design firm. Our solutions improve communities and our people make it possible.Our most meaningful asset is our people, and we are dedicated to providing an environment where they can continue to learn, grow, and thrive. Our entrepreneurial spirit is...
-
Data Engineer
2 weeks ago
Jersey City, United States Glocomms Full timeThe Role: Staff Data Engineer We love our customers, and we love data that tells their story. And while we’re happy to say that we have a lot of both, we need help bringing it together, managing it, and making it useful -- to us and to our customers. This is where you come in: we’re building our business on this foundation of data, and you’ll make sure...
-
Data Engineer
2 weeks ago
Jersey City, United States Glocomms Full timeThe Role: Staff Data Engineer We love our customers, and we love data that tells their story. And while we’re happy to say that we have a lot of both, we need help bringing it together, managing it, and making it useful -- to us and to our customers. This is where you come in: we’re building our business on this foundation of data, and you’ll make sure...
-
Data Engineer
3 weeks ago
Jersey City, United States Princeton IT Services Full timeJob DescriptionJob DescriptionJob Title: Data Engineer / Data ArchitectLocation: Jersey city,NJExperience: 10+ Years Expert levelJob Type: Full-Time contract (W2 preferred)Job Summary: We are seeking an experienced Data Engineer/ Architect with expertise in Python, PySpark, and Databricks to join our dynamic team. You will be responsible for designing,...
-
Data Engineer
4 weeks ago
Oklahoma City, United States Meta Full timeSummary: At Meta, we have many opportunities to work with data each and every day. In this role as a Data Engineer on the Meta Data Center’s Data Science team, your primary responsibility will be to partner with key stakeholders, data scientists and software engineers to support and enable the continued growth critical to Meta's Data Center...
-
Data Engineer
3 weeks ago
Culver City, United States Robert Half Full timePlease reach out to Valerie Nielsen on LinkedIn and email directly for immediate response! Don't want you to get lost and the sea of applicants!The Role: Data EngineerLocation: Culver City (hybrid)Salary: 110-120k baseData EngineerExciting opportunity to work with our client in the Ad Tech space that is growing rapidly! Looking to bring on 2 Data Engineers!...
-
Data Engineer
3 weeks ago
Culver City, United States Robert Half Full timePlease reach out to Valerie Nielsen on LinkedIn and email directly for immediate response! Don't want you to get lost and the sea of applicants!The Role: Data EngineerLocation: Culver City (hybrid)Salary: 110-120k baseData EngineerExciting opportunity to work with our client in the Ad Tech space that is growing rapidly! Looking to bring on 2 Data Engineers!...
-
Data Engineer
4 weeks ago
Jersey City, United States Norgate Technology Full timeLong Term W2 Contract Position in Jersey City, NJ. Hybrid Position. Financial Experience Required. 5+ years in similar rolesHigher education in IT field or relevant previous work experienceProficient in data engineering practices and using design and architectural patterns4+ years' experience as a Data Engineer or in a similar role, in Extract, Transform,...
![Catalytic Data Science](https://media.trabajo.org/img/noimg.jpg)
Data Engineer
2 months ago
Data Engineer III (Large Language Models)
About Catalytic Data Science (CDS):
Catalytic Data Science is a groundbreaking cloud R&D platform designed to integrate volumes of scientific resources, data, and analytic tools while providing the ability to network with colleagues in one secure and scalable environment.
By enabling R&D teams to work more collaboratively and improving productivity company-wide, the Catalytic platform helps teams achieve key R&D milestones faster and with greater accuracy.
Our customers are passionate about making the world a better place, and we are inspired by the opportunity to help them.
The Role
You are a Data Engineer with experience in processing terabytes of data and working with large language models (LLMs). You have experience in creating and automating scalable, fault-tolerant, and reproducible data pipelines for natural language processing (NLP) using Amazon AWS technologies. You will design and implement data ingestion, processing, and storage solutions that can handle massive amounts of text data from various sources. You are interested in helping to create a platform completely built on top of AWS. You are eager to join a team of Life Scientists and Software Engineers that believe the brightest minds in research should have the best tools to drive innovation.
What You’ll Do
Build, test, and operate automated
Extract, Transform, and Load (
ETL) pipelines that process terabytes of text data nightly
Develop service frontends around our various backend data stores (AWS Aurora, MySQL, Elasticsearch, S3)
Rapidly protype, test, and deploy data pipelines for LLMs using AWS.
Collaborate with data scientists and NLP engineers to understand the data requirements and specifications for LLMs and related tasks such as text summarization, translation, and question answering.
Optimize the performance, reliability, and scalability of the data pipelines and LLMs by applying best practices and techniques such as data partitioning, caching, compression, and monitoring.
Ensure the quality, integrity, and security of the data by implementing data validation, cleaning, and governance policies and procedures.
Research and evaluate new technologies and methods for data engineering and LLMs and stay updated with the latest trends and developments in the field.
Participate in data architecture and engineering decisions, bringing your strong experience and knowledge to bear.
Qualifications
Bachelor's degree or higher in computer science, engineering, or a related field.
3+ years of experience in data engineering, preferably with large-scale text data and LLMs and 6+ years of any software engineering experience (including data engineering).
Proficient in Python 3 or Java, preferably both.
Experience with data modeling, ETL, and data warehouse design and implementation.
Expertise with ETL schedulers such as Airflow, Prefect or similar frameworks.
Familiar with LLMs and NLP concepts and frameworks such as Transformers, BERT, GPT, PaLM, and LLaMA.
Day-to-day experience using AWS technologies such as Lambda, ECS Fargate, SQS, & SNS
Experience extracting, processing, storing, and querying of petabyte-scale datasets
Familiarity with building and using containers
Familiarity with event-based microservices
Strong communication, collaboration, and problem-solving skills.
Core Skills:
ETL Processes
Data Modeling and Database Design
Proficiency in Large Language Models
Data Pipeline Optimization
Cross-functional Collaboration
Problem-solving and Analytical Skills
Nice-to-Haves
Prior experience with Elasticsearch (custom development and/or administration) is a huge plus
Knowledge of Graph databases
What Do We Love in Team Members?
Your specialization is less important than your ability to learn fast and adapt to shifting technologies. We’re especially fond of people who:
Focus on customer’s needs and our company’s goals, not just writing code
Iterate until customers love what you’ve built
Self-start and initiate
Self-organize
Strive to grow personally and professionally, beyond just expanding technical abilities
Love to experiment with new technology and share knowledge with the team
In compliance with federal law, all persons hired will be required to verify identity and eligibility to work in the United States and to complete the required employment eligibility verification document form upon hire.
#J-18808-Ljbffr