Data Engineer
19 hours ago
- Data& Pipeline Development:
- Design, develop, and maintain robust and scalable ETL (Extract, Transform, Load) processes.
- Ensure data is collected, processed, and stored efficiently and accurately.
- Data& Integration:
- Integrate data from various sources, including databases, APIs, and third-party data providers.
- Ensure data consistency and integrity across different systems.
- RAG Type LLM Workflows:
- Develop and maintain data pipelines specifically tailored for Retrieval-Augmented Generation (RAG) type Large Language Model (LLM) workflows.
- Ensure efficient data retrieval and augmentation processes to support LLM training and inference.
- Collaborate with data scientists to optimize data pipelines for LLM performance and accuracy.
- Semantic/Ontology& Data& Layers:
- Develop and maintain semantic and ontology data layers to enhance data integration and retrieval.
- Ensure data is semantically enriched to support advanced analytics and machine learning models.
- Collaboration:
- Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
- Provide technical support and guidance on data-related issues.
- Data& Quality and Governance:
- Implement data quality checks and validation processes to ensure data accuracy and reliability.
- Adhere to data governance policies and best practices.
- Performance Optimization:
- Monitor and optimize the performance of data pipelines and infrastructure.
- Troubleshoot and resolve data-related issues in a timely manner.
- Support for Analysis:
- Support short-term ad-hoc analysis by providing quick and reliable data access.
- Contribute to longer-term goals by developing scalable and maintainable data solutions.
- Documentation:
- Maintain comprehensive documentation of data pipelines, processes, and infrastructure.
- Ensure knowledge transfer and continuity within the team.
- Education and Experience:
- Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
- 3+ years of experience in data engineering or a related role.
- Technical Skills:
- Proficiency in Python (mandatory).
- Experience with other programming languages such as Java or Scala is a plus.
- Experience with SQL and NoSQL databases (e.g., MySQL, PostgreSQL, MongoDB).
- Familiarity with big data technologies (e.g., Hadoop, Spark, Kafka).
- Experience with cloud platforms (e.g., AWS, Azure, Google Cloud) and their data services.
- RAG Type LLM Skills:
- Experience with data pipelines for LLM workflows, including data retrieval and augmentation.
- Familiarity with natural language processing (NLP) techniques and tools.
- Understanding of LLM architectures and their data requirements.
- Semantic/Ontology& Data& Layers:
- Familiarity with semantic and ontology data layers and their application in data integration and retrieval.
- Tools and Frameworks:
- Experience with ETL tools and frameworks (e.g., Apache NiFi, Airflow, Talend).
- Familiarity with data visualization tools (e.g., Tableau, Power BI) is a plus.
- Soft Skills:
- Strong analytical and problem-solving skills.
- Excellent communication and collaboration abilities.
- Ability to work in a fast-paced, dynamic environment.
- Experience with machine learning and data science workflows.
- Knowledge of data governance and compliance standards.
- Certification in cloud platforms or data engineering.
-
Data Engineer | Data Engineer
3 weeks ago
cincinnati, United States Data Engineer Full time• 6+ years of software product development and delivery experience.• 5+ years of ETL testing/SQL experience.• 3+ years of Informatica Power Center, IDQ, IICS/IDMC experience.• 3+ years’ experience overseeing the development of data test plans, test scenarios, test cases, execution of test case and documentation of test results• 2+ years of...
-
Data Engineer
3 weeks ago
Cincinnati, United States Data Engineer Full time• 6+ years of software product development and delivery experience.• 5+ years of ETL testing/SQL experience.• 3+ years of Informatica Power Center, IDQ, IICS/IDMC experience.• 3+ years’ experience overseeing the development of data test plans, test scenarios, test cases, execution of test case and documentation of test results• 2+ years of...
-
Data Engineer:
1 month ago
Cincinnati, United States Saxon Global Full timeData Engineer: Must be in Cincinnati OH from day 1. Expectation is 2-3x/week in office and remote the other 2 days. Location: Cincy OH (they're going to convert this person and will be hybrid in office) C2C: $70/HR. Visa: USC or GC Perm - must be able to convert after 6 months Adv Data Engineer: Databricks, Azure, GCP. Streaming Interfaces: Kafka, Azure...
-
Data Engineer
4 weeks ago
Cincinnati, United States Apex Systems Full timeJob#: 2055521 Job Description: Apex Systems is looking for a Data Engineer for one of our large clients in Cincinnati, OH. Job Title: Data Engineer Role Overview: We are looking for a Data Engineer with a focus on processing unstructured data to enhance our enterprise data governance framework. You will design and implement scalable workflows that...
-
Data Engineer
4 days ago
Cincinnati, United States Encore Talent Solutions Full timeEncore Talent has partnered with a local client in staffing Entry Level Data Engineers.These roles are contract roles with the right-to-hire joining our clients cadet program in their training environment. This program is a one year training program with our Entry Level Engineers working with other recent hires.JOB DESCRIPTIONHandle the design and...
-
Data Engineer
2 months ago
Cincinnati, United States Encore Talent Solutions Full timeEncore Talent has partnered with a local client in staffing Entry Level Data Engineers.These roles are contract roles with the right-to-hire joining our clients cadet program in their training environment. This program is a one year training program with our Entry Level Engineers working with other recent hires.JOB DESCRIPTIONHandle the design and...
-
Data Engineer
21 hours ago
Cincinnati, United States ComResource Full timeJob DescriptionJob DescriptionComResource is looking for a Data Engineer.ComResource is seeking a Data Engineer to manage and optimize data pipelines and processes, with a focus on DBT Cloud and DBT Core. This role involves troubleshooting, optimizing, and maintaining shared DBT packages while supporting application teams in deploying new models and handling...
-
Data Engineer
1 month ago
Cincinnati, United States PeopleCaddie Full timeJob Description: DATA ENGINEER | $55-$65/HR | DURATION: 6+ MONTHS | REMOTE! Our client, a developer-led custom software development consulting firm, is seeking an experienced data engineer to work on high value projects across diverse industries. This is an excellent opportunity for an experienced data engineer to contribute to the overall team goals and...
-
Data Engineer
21 hours ago
Cincinnati, United States eTek IT Services, Inc. Full timeJob DescriptionJob DescriptionRole : Data EngineerLocation : Cincinnati& ,OHW2 Contract JD : Required SkillsWord, Databricks, PySpark, Python, SQL, AzureAdditional SkillsJob DescriptionIn serving data back, make accessible to analysts and PowerBI reporting. Can build dashboards on top of this area.Real time and batch data – large volume will be batch....
-
Cincinnati, Ohio, United States eTek IT Services, Inc. Full timeJob DescriptionWe are seeking a skilled Data Engineer with strong expertise in mortgage banking to join our IT team. As a key member of our data engineering team, you will be responsible for designing, constructing, and maintaining highly scalable data management systems that support data analysis and decision-making processes.Key Responsibilities:Design and...
-
Data Engineer
1 month ago
Cincinnati, United States JobRialto Full timeJob Summary: We are seeking a highly skilled Data Engineer specializing in unstructured data processing to enhance our enterprise data governance framework. This role involves designing and implementing scalable workflows to transform unstructured data into valuable assets while integrating their metadata into cataloging systems like Informatica CDGC. The...
-
Data Engineer
3 weeks ago
Cincinnati, Ohio, United States Apex Systems Full timeJob Title: Data Engineer - Unstructured Data ExpertApex Systems is seeking a seasoned Data Engineer to join our team in Cincinnati, OH. This role involves designing and implementing scalable data workflows that transform unstructured data into valuable assets for our enterprise clients.We are looking for a highly skilled professional with expertise in...
-
Data Engineer
3 weeks ago
Cincinnati, United States w3r Consulting Full timeJob Title: Data Engineer GENERAL FUNCTION: The data engineer designs and builds platforms, tools, and solutions that help the bank manage, secure, and generate value from its data. The person in this role creates scalable and reusable solutions for gathering, collecting, storing, processing, and serving data on both small and very large (i.e. Big Data)...
-
Data Engineer with Datastage
20 hours ago
Cincinnati, United States eTek IT Services, Inc. Full timeJob DescriptionJob DescriptionRole : Data EngineerLocation : Cincinnati , OhioExperience : 5+yearsW2 ContractJob DescriptionJob Overview:We are seeking a skilled Data Engineer with a strong background in mortgage banking to join our IT team. The candidate will be instrumental in constructing, testing, and maintaining our mortgage banking data...
-
Data Engineer Lead
2 weeks ago
Cincinnati, Ohio, United States Insight Global Full timeJob Title: Data Engineer LeadLocation: Cincinnati, OhioSalary: $120,000 - $180,000 per yearThis is a long-term contract opportunity for an experienced Data Engineer to join our team in Cincinnati, Ohio. As a Data Engineer Lead, you will be responsible for designing and constructing scalable data management systems that meet the company's...
-
AWS Data engineer
21 hours ago
Cincinnati, United States Indus River Technologies Inc Full timeJob DescriptionJob DescriptionData engineer: (Banking experience necessary and heavy)C2H Remote 4 openings 2 slots 12 months*Experience with standing up a data/analytics platform in AWS.**AWS data engineer experience**Ability to govern data models**Celebrus experience would be a huge plus*Job Posting Description:REMOTE Role and Responsibilities The Data...
-
Data Engineer Specialist
3 weeks ago
Cincinnati, Ohio, United States Saxon Global Full timeJob Title: Data Engineer SpecialistSaxon Global is seeking an experienced Data Engineer Specialist to join our team. As a Data Engineer Specialist, you will play a crucial role in designing, building, and maintaining large-scale data systems.Responsibilities:Design and implement data pipelines using Azure Data FactoryDevelop and maintain data warehouses...
-
Data Systems Engineer
1 month ago
Cincinnati, Ohio, United States Saxon Global Full timeJob Description:At Saxon Global, we are seeking a talented Data Systems Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing and developing Azure solutions, implementing automated unit and integration testing, and collaborating with architecture and lead engineers to ensure consistent development...
-
Senior Data Engineer
1 week ago
Cincinnati, United States Flexton Inc. Full timeAs an Advanced Data Engineer, you will have the opportunity to lead the development of innovative data solutions, enabling the effective use of data across the organization. You will be responsible for designing, building, and maintaining robust data pipelines and platforms to meet business objectives, focusing on data as a strategic asset. Your role will...
-
Senior Data Engineer
7 days ago
Cincinnati, United States Flexton Inc. Full timeAs an Advanced Data Engineer, you will have the opportunity to lead the development of innovative data solutions, enabling the effective use of data across the organization. You will be responsible for designing, building, and maintaining robust data pipelines and platforms to meet business objectives, focusing on data as a strategic asset. Your role will...