Data Engineer

4 weeks ago

Providence, United States Omni Inclusive Full time
Mandatory Skills - Gen AI, Data Engineering, ETL Jobs, Snowflake, Azure Cloud

Data Engineer - Essential Job Functions:
Design, develop, and maintain scalable data pipelines for ingesting, processing, and transforming large volumes of structured and unstructured data.
Implement efficient data processing workflows to support the training and evaluation of solutions using large language models, ensuring reliability, scalability, and performance.
Addressing issues related to data quality, pipeline failures, or resource contention, ensuring minimal disruption to systems.
Integrate Large Language Model into data pipeline for natural language processing tasks.
Working with Snowflake ecosystem
Deploying, scaling, and monitoring AI solutions on cloud platforms like Snowflake, Azure, AWS, GCP
Communicating technical and non-technical stakeholders and collaborate with cross-functional teams.
Cloud cost management and best practices to optimize cloud resource usage and minimize costs.

Data Engineer - Preferred Qualifications:
  • Experience working within the Azure ecosystem, including Azure AI Search, Azure Storage Blob, Azure Postgres and understanding how to leverage them for data processing, storage, and analytics tasks.
  • Experience with techniques such as data normalization, feature engineering, and data augmentation.
  • Ability to preprocess and clean large datasets efficiently using Azure Tools /Python and other data manipulation tools.
  • Expertise in working with healthcare data standards (ex. HIP nd FHIR), sensitive data and data masking techniques to mask personally identifiable information (PII) and protected health information (PHI) is essential.
  • In-depth knowledge of search algorithms, indexing techniques, and retrieval models for effective information retrieval tasks. Familiarity with search platforms like Elasticsearch or Azure AI Search is a must.
  • Familiarity with chunking techniques and working with vectors and vector databases like Pinecone.
  • Experience working within the snowflake ecosystem.
  • Ability to design, develop, and maintain scalable data pipelines for ingesting, processing, and transforming large volumes of structured and unstructured data.
  • Experience with implementing best practices for data storage, retrieval, and access control to ensure data integrity, security, and compliance with regulatory requirements.
  • Be able to implement efficient data processing workflows to support the training and evaluation of solutions using large language models, ensuring reliability, scalability, and performance.
  • Ability to proactively identify and address issues related to data quality, pipeline failures, or resource contention, ensuring minimal disruption to systems.
  • Experience with large language model frameworks, such as Langchain and know how to integrate them into data pipelines for natural language processing tasks

  • Data Engineer

    3 weeks ago

    Providence, United States Omni Inclusive Full time

    Mandatory Skills - Gen AI, Data Engineering, ETL Jobs, Snowflake, Azure Cloud Data Engineer - Essential Job Functions: Design, develop, and maintain scalable data pipelines for ingesting, processing, and transforming large volumes of structured and unstructured data. Implement efficient data processing workflows to support the training and evaluation of...

  • Data Engineer

    3 days ago

    Providence, United States Omni Inclusive Full time

    Experience working within the Azure ecosystem, including Azure AI Search, Azure Storage Blob, Azure Postgres and understanding how to leverage them for data processing, storage, and analytics tasks. Ability to preprocess and clean large datasets efficiently using Azure Tools /Python and other data manipulation tools. Experience with techniques such as data...

  • Azure Data Engineer

    2 months ago

    Providence, United States Diverse Lynx Full time

    Role: Azure Data Engineer Location: Providence, RI (Remote) Contract Keyskills: (ADF, Databricks, Synapse) 8+ years of total IT experience Minimum 5+ years of development experience in Azure Must have Data Warehouse / Data Lake development experience. Must have Azure Data Factory (ADF) & Azure SQL DB Must have Azure Data Bricks experience...

  • Azure Data Engineer

    1 month ago

    Providence, United States Diverse Lynx Full time

    Role: Azure Data Engineer Location: Providence, RI (Remote) Contract Keyskills: (ADF, Databricks, Synapse) 8+ years of total IT experience Minimum 5+ years of development experience in Azure Must have Data Warehouse / Data Lake development experience. Must have Azure Data Factory (ADF) & Azure SQL DB Must have Azure Data Bricks experience...

  • Azure Data Engineer

    3 weeks ago

    Providence, United States Diverse Lynx Full time

    Role: Azure Data Engineer Location: Providence, RI (Remote) Contract Keyskills: (ADF, Databricks, Synapse) 8+ years of total IT experience Minimum 5+ years of development experience in Azure Must have Data Warehouse / Data Lake development experience. Must have Azure Data Factory (ADF) & Azure SQL DB Must have Azure Data Bricks experience...

  • Azure Data Engineer

    4 weeks ago

    Providence, United States Diverse Lynx Full time

    Role: Azure Data Engineer Location: Providence, RI (Remote) Contract Keyskills: (ADF, Databricks, Synapse) 8+ years of total IT experience Minimum 5+ years of development experience in Azure Must have Data Warehouse / Data Lake development experience. Must have Azure Data Factory (ADF) & Azure SQL DB Must have Azure Data Bricks experience...

  • Principal Data Engineer

    3 weeks ago

    Providence, United States Citizens Full time

    Principal Data Engineer - Risk and Finance Return To Work Program For Parents and Veterans About This Workplace Citizens is one of the nation’s oldest and largest financial institutions, offering a broad range of retail and commercial banking products and services to individuals, small businesses, middle-market companies, large corporations and...

  • Sr Data Engineer

    2 weeks ago

    Providence, United States ApTask Full time

    About Client: Client is a company that helps other businesses use technology to improve and grow. They provide services like creating computer programs, managing computer systems, and making sure everything is secure. Client works with different industries like telecommunications, healthcare, banking, and retail to help them use new and exciting technologies...

  • Sr. Data engineer

    2 months ago

    Providence, United States Diverse Lynx Full time

    Hello Hope you are doing well today ! We are currently hiring for "Sr. data engineer " for our client who can join the project asap . Please check the Jd once which are mention below and if you are okay with the Jd please reply with you updated resume , LinkedIn id , Current location ASAP . Role :- Sr. Data engineer Location :- Remote ) Type & duration :-...

  • Sr. Data engineer

    4 weeks ago

    Providence, United States Diverse Lynx Full time

    Hello Hope you are doing well today ! We are currently hiring for "Sr. data engineer " for our client who can join the project asap . Please check the Jd once which are mention below and if you are okay with the Jd please reply with you updated resume , LinkedIn id , Current location ASAP . Role :- Sr. Data engineer Location :- Remote ) Type & duration :-...

  • Data Scientist, Monetization

    1 week ago

    Providence, United States Meta Inc Full time

    Summary: As a Data Scientist, you will collaborate on a wide array of product and technical problems with a diverse set of cross-functional partners across Product, Engineering, Research, Data Engineering, Finance and others. You will use data and analysis to identify and solve product developments biggest challenges. You will influence product strategy and...

  • Data Scientist

    5 days ago

    Providence, United States Omni Inclusive Full time

    A solid foundation in Python programming is essential, along with familiarity with popular AI libraries/frameworks such as Langchain, TensorFlow, PyTorch, scikit-learn, and spaCy. Demonstrated proficiency in developing AI solutions using Azure services, including Azure AI Search, Azure OpenAI APIs, and Azure SQL Database. In-depth knowledge of search...

  • Entry Level Data Scientist

    2 weeks ago

    Providence, United States SynergisticIT Full time

    Role: Entry Level Data ScientistAbout Us: Synergistic IT is a full-service staffing and placement firm servicing client in America for the past 12+ years. We are dedicated towards fulfilling the IT needs of our clients. From staffing to full implementation of projects we provide the highest quality IT Services. We Intend to deliver exceptional student...

  • Principal Cloud Architect

    4 weeks ago

    Providence, United States Blue Cross Blue Shield Full time

    Principal Cloud Architect - Data Platform page is loaded Principal Cloud Architect - Data Platform Apply locations US IL Chicago E. Randolph time type Full time posted on Posted Yesterday job requisition id JR4818 Job Description Summary The Principal Cloud Architect will lead the engineering and operational strategy for cloud architecture, focusing on AWS...

  • Chief Data Operations

    3 weeks ago

    Providence, United States State of Rhode Island Full time

    **Class Definition**: - GENERAL STATEMENT OF DUTIES: To plan, organize, direct, supervise and coordinate the work of the systems analysis, programming, computer operations and data input operations; and to do related work as required. - SUPERVISION EXERCISED: To plan, coordinate, direct and supervise the work of a technical and clerical staff engaged in...

  • Analytics Engineer II

    2 months ago

    Providence, United States Virgin Pulse Full time

    Who are you? The Analytics Engineer will design, develop, and maintain data analytics solutions for core data storage in our Analytics Engineering team. This person will support the success of the analytics engineering team by developing high quality, robust data analytic pipelines and refining data utilization to support quality, performance, cost and...

  • Analytics Engineer II

    4 weeks ago

    Providence, United States Virgin Pulse Full time

    Who are you? The Analytics Engineer will design, develop, and maintain data analytics solutions for core data storage in our Analytics Engineering team. This person will support the success of the analytics engineering team by developing high quality, robust data analytic pipelines and refining data utilization to support quality, performance, cost and...

  • Data Innovation Consultant

    6 days ago

    Providence, United States Software Quality Associates Full time

    The era of data innovation is here. A time in which businesses can do the remarkable with data — from measuring what’s long felt immeasurable to unearthing dark data insights that unlock ROI potential to predicting the future through advanced analytics. At SQA Group, a technology and advisory services firm, we work with some of the most forward thinking...

  • GCp Data Architect

    1 month ago

    Providence, United States ApTask Full time

    About Client: The Client is a leading global IT services and consulting company, providing a wide range of services to clients in various industries, including banking, financial services, retail, manufacturing, healthcare, and more. It is one of the largest employers in the IT industry and has a vast and diverse workforce. The company places a strong...

  • GCp Data Architect

    2 weeks ago

    Providence, United States ApTask Full time

    About Client: The Client is a leading global IT services and consulting company, providing a wide range of services to clients in various industries, including banking, financial services, retail, manufacturing, healthcare, and more. It is one of the largest employers in the IT industry and has a vast and diverse workforce. The company places a strong...