Data MLOps Engineer

2 weeks ago

Providence, RI, United States Omni Inclusive Full time
Data MLOps Engineer
  • Experience working within the Azure ecosystem, including Azure AI Search, Azure Storage Blob, Azure Postgres and understanding how to leverage them for data processing, storage, and analytics tasks.
  • Ability to preprocess and clean large datasets efficiently using Azure Tools /Python and other data manipulation tools. Experience with techniques such as data normalization, feature engineering, and data augmentation is preferred.
  • To have background in Data Science/MLOps and proficiency in DevOps, CI/CD, Azure Cloud computing and Model monitoring.
  • Expertise in working with healthcare data standards (ex. HIP nd FHIR), sensitive data and data masking techniques to mask personally identifiable information (PII) and protected health information (PHI) is essential.
  • In-depth knowledge of search algorithms, indexing techniques, and retrieval models for effective information retrieval tasks. Familiarity with search platforms like Elasticsearch or Azure AI Search is a must.
  • Familiarity with chunking techniques and working with vectors and vector databases like Pinecone.
  • Ability to design, develop, and maintain scalable data pipelines for ingesting, processing, and transforming large volumes of structured and unstructured data.
  • Experience with implementing best practices for data storage, retrieval, and access control to ensure data integrity, security, and compliance with regulatory requirements.
  • Be able to implement efficient data processing workflows to support the training and evaluation of solutions using large language models, ensuring reliability, scalability, and performance.
  • Ability to proactively identify and address issues related to data quality, pipeline failures, or resource contention, ensuring minimal disruption to systems.
  • Experience with large language model frameworks, such as Langchain and know how to integrate them into data pipelines for natural language processing tasks.
  • Experience working within the snowflake ecosystem.
  • Knowledge of cloud computing principles and experience in deploying, scaling, and monitoring AI solutions on cloud platforms like Snowflake, Azure, AWS.
  • Ability to communicate complex technical concepts effectively to technical and non-technical stakeholders and collaborate with cross-functional teams.
  • Analytical mindset with a keen attention to detail, coupled with the ability to solve complex problems efficiently.
  • Knowledge of cloud cost management principles and best practices to optimize cloud resource usage and minimize costs.
Must Have:
  • Minimum of 10 years' experience as a data engineer
  • Hands-on experience with Azure Cloud eco-system.
  • Hands-on experience using Python for data manipulation.
  • Deep understanding of vectors and vector databases.
  • Hands-on experience scaling POC to production.
  • Hands-on experience using tools such as Document Intelligence, Snowflake, function app. Azure AI Search
  • Experience working with PII/PHI
  • Hands-on experience working with unstructured data.

  • Data MLOps Engineer

    2 weeks ago

    Providence, RI, United States Tekfortune Inc Full time

    Role : Data MLOps Engineer Location : Remote Experience within the Azure ecosystem, including Azure AI Search, Azure Storage Blob, Azure Postgres, with expertise in leveraging these tools for data processing, storage, and analytics tasks. Proficiency in data preprocessing and cleaning large datasets efficiently using Azure Tools, Python, and other data...

  • Principal Data Architect

    1 week ago

    Providence, RI, United States UNFI Full time

    Job Overview: The Principal IT Solutions Data Architect leads end-to-end data architecture on AWS, leveraging Databricks for computing, governance, and platform evolution, defines data product patterns, domain models, and best practices, partnering with engineering, analytics, security, and business teams to deliver resilient, high-performance, governed data...

  • Principal Data Architect

    1 week ago

    Providence, RI, United States UNFI Full time

    Job Overview: The Principal IT Solutions Data Architect leads end-to-end data architecture on AWS, leveraging Databricks for computing, governance, and platform evolution, defines data product patterns, domain models, and best practices, partnering with engineering, analytics, security, and business teams to deliver resilient, high-performance, governed data...

  • Principal Data Architect

    12 hours ago

    Providence, RI, United States UNFI Full time

    Job Overview: The Principal IT Solutions Data Architect leads end-to-end data architecture on AWS, leveraging Databricks for computing, governance, and platform evolution, defines data product patterns, domain models, and best practices, partnering with engineering, analytics, security, and business teams to deliver resilient, high-performance, governed data...

  • Principal Data Architect

    6 days ago

    Providence, RI, United States UNFI Full time

    Job Overview: The Principal IT Solutions Data Architect leads end-to-end data architecture on AWS, leveraging Databricks for computing, governance, and platform evolution, defines data product patterns, domain models, and best practices, partnering with engineering, analytics, security, and business teams to deliver resilient, high-performance, governed data...

  • Data Engineer

    2 weeks ago

    Providence, RI, United States Tekfortune Inc Full time

    Tekfortune is a fast-growing consulting firm specialized in permanent, contract & project-based staffing services for world's leading organizations in a broad range of industries. In this quickly changing economic landscape, virtual recruiting and remote work are critical for the future of work. To support the active project demands and skills gaps, our...

  • Data Engineering Manager

    1 week ago

    Providence, RI, United States META Full time

    Summary: We're looking for a leader in our Data Engineering team to work closely with Product Managers, Data Scientists and Software Engineers to support product launches and roadmaps by building the data architecture that informs and drives insight. In this role, there will be a direct link between your work, company growth, and user satisfaction. You'll...

  • Senior Data Engineer

    1 week ago

    Providence, RI, United States Oracle Full time

    Job Description We're looking for an experienced software engineer specializing in data engineering to join our growing team focused on building, supporting and enhancing the OCI Data Center telemetry big data and analytics platform. This platform is at the heart of driving hardware quality, reliability, and efficiency as well as providing operational...

  • Mid-Level Data Engineer

    2 weeks ago

    Providence, RI, United States Duck Creek Technologies Full time

    Duck Creek is at the forefront of transforming the insurance industry through innovative SaaS solutions that enhance how insurers interact with their customers. We pride ourselves on not just creating software but also providing a fully managed service model that empowers insurance companies to revolutionize their business operations. At Duck Creek, we...

  • Mid-Level Data Engineer

    2 weeks ago

    Providence, RI, United States Duck Creek Technologies Full time

    Duck Creek is at the forefront of transforming the insurance industry through innovative SaaS solutions that enhance how insurers interact with their customers. We pride ourselves on not just creating software but also providing a fully managed service model that empowers insurance companies to revolutionize their business operations. At Duck Creek, we...