AI/ML & RAG Platform Developer
Save this job and keep your search organized
Create a free account to save jobs, create alerts and return to this listing from your dashboard.
By continuing, you agree to our Terms & Privacy Policy.
Position Title: Senior Generative AI & LLM Engineer
Location: Raleigh, NC
Work Arrangement: Hybrid (2 days onsite per week required—non-negotiable)
Interview Process: Both Phone and In-Person Interviews (Candidate must be able to attend an in-person interview)
< data-path-to-node="12" dir="ltr">Role Summary>Seeking a Senior Generative AI Developer to design, build, and deploy production-grade Artificial Intelligence solutions leveraging Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), model fine-tuning, and secure enterprise data systems. Collaborating across engineering, data, security, and governance teams, this role builds scalable AI microservices while enforcing strict privacy, compliance, and Responsible AI standards.
< data-path-to-node="14" dir="ltr">Key Responsibilities>-
LLM & Agent Development: Build and deploy production LLM-driven features, prompts, and agentic workflows, customizing models through fine-tuning and adapter techniques.
-
RAG Pipelines & Data Integration: Develop RAG pipelines backed by vector, relational (SQL), and NoSQL databases, managing secure enterprise content ingestion with metadata tagging and PII protection.
-
Microservices & MLOps: Build secure, scalable microservices to integrate AI capabilities into enterprise applications, maintaining CI/CD pipelines and monitoring system performance, cost, and model drift.
-
AI Security & Responsible AI: Implement AI safety controls, encryption, RBAC, and API security while conducting bias, fairness, hallucination, and privacy reviews to support audit readiness.
-
Generative AI & Python Frameworks: 3+ years of hands-on experience in applied machine learning or Generative AI development, including 3+ years of Python development with LLM frameworks (LangChain, Semantic Kernel, or LangGraph) and 3+ years on a major cloud platform (Azure, AWS, or Google Cloud Platform).
-
RAG & Vector Databases: 2+ years of experience building RAG pipelines or LLM-driven applications, alongside 2+ years working with vector databases (Pinecone, Weaviate, Milvus, or FAISS) and retrieval optimization.
-
Microservices & Databases: 5+ years of experience building/integrating microservices (FastAPI, Node.js, or Azure Functions), 5+ years of SQL experience (data modeling, transformations, performance tuning), and 2+ years with NoSQL/document databases (MongoDB, Cosmos DB, or DynamoDB).
-
AI Security & Responsible AI: 2+ years implementing AI security controls (encryption, RBAC, API security, secret management) and 2+ years applying Responsible AI practices (bias testing, hallucination mitigation, privacy safeguards).
-
Agile & Execution: 3+ years of experience in Agile environments (Scrum, Kanban, or SAFe) with strong organizational skills for following complex technical procedures.