GenAI

GCP GenAI Platform Engineer (Onsite role-5days)

Location: Charlotte NC (Need local candidate only)

Experience Level:
10 years

Job Summary

We are seeking a skilled
GCP GenAI Platform Engineer
to design, deploy, and manage next-generation
Generative AI (GenAI)
solutions on
Google Cloud Platform
. The ideal candidate will have hands-on experience with
GCP AI/ML services, Guardrails (Model Armor/SDP)
,
Terraform
, and
GKE
, with a strong understanding of
GenAI architectures and deployment best practices
.

Key Responsibilities

• Design and deploy
  GenAI workloads
  and
  LLM-based applications
  on
  GCP
  .
• Implement
  GCP Guardrails (Model Armor/SDP)
  for secure and compliant AI operations.
• Automate infrastructure provisioning and configuration using
  Terraform
  .
• Manage and scale
  GenAI models
  on
  Google Kubernetes Engine (GKE)
  .
• Collaborate with data scientists and ML engineers to operationalize LLMs.
• Monitor performance, optimize cost, and ensure high availability of AI services.
• Troubleshoot deployment issues, analyze logs, and enhance platform reliability.

Required Skills & Qualifications

• Strong experience with
  GCP AI/ML stack
  ,
  Vertex AI
  , and
  GenAI APIs
  .
• Working knowledge of
  Terraform
  and
  GKE
  .
• Proficiency in
  Python
  for scripting and automation.
• Understanding of
  GenAI concepts
  ,
  prompt engineering
  , and
  LLM architectures
  .
• Familiarity with
  security, compliance, and governance
  in AI workloads.
• Excellent problem-solving and collaboration skills.

Azure GenAI Platform Engineer

Job Summary

We are looking for an experienced
Azure GenAI Platform Engineer
to build and manage AI/LLM-based applications on the
Microsoft Azure GenAI ecosystem
. The ideal candidate should be proficient with
Azure OpenAI Service
,
Azure Guardrails (Content Filtering, Purview, etc.)
,
Terraform
, and
Kubernetes
, with a deep understanding of
GenAI concepts
and enterprise-scale deployment practices.

Key Responsibilities

• Architect, deploy, and manage
  GenAI workloads
  using
  Azure OpenAI
  ,
  Cognitive Services
  , and related tools.
• Implement
  Azure Guardrails
  for responsible AI usage (Content Filtering, Purview).
• Automate infrastructure setup using
  Terraform
  .
• Deploy and manage AI microservices on
  Azure Kubernetes Service (AKS)
  or
  GKE
  .
• Integrate
  LLM endpoints
  with enterprise applications securely.
• Work closely with leadership and product teams to design scalable, production-ready AI solutions.

Required Skills & Qualifications

• Hands-on experience with
  Azure OpenAI Service
  ,
  Azure ML
  , and
  Azure AI Studio
  .
• Proficiency in
  Terraform
  ,
  Python
  , and containerized deployments (
  Docker
  ,
  AKS/GKE
  ).
• Strong understanding of
  LLMs
  ,
  prompt engineering
  , and
  GenAI system design
  .
• Familiarity with
  Azure Guardrails
  (Purview, Content Filtering).
• Excellent communication skills to work with technical and business stakeholders.

OCP GenAI Platform Engineer (Red Hat OpenShift)

Job Summary

We are seeking an experienced
OCP GenAI Platform Engineer
with strong expertise in
Red Hat OpenShift (OCP)
and
LLM deployment
. The ideal candidate will have deep hands-on experience with
vLLM inferencing engines
,
GPU-based workloads
, and
end-to-end deployment of large language models (LLMs)
. The role requires someone who can operate independently, troubleshoot complex deployments, and collaborate directly with leadership on strategic AI initiatives.

Key Responsibilities

• Deploy and manage
  GenAI and LLM workloads
  on
  Red Hat OpenShift Platform
  .
• Configure and optimize
  vLLM inferencing engines
  for GPU-based model serving.
• Manage deployment of
  LLM endpoints
  , model tuning, and performance optimization.
• Develop and debug
  deployment manifests (YAML files)
  and infrastructure configurations.
• Ensure stability, scalability, and security of GenAI workloads on OCP.
• Collaborate with AI architects and leadership to drive AI platform strategy and adoption.

Required Skills & Qualifications

• Strong experience with
  Red Hat OpenShift Container Platform (OCP)
  .
• Deep understanding of
  LLM internals
  ,
  inference optimization
  , and
  GPU utilization
  .
• Hands-on experience with
  vLLM
  ,
  Python scripting
  , and
  YAML-based deployments
  .
• Ability to
  troubleshoot OCP issues independently
  .
• Strong collaboration and leadership communication skills.