llmops-project

Hands-on AI infrastructure projects for DevOps, SRE, and platform engineers. Learn MLOps, LLMOps, and GPU-on-Kubernetes by building real systems — model serving with vLLM, ML pipelines, GPU autoscaling, and production inference platforms.

**Vigilant Agent** is an agentic AI platform using Azure Video Indexer, LangGraph, and Groq Llama-3 LPUs for multi-modal video compliance auditing.

Pulse360 is a full-stack internal HR Analytics platform built for cycle reviews for organizational intiatives, this can be monthly, quarterly. The client wanted a broad HR solution to help monitor employee contributions, likely hiring conversions and system adoption.

Evaluated AI assistant platform: LangGraph agent with hybrid RAG and an MLflow quality gate in CI, Java RBAC/audit gateway, C++ whisper.cpp speech-to-text, Perl/Spark/DuckDB PII-redacting pipeline. Runs free on local models; Claude optional.

Production-ready MCP (Model Context Protocol) AI agent for automating Australian telehealth patient intake, TGA/AHPRA compliance pre-screening, and doctor pre-consult briefs.

Enterprise Distributed Continuous Training (CT) and Model Governance Platform

AI agent cost, node by node, from your OpenTelemetry traces. Thrown-away attempts included.