Skip to content
#

llmops

Here are 15 public repositories matching this topic...

A comprehensive toolkit for deploying production-ready Generative AI infrastructure on Amazon EKS. Includes pre-configured components for: 🚀 AI Gateway (LiteLLM) 🤖 LLM Serving (vLLM, SGLang, Ollama) 📊 Vector Databases, 🔍 Embedding Models (TEI) 📈 Observability (Langfuse, Phoenix) etc. Fast-track your GenAI deployment with Kubernetes

  • Updated Nov 6, 2025
  • JavaScript

Improve this page

Add a description, image, and links to the llmops topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the llmops topic, visit your repo's landing page and select "manage topics."

Learn more