Generative Artificial Intelligence (GenAI) 171 ★
LLMKube
Kubernetes operator for self-hosted LLM inference with pluggable runtimes (llama.cpp, vLLM, TGI, Ollama, vllm-swift), multi-GPU sharding, NVIDIA CUDA + Apple Silicon Metal support, and OpenAI-compatible API.
Replaces OpenAI-compatible API
- License
- Apache-2.0
- Stack
- Go, Docker, K8S
- Catalog
- Awesome Self-Hosted
Tags
Generative Artificial Intelligence (GenAI)
More Generative Artificial Intelligence (GenAI) tools
For research only. Verify license, security, and maintenance status before deploying anything in production.