Generative Artificial Intelligence (GenAI) 144 ★

LLMKube

Kubernetes operator for llama.cpp-native LLM inference with GPU scheduling, Apple Silicon Metal support, and OpenAI-compatible API.

Replaces OpenAI-compatible API
License
Apache-2.0
Stack
Go, Docker, K8S
Catalog
Awesome Self-Hosted

Tags

Generative Artificial Intelligence (GenAI)

For research only — verify license, security, and maintenance status before deploying anything in production.