Kaito

Kaito is the Kubernetes AI Toolchain Operator, an operator suite that automates LLM inference, fine-tuning and RAG engine deployment in a Kubernetes cluster. It simplifies the CRD API and provides optimized preset configurations for inference engine scheduling parameters. Workspaces are the basic CRD for managing inference and tuning workloads, and all vLLM-supported models can be run.

GitHub repo Directory import
0 shouts Added Sep 23, 2026 github.com
github.com/kaito-project/kaito
Kaito website preview

Features

  • automates LLM model inference, fine-tuning, and RAG engine deployment Source: github.com

Links

Tags