BentoML

BentoML is a unified model serving framework. It enables users to build model inference APIs, job queues, LLM applications, and multi-model pipelines. The framework supports local execution and deployment via Docker.

GitHub repo Directory import
0 shouts Added Sep 23, 2026 github.com
github.com/bentoml/BentoML
BentoML website preview

Links

Tags