FastChat

FastChat is an open platform for training, serving, and evaluating large language model based chatbots. Its core features include training and evaluation code for models such as Vicuna and MT-Bench, and a distributed multi-model serving system with a web UI and OpenAI-compatible RESTful APIs.

GitHub repo Directory import
0 shouts Added Sep 23, 2026 github.com
github.com/lm-sys/FastChat
FastChat website preview

Features

  • distributed multi-model serving system with web UI Source: github.com

Uses

Links

Tags