Xinference

Xinference is a model serving tool that provides a unified production-ready inference API. It allows users to run open-source, speech and multimodal models on cloud infrastructure, on-premises systems or personal laptops by modifying a single line of code.

GitHub repo Directory import
0 shouts Added Sep 23, 2026 github.com
github.com/xorbitsai/inference
Xinference website preview

Links

Tags