Modelz-LLM

Modelz LLM is an inference server for running open source large language models such as FastChat, LLaMA and ChatGLM on local or cloud environments with an OpenAI compatible API. It supports interaction through the OpenAI python SDK or LangChain and provides docker images for deployment on Kubernetes or Modelz.

GitHub repo Directory import
0 shouts Added Sep 23, 2026 github.com
github.com/tensorchord/modelz-llm
Modelz-LLM website preview

Uses

  • use the OpenAI python SDK or LangChain to interact with the model Source: github.com

Links

Tags