Mamba-Chat

Mamba-Chat is a chat language model built on a state-space model architecture rather than a transformer. The repository provides training and fine-tuning code based on a modified Huggingface Trainer class. The model is based on Mamba-2.8B and was fine-tuned on 16,000 samples of the HuggingFaceH4/ultrachat_200k dataset. Code is provided for testing and fine-tuning, including a command-line chatbot and a Gradio app.

GitHub repo Directory import
0 shouts Added Sep 23, 2026 github.com
github.com/midrender/mamba-chat
Mamba-Chat website preview

Features

Links

Tags