LMFlow

LMFlow is a toolkit for finetuning and inference of large foundation models, presented as extensible, convenient and efficient. It offers support for custom optimizer training, conversation templates, speculative decoding, long context inference with position interpolation for LLaMA models, and Flash Attention-2. The project is released under the Apache-2.0 license and was made available on PyPI.

GitHub repo Directory import
0 shouts Added Sep 23, 2026 github.com
github.com/OptimalScale/LMFlow
LMFlow website preview

Features

  • Extensible Toolkit for Finetuning and Inference of Large Foundation Models Source: github.com

Links

Tags