FlexGen

FlexGen is a software project that enables running large language models on a single GPU. It focuses on throughput-oriented scenarios, offering an approach to efficient inference. The project is available on GitHub as FMInference/FlexLLMGen.

GitHub repo Directory import
0 shouts Added Sep 23, 2026 github.com
github.com/FMInference/FlexLLMGen
FlexGen website preview

Links

Tags