autobatcher

Drop-in AsyncOpenAI replacement that transparently batches requests via the Batch API for cheaper LLM inference.

GitHub repo Directory import
0 shouts Added Sep 23, 2026 github.com
github.com/doublewordai/autobatcher
autobatcher website preview

Links

Tags