ShoutMyPost
Sign in Submit your work

autobatcher

Directory import

Drop-in AsyncOpenAI replacement that transparently batches requests via the Batch API for cheaper LLM inference.

GitHub repo Models & Machine Learning
View repository Save project
Preview unavailable
Screenshot pending. The listing stays available while a preview is prepared.

Project links

Tags

machine learning AI models model evaluation ML research mlops model deployment

More in Models & Machine Learning

View category

  • AI Studio

    AI Studio supports software development with code generation, analysis, debugging, or documentation.

    Website

  • Android

    Android uses AI to create, edit, transform, or animate video content.

    Website

  • Colab

    Colab creates or edits images with generative AI and text-based controls.

    Website