github.com
Drop-in AsyncOpenAI replacement that transparently batches requests via the Batch API for cheaper LLM inference.
Directory
Search results
Published directory entries matching your search.
github.com
Batch workflow job scheduler created at LinkedIn to run Hadoop jobs.
github.com
A supplement to Copilot and Cursor - utilizes AI for batch processing of project codes.
github.com
A service for deployment Apache Spark MLLib machine learning models as realtime, batch or reactive web services.
github.com
An open-source visual programming environment for battle-testing prompts to LLMs.
airtrain.ai
No-code batch compute platform for LLM evaluation and tuning workloads.
github.com
Python module that helps you build complex pipelines of batch jobs.
github.com
Machine learning model serving framework with dynamic batching and pipelined stages, provides an easy-to-use Python interface.
github.com
Export ML projects to Kubernetes (Argo workflows), Airflow, AWS Batch, and SLURM.
velda.io
Velda - Run GPU training and batch jobs instantly from your dev environment, no code change or manifest.
github.com
Cloud Native Batch System (Project under CNCF).