github.com
Fast inference engine for Transformer models in C++.
Recently added
Recently added to the directory
Imported and editorial directory entries, listed by publication or catalogue date.
Filters
github.com
Open-source project that supports deploying, serving, monitoring, or operating AI and machine-learning systems.
github.com
Open-source tool that lets you package ML models in a standard, production-ready container.
github.com
Open-source project that supports deploying, serving, monitoring, or operating AI and machine-learning systems.
huyenchip.com
I work to bring AI into production. I write about AI system design.
call-cc.org
Layer - Neural network inference from the command line, implemented in.
cerebras.ai
Helps teams build, deploy, observe or operate machine-learning systems.
github.com
An easy-to-use feature store. Optimized for time-series data.
github.com
Open-source project that supports deploying, serving, monitoring, or operating AI and machine-learning systems.
getburnrate.io
BurnRate supports deploying, serving, monitoring, or operating AI and machine-learning systems.
github.com
Deploy a ML inference service on a budget in less than 10 lines of code.
github.com
An open-source LLM gateway with routing, load balancing, guardrails, and observability for 1000+ models. opensource.
github.com
Open-source platform for high-performance ML model serving.
beam.cloud
Run sandboxes, task queues, and custom model inference with ultrafast boot times, instant autoscaling, and a developer experience that just works.
github.com
Bayesian Inference Tools in Python.
banana.dev
Inference hosting for AI teams who ship fast and scale faster.
arize.com
MLOps in a notebook - uncover insights, surface problems, monitor, and fine tune your models.
github.com
Open-source project that supports deploying, serving, monitoring, or operating AI and machine-learning systems.
amadeuscode.com
Amadeus Code supports deploying, serving, monitoring, or operating AI and machine-learning systems.
github.com
Open-source project that supports deploying, serving, monitoring, or operating AI and machine-learning systems.
huggingface.co
Helps teams build, deploy, observe or operate machine-learning systems.
github.com
Open-source project that supports deploying, serving, monitoring, or operating AI and machine-learning systems.
agenta.ai
Agenta supports deploying, serving, monitoring, or operating AI and machine-learning systems.
yomu.ai
Yomu AI is the #1 AI writing tool for students. Write essays, papers, and theses in minutes, not hours. Try it free – no credit card required.