AI Infrastructure & MLOps

Agenta supports deploying, serving, monitoring, or operating AI and machine-learning systems.

Open-source project that supports deploying, serving, monitoring, or operating AI and machine-learning systems.

Helps teams build, deploy, observe or operate machine-learning systems.

Open-source project that supports deploying, serving, monitoring, or operating AI and machine-learning systems.

Amadeus Code supports deploying, serving, monitoring, or operating AI and machine-learning systems.

Open-source project that supports deploying, serving, monitoring, or operating AI and machine-learning systems.

MLOps in a notebook - uncover insights, surface problems, monitor, and fine tune your models.

Inference hosting for AI teams who ship fast and scale faster.

Bayesian Inference Tools in Python.

Run sandboxes, task queues, and custom model inference with ultrafast boot times, instant autoscaling, and a developer experience that just works.

Open-source platform for high-performance ML model serving.

An open-source LLM gateway with routing, load balancing, guardrails, and observability for 1000+ models. opensource.

Deploy a ML inference service on a budget in less than 10 lines of code.

BurnRate supports deploying, serving, monitoring, or operating AI and machine-learning systems.

Open-source project that supports deploying, serving, monitoring, or operating AI and machine-learning systems.

An easy-to-use feature store. Optimized for time-series data.

Helps teams build, deploy, observe or operate machine-learning systems.

Layer - Neural network inference from the command line, implemented in.

I work to bring AI into production. I write about AI system design.

Open-source project that supports deploying, serving, monitoring, or operating AI and machine-learning systems.

Open-source tool that lets you package ML models in a standard, production-ready container.

Open-source project that supports deploying, serving, monitoring, or operating AI and machine-learning systems.

Fast inference engine for Transformer models in C++.

Curated list of awesome vector search framework/engine, library, cloud service and research papers to vector similarity search.