AI Infrastructure & MLOps

Open-source project that supports deploying, serving, monitoring, or operating AI and machine-learning systems.

MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.

Dify supports deploying, serving, monitoring, or operating AI and machine-learning systems.

Dominodatalab supports deploying, serving, monitoring, or operating AI and machine-learning systems.

A library for probabilistic modelling, inference, and criticism. Built on top of TensorFlow.

10x faster, cheaper, and better vector database.

Eurybia monitors data and model drift over time and securizes model deployment with data validation.

Interactive reports to analyze ML models during validation or production monitoring.

A library for efficient similarity search and clustering of dense vectors.

Open-source project that supports deploying, serving, monitoring, or operating AI and machine-learning systems.

FeatherCNN is a high performance inference engine for convolutional neural networks.

An enterprise-grade, high performance feature store.

A Virtual Feature Store. Turn your existing data infrastructure into a feature store.

Ultravox is a real-time voice AI infrastructure layer that powers fast, natural, and scalable voice agents.

Ultravox is a real-time voice AI infrastructure layer that powers fast, natural, and scalable voice agents.

Open-source self-hostable end-to-end LLMOps platform unifying tracing, evals, simulations, datasets, gateway, and guardrails.

Production-grade SDK for observability, automated evaluations and prompt management with sub-100ms guardrails for LLM/agent workflows.

Go binding for MXNet c predict api to do inference with a pre-trained model.

Real-time GPU cloud price comparison across 30+ providers.

Create customizable UI components around your models.

GraphPipe supports deploying, serving, monitoring, or operating AI and machine-learning systems.

Groq supports deploying, serving, monitoring, or operating AI and machine-learning systems.

Guild AI supports deploying, serving, monitoring, or operating AI and machine-learning systems.

Helicone AI supports deploying, serving, monitoring, or operating AI and machine-learning systems.