AI Infrastructure & MLOps

Open-source project that supports deploying, serving, monitoring, or operating AI and machine-learning systems.

Open-source GenAI and LLM observability platform native to OpenTelemetry with traces and metrics. opensource.

Turns your ML code into microservices with web API, interactive GUI, and more.

Platform and SDK for AI Engineers providing tools for LLM evaluation, observability, and a version-controlled enhanced prompt playground.

Vector database plugin for Postgres, written in Rust, specifically designed for LLM.

Open-source vector similarity search for Postgres.

MLOps and LLMOps, from the trenches.

Democratize and productionize Gen AI across your entire org with Portkey.

Open-source project that supports deploying, serving, monitoring, or operating AI and machine-learning systems.

Open-source project that supports deploying, serving, monitoring, or operating AI and machine-learning systems.

Quix is the agentic AI platform for hardware engineering — turn test-rig and sensor data into real-time insight.

The open source solution for monitoring your AI models in production.

OpenAI-compatible LLM inference server for Apple Silicon using MLX. 2-4x faster than Ollama with tool calling and prompt caching.

Examples showing how to use the OpenAI vision API to run inference on images, video files and webcam streams.

Provides containers to encapsulate and deploy EdgeML pipelines and applications.

MLOps framework to package, deploy, monitor and manage thousands of production machine learning models.

Python-free Rust inference server with OpenAI API compatibility and hot model swapping.

SinglebaseCloud supports deploying, serving, monitoring, or operating AI and machine-learning systems.

SocialBu supports deploying, serving, monitoring, or operating AI and machine-learning systems.

Stan supports deploying, serving, monitoring, or operating AI and machine-learning systems.

An MLOps/LLMOps platform for model building, evaluation, and fine-tuning.

Lets you create apps for your ML projects with deceptively simple Python scripts.

Superwise supports deploying, serving, monitoring, or operating AI and machine-learning systems.

systemprompt.io supports deploying, serving, monitoring, or operating AI and machine-learning systems.