AI Infrastructure & MLOps

Tecton supports deploying, serving, monitoring, or operating AI and machine-learning systems.

TensorZero builds open-source tools for production-grade LLM applications: LLM gateway, observability, optimization, evaluations, and experimentation.

Inference for text-embedding models.

A flexible and easy to use tool for serving PyTorch models.

OpenTelemetry-based observability and monitoring for LLM and agents workflows.

Tracking AI supports deploying, serving, monitoring, or operating AI and machine-learning systems.

Provides an optimized cloud and edge inferencing solution.

TrueFoundry supports deploying, serving, monitoring, or operating AI and machine-learning systems.

Package, configure, and iterate on a model with Truss at whatever level of control your model needs.

Highly Scalable Distributed Vector Search Engine.

Valohai supports deploying, serving, monitoring, or operating AI and machine-learning systems.

Scalable, fast, and disk-friendly vector search in Postgres, the successor of pgvecto.rs.

Python vector database you just need - no more, no less.

Gemini Enterprise Agent Platform (formerly Vertex AI) is a comprehensive platform for developers to build, scale, govern and optimize agents.

Store, search, organize and make machine-learned inferences over big data at serving time.

Machine Learning Operations - An awesome list of references for MLOps.

Wallaroo.AI supports deploying, serving, monitoring, or operating AI and machine-learning systems.

Open-source project that supports deploying, serving, monitoring, or operating AI and machine-learning systems.

Weco Observe supports deploying, serving, monitoring, or operating AI and machine-learning systems.

Documentation for Weights & Biases (Prompts), covering setup, features, and practical usage.

The open source standard for data logging. Enables ML monitoring and observability.