Search results

Ultravox is a real-time voice AI infrastructure layer that powers fast, natural, and scalable voice agents.

Running large language models on a single GPU for throughput-oriented scenarios. (Archived).

Drag & drop UI to build your customized LLM flow using LangchainJS.

Library for high performance deep learning inference on NVIDIA GPUs.

Open-source self-hostable end-to-end LLMOps platform unifying tracing, evals, simulations, datasets, gateway, and guardrails.

Production-grade SDK for observability, automated evaluations and prompt management with sub-100ms guardrails for LLM/agent workflows.

FutureTools supports machine learning models, deployment, inspection, datasets, or AI development workflows.

Host inference APIs, bulk inference and fine tune text, vision, audio and multi-modal models.

Testing framework dedicated to ML models, from tabular to LLMs. Detect risks of biases, performance issues and errors in 4 lines of code.

Cloud-Native LLM Routing Engine. Improve LLM app resilience and speed.

Go binding for MXNet c predict api to do inference with a pre-trained model.

gotoHuman provides machine-learning models, research, training resources, or evaluation tools.

Creating semantic cache to store responses from LLM queries.

Real-time GPU cloud price comparison across 30+ providers.

GPU cluster manager for running and managing LLMs.

Create customizable UI components around your models.

GraphPipe supports deploying, serving, monitoring, or operating AI and machine-learning systems.

Groq supports deploying, serving, monitoring, or operating AI and machine-learning systems.

Guild AI supports deploying, serving, monitoring, or operating AI and machine-learning systems.

Helicone AI supports deploying, serving, monitoring, or operating AI and machine-learning systems.

HF Learn supports machine learning models, deployment, inspection, datasets, or AI development workflows.

Build, deploy, and scale production ML systems with Hopsworks. The Feature Store and MLOps platform for real-time AI, trusted by teams.

Hugging Face supports machine learning models, deployment, inspection, datasets, or AI development workflows.

LLM evals platform for enterprises, providing tools to develop, evaluate, and observe AI systems.