Search results

Running large language models on a single GPU for throughput-oriented scenarios. (Archived).

Drag & drop UI to build your customized LLM flow using LangchainJS.

Library for high performance deep learning inference on NVIDIA GPUs.

Open-source self-hostable end-to-end LLMOps platform unifying tracing, evals, simulations, datasets, gateway, and guardrails.

Production-grade SDK for observability, automated evaluations and prompt management with sub-100ms guardrails for LLM/agent workflows.

Host inference APIs, bulk inference and fine tune text, vision, audio and multi-modal models.

Testing framework dedicated to ML models, from tabular to LLMs. Detect risks of biases, performance issues and errors in 4 lines of code.

Cloud-Native LLM Routing Engine. Improve LLM app resilience and speed.

Go binding for MXNet c predict api to do inference with a pre-trained model.

gotoHuman provides machine-learning models, research, training resources, or evaluation tools.

Creating semantic cache to store responses from LLM queries.

Real-time GPU cloud price comparison across 30+ providers.

GPU cluster manager for running and managing LLMs.

Create customizable UI components around your models.

GraphPipe supports deploying, serving, monitoring, or operating AI and machine-learning systems.

Groq supports deploying, serving, monitoring, or operating AI and machine-learning systems.

Guild AI supports deploying, serving, monitoring, or operating AI and machine-learning systems.

Helicone AI supports deploying, serving, monitoring, or operating AI and machine-learning systems.

LLM evals platform for enterprises, providing tools to develop, evaluate, and observe AI systems.

Platform for deploying your Machine Learning to production.

A service for deployment Apache Spark MLLib machine learning models as realtime, batch or reactive web services.

Code for hyperparameter tuning/optimization of machine learning and deep learning algorithms.

Infer.NET provides machine-learning models, research, training resources, or evaluation tools.

Helps teams build, deploy, observe or operate machine-learning systems.