github.com
Inference for text-embedding models.
Directory
Search results
Published directory entries matching your search.
github.com
Large Language Model Text Generation Inference.
github.com
Flexible, high-performance serving system for machine learning models.
disconnect.blog
Generative AI will enrich investors and be deployed against everyone else.
github.com
Uniform deep learning inference framework for mobile, desktop and server.
github.com
A flexible and easy to use tool for serving PyTorch models.
github.com
OpenTelemetry-based observability and monitoring for LLM and agents workflows.
trackingai.org
Tracking AI supports deploying, serving, monitoring, or operating AI and machine-learning systems.
github.com
Provides an optimized cloud and edge inferencing solution.
truefoundry.com
TrueFoundry supports deploying, serving, monitoring, or operating AI and machine-learning systems.
truss.baseten.co
Package, configure, and iterate on a model with Truss at whatever level of control your model needs.
docs.ray.io
Documentation for Tune, covering setup, features, and practical usage.
github.com
Highly Scalable Distributed Vector Search Engine.
valohai.com
Valohai supports deploying, serving, monitoring, or operating AI and machine-learning systems.
vast.ai
Vast.ai provides machine-learning models, research, training resources, or evaluation tools.
huggingface.co
VBench supports machine learning models, deployment, inspection, datasets, or AI development workflows.
github.com
Scalable, fast, and disk-friendly vector search in Postgres, the successor of pgvecto.rs.
github.com
Python vector database you just need - no more, no less.
vellum.ai
AI product development platform to experiment with, evaluate, and deploy advanced LLM apps.
cloud.google.com
Gemini Enterprise Agent Platform (formerly Vertex AI) is a comprehensive platform for developers to build, scale, govern and optimize agents.
github.com
Store, search, organize and make machine-learned inferences over big data at serving time.
github.com
Machine Learning Operations - An awesome list of references for MLOps.
docs.vllm.ai
An inference and serving engine for language models.
wallaroo.ai
Wallaroo.AI supports deploying, serving, monitoring, or operating AI and machine-learning systems.