Search results

Rune

github.com

Provides containers to encapsulate and deploy EdgeML pipelines and applications.

RunThisLLM

runthisllm.com

RunThisLLM provides machine-learning models, research, training resources, or evaluation tools.

Seldon-core

github.com

MLOps framework to package, deploy, monitor and manage thousands of production machine learning models.

Semantic Cache Router

github.com

Open-source project that provides machine-learning models, research, training resources, or evaluation tools.

Shimmy

github.com

Python-free Rust inference server with OpenAI API compatibility and hot model swapping.

Sinabs

github.com

Open-source project that provides machine-learning models, research, training resources, or evaluation tools.

SinglebaseCloud

singlebase.cloud

SinglebaseCloud supports deploying, serving, monitoring, or operating AI and machine-learning systems.

SocialBu supports deploying, serving, monitoring, or operating AI and machine-learning systems.

Stan

mc-stan.org

Stan supports deploying, serving, monitoring, or operating AI and machine-learning systems.

Starwhale

github.com

An MLOps/LLMOps platform for model building, evaluation, and fine-tuning.

Streamlit

github.com

Lets you create apps for your ML projects with deceptively simple Python scripts.

Superwise

superwise.ai

Superwise supports deploying, serving, monitoring, or operating AI and machine-learning systems.

systemprompt.io

systemprompt.io

systemprompt.io supports deploying, serving, monitoring, or operating AI and machine-learning systems.

TeamoRouter provides machine-learning models, research, training resources, or evaluation tools.

Tecton supports deploying, serving, monitoring, or operating AI and machine-learning systems.

TensorRT-LLM

github.com

Inference engine for TensorRT on Nvidia GPUs.

TensorZero builds open-source tools for production-grade LLM applications: LLM gateway, observability, optimization, evaluations, and experimentation.

text-embeddings-inference

github.com

Inference for text-embedding models.

text-generation-inference

github.com

Large Language Model Text Generation Inference.

TFServing

github.com

Flexible, high-performance serving system for machine learning models.

TNN

github.com

Uniform deep learning inference framework for mobile, desktop and server.

TorchServe

github.com

A flexible and easy to use tool for serving PyTorch models.

Traceloop OpenLLMetry

github.com

OpenTelemetry-based observability and monitoring for LLM and agents workflows.

Tracking AI

trackingai.org

Tracking AI supports deploying, serving, monitoring, or operating AI and machine-learning systems.