Search results

QWED

github.com

Open-source project that provides machine-learning models, research, training resources, or evaluation tools.

The open source solution for monitoring your AI models in production.

OpenAI-compatible LLM inference server for Apple Silicon using MLX. 2-4x faster than Ollama with tool calling and prompt caching.

ray-llm

github.com

Open-source project that provides machine-learning models, research, training resources, or evaluation tools.

Examples showing how to use the OpenAI vision API to run inference on images, video files and webcam streams.

Rockpool

github.com

Open-source project that provides machine-learning models, research, training resources, or evaluation tools.

Provides containers to encapsulate and deploy EdgeML pipelines and applications.

RunThisLLM

runthisllm.com

RunThisLLM provides machine-learning models, research, training resources, or evaluation tools.

Semantic Cache Router

github.com

Open-source project that provides machine-learning models, research, training resources, or evaluation tools.

Python-free Rust inference server with OpenAI API compatibility and hot model swapping.

Sinabs

github.com

Open-source project that provides machine-learning models, research, training resources, or evaluation tools.

SinglebaseCloud supports deploying, serving, monitoring, or operating AI and machine-learning systems.

SocialBu supports deploying, serving, monitoring, or operating AI and machine-learning systems.

Stan supports deploying, serving, monitoring, or operating AI and machine-learning systems.

Lets you create apps for your ML projects with deceptively simple Python scripts.

Superwise supports deploying, serving, monitoring, or operating AI and machine-learning systems.

systemprompt.io supports deploying, serving, monitoring, or operating AI and machine-learning systems.

TeamoRouter provides machine-learning models, research, training resources, or evaluation tools.

Tecton supports deploying, serving, monitoring, or operating AI and machine-learning systems.

Suite of tools that users, both novice and advanced, can use to optimize machine learning models for deployment and execution.

Inference engine for TensorRT on Nvidia GPUs.

TensorZero builds open-source tools for production-grade LLM applications: LLM gateway, observability, optimization, evaluations, and experimentation.

Inference for text-embedding models.

Large Language Model Text Generation Inference.