Search results

Bayesian Inference Tools in Python.

Run sandboxes, task queues, and custom model inference with ultrafast boot times, instant autoscaling, and a developer experience that just works.

Open-source platform for high-performance ML model serving.

An open-source LLM gateway with routing, load balancing, guardrails, and observability for 1000+ models. opensource.

Official inference framework for 1-bit LLMs, by Microsoft. opensource.

Deploy a ML inference service on a budget in less than 10 lines of code.

BurnRate supports deploying, serving, monitoring, or operating AI and machine-learning systems.

Open-source project that supports deploying, serving, monitoring, or operating AI and machine-learning systems.

An easy-to-use feature store. Optimized for time-series data.

Helps teams build, deploy, observe or operate machine-learning systems.

Layer - Neural network inference from the command line, implemented in.

I work to bring AI into production. I write about AI system design.

Open-source project that supports AI agents, automated workflows, orchestration, or delegated tasks.

Open-source project that supports deploying, serving, monitoring, or operating AI and machine-learning systems.

Open-source tool that lets you package ML models in a standard, production-ready container.

Open-source project that provides machine-learning models, research, training resources, or evaluation tools.

Deploy, manage, and scale machine learning models in production.

Open-source project that supports deploying, serving, monitoring, or operating AI and machine-learning systems.

Fast inference engine for Transformer models in C++.

Curated list of awesome vector search framework/engine, library, cloud service and research papers to vector similarity search.

Enjoy unlimited API calls with Serverless AI Workers/LLMs for just $25 per month. No rate or concurrency limits.

Open-source project that supports deploying, serving, monitoring, or operating AI and machine-learning systems.

DeepSeek provides machine-learning models, research, training resources, or evaluation tools.

DeepSpeed supports deploying, serving, monitoring, or operating AI and machine-learning systems.