github.com
Open-source tool that lets you package ML models in a standard, production-ready container.
Directory
Search results
Published directory entries matching your search.
github.com
Fast inference engine for Transformer models in C++.
github.com
Curated list of awesome vector search framework/engine, library, cloud service and research papers to vector similarity search.
github.com
MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.
edwardlib.org
A library for probabilistic modelling, inference, and criticism. Built on top of TensorFlow.
github.com
10x faster, cheaper, and better vector database.
github.com
Eurybia monitors data and model drift over time and securizes model deployment with data validation.
github.com
A library for efficient similarity search and clustering of dense vectors.
github.com
FeatherCNN is a high performance inference engine for convolutional neural networks.
github.com
An enterprise-grade, high performance feature store.
github.com
A Virtual Feature Store. Turn your existing data infrastructure into a feature store.
fixie.ai
Ultravox is a real-time voice AI infrastructure layer that powers fast, natural, and scalable voice agents.
ultravox.ai
Ultravox is a real-time voice AI infrastructure layer that powers fast, natural, and scalable voice agents.
github.com
Open-source self-hostable end-to-end LLMOps platform unifying tracing, evals, simulations, datasets, gateway, and guardrails.
github.com
Production-grade SDK for observability, automated evaluations and prompt management with sub-100ms guardrails for LLM/agent workflows.
github.com
Go binding for MXNet c predict api to do inference with a pre-trained model.
gpuperhour.com
Real-time GPU cloud price comparison across 30+ providers.
github.com
Create customizable UI components around your models.
hopsworks.ai
Build, deploy, and scale production ML systems with Hopsworks. The Feature Store and MLOps platform for real-time AI, trusted by teams.
Helps teams build, deploy, observe or operate machine-learning systems.
github.com
Build multimodal AI services via cloud native technologies · Model Serving · Generative AI · Neural Search · Cloud Native.
github.com
Kubernetes-based system for hyperparameter tuning and neural architecture search.
respan.ai
Respan unifies LLM observability, evals, prompt optimization, and an AI gateway so teams can ship reliable AI applications.
github.com
Kubernetes custom resource definition for serving ML models on arbitrary frameworks.