github.com
An open-source LLM gateway with routing, load balancing, guardrails, and observability for 1000+ models. opensource.
Directory
Search results
Published directory entries matching your search.
github.com
Deploy a ML inference service on a budget in less than 10 lines of code.
github.com
An easy-to-use feature store. Optimized for time-series data.
github.com
Monitor your websites, showcase status including daily history, and get Slack/Telegram/Discord notification whenever your website status changes. Using Cloudflare Workers, CRON Triggers, and KV storage.
github.com
Fast inference engine for Transformer models in C++.
github.com
Curated list of awesome vector search framework/engine, library, cloud service and research papers to vector similarity search.
github.com
MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.
github.com
10x faster, cheaper, and better vector database.
github.com
Eurybia monitors data and model drift over time and securizes model deployment with data validation.
github.com
A library for efficient similarity search and clustering of dense vectors.
github.com
FeatherCNN is a high performance inference engine for convolutional neural networks.
github.com
An enterprise-grade, high performance feature store.
github.com
A Virtual Feature Store. Turn your existing data infrastructure into a feature store.
github.com
Open-source self-hostable end-to-end LLMOps platform unifying tracing, evals, simulations, datasets, gateway, and guardrails.
github.com
Production-grade SDK for observability, automated evaluations and prompt management with sub-100ms guardrails for LLM/agent workflows.
github.com
Go binding for MXNet c predict api to do inference with a pre-trained model.
github.com
Create customizable UI components around your models.
github.com
Build multimodal AI services via cloud native technologies · Model Serving · Generative AI · Neural Search · Cloud Native.
github.com
Kubernetes-based system for hyperparameter tuning and neural architecture search.
github.com
Kubernetes custom resource definition for serving ML models on arbitrary frameworks.
github.com
Open source MLOps project that eases model handoffs between data scientist and DevOps.
github.com
Standardized Serverless ML Inference Platform on Kubernetes.
github.com
Open-source all-in-one platform for engineering AI products. Traces, Evals, Datasets, Labels.
github.com
Developer-friendly, serverless vector database for AI applications. Easily add long-term memory to your LLM apps!