Directory
Published directory entries matching your search.
QWED is an open-source AI verification infrastructure hosted on GitHub. It provides deterministic verification for large language model outputs, tool calls, code, schemas, and agent state prior to production execution.
The open source solution for monitoring your AI models in production.
Rapid-MLX is an open-source, Apache 2.0 licensed large language model inference server and Mac application for Apple Silicon devices. It is compatible with OpenAI and Anthropic APIs, built on the MLX framework, and focused on reliable tool calling for coding agents.
Examples showing how to use the OpenAI vision API to run inference on images, video files and webcam streams.
Rune is a project that provides containers to encapsulate and deploy EdgeML pipelines and applications. It is associated with the repository hotg-ai/rune and is licensed under Apache 2.0 or MIT at the user's option.
MLOps framework to package, deploy, monitor and manage thousands of production machine learning models.
Python-free Rust inference server with OpenAI API compatibility and hot model swapping.
Open-source DevOps agent to help you secure, deploy, and maintain production-ready infrastructure.
An MLOps/LLMOps platform for model building, evaluation, and fine-tuning.
Steel Browser is an open source browser API built for AI agents and applications. It functions as a batteries-included browser sandbox that enables web automation without requiring users to manage underlying infrastructure. The project is hosted on GitHub under the steel-dev organization.
Lets you create apps for your ML projects with deceptively simple Python scripts.
Tabby is a self-hosted AI coding assistant presented as an open-source, on-premises alternative to GitHub Copilot. The project describes itself as self-contained, requiring no DBMS or cloud service, with an OpenAPI interface for integration with existing infrastructure such as cloud IDEs, and support for consumer-grade GPUs.
A toolkit for deploying and serving open source text embeddings and sequence classification models. It supports models including FlagEmbedding, Ember, GTE and E5, and features token based dynamic batching, Flash Attention and Candle optimized inference, Safetensors and ONNX weight loading, and Metal support for local execution on Macs.
TF-GAN is a lightweight library for training and evaluating Generative Adversarial Networks in TensorFlow. It provides core training infrastructure, common GAN operations and normalization techniques, losses and penalties such as the Wasserstein loss and gradient penalty, and standard evaluation metrics including Inception Score, Frechet Distance and Kernel Distance. It can be installed with pip. The repository was archived and is now read-only.
TorchServe is an open-source tool for serving, optimizing, and scaling PyTorch models in production. It offers quick start guides for TorchServe, conda, and Docker, and includes an announcement about security changes.
Traceloop OpenLLMetry is an open-source observability tool for GenAI and LLM applications, based on OpenTelemetry and maintained by Traceloop. It provides instrumentation for vector databases and frameworks, and includes documentation on getting started and supported destinations.
Triton Inference Server is open source inference serving software that streamlines AI inferencing. It enables teams to deploy models from multiple deep learning and machine learning frameworks across cloud, data center, edge and embedded devices.
Vald is a highly scalable distributed vector search engine. It is hosted on GitHub and provides documentation on installation using Helm, requirements, and usage. The project focuses on delivering a scalable solution for vector search.
Scalable, fast, and disk-friendly vector search in Postgres, the successor of pgvecto.rs.
VectorDB is a Python vector database designed to be simple and sufficient. It can be used locally or as a service, with server and client components. The project emphasizes ease of use for vector database needs.
Vespa is an AI search platform. Its repository contains the code required to build and run Vespa. The project covers searching, making inferences in and organizing vectors, tensors, text and structured data at serving time and any scale. It is licensed under Apache 2.0.
Machine Learning Operations - An awesome list of references for MLOps.
Open-source project that supports deploying, serving, monitoring, or operating AI and machine-learning systems.
Whylogs is an open-source data logging library for machine learning models and data pipelines. It provides visibility into data quality and model performance over time, and supports privacy-preserving data collection to support system safety and robustness.
