Directory
Published directory entries matching your search.
Cog is an open-source tool that packages machine learning models in standard, production-ready containers. Users define the environment in a configuration file, and it generates a Docker image with Nvidia base images and dependency caching. Model inputs and outputs are defined in Python, from which Cog generates an OpenAPI schema and an HTTP inference server. Models can be deployed to own infrastructure or Replicate.
Featureform is an open-source virtual feature store hosted on GitHub under the featureform organization. It is designed to turn users' existing data infrastructure into a feature store, with supporting resources including a public website, documentation, community forum, and explanatory material on its core abstraction and unique value proposition.
Ombre is an open-source AI infrastructure layer. It runs eight specialized agents on every request to handle security, caching, memory, hallucination detection, and tamper-proof audit trails. It is installed with one line of code, and user data never leaves the user's server.
ZenML is an open-source AI platform for building workflows that run on various infrastructure backends. It allows writing pipelines containing Python logic, such as model training or agentic loops, and tracks runs with metrics, logs and metadata. It integrates with tools and infrastructure including MLflow, LangGraph, Langfuse, Sagemaker and GCP Vertex.
agenttrace is a local-first terminal TUI and report generator for AI coding-agent session history. It reads logs from several coding agents and produces reports on cost, tokens, time, and slow-run diagnosis. Prompts, code, and logs stay on the local machine.
A deprecated GitHub repository described as an AI Gateway, a core infrastructure stack for building production-ready AI applications. It provides a universal API for inferencing over 100 LLMs and lists supported providers and endpoints such as OpenAI and Groq.
Open-source project that supports deploying, serving, monitoring, or operating AI and machine-learning systems.
A curated GitHub list of generative AI companies, sorted by focus area and total fundraised amount. It covers companies with over $5MM raised as of August 2023, split into horizontal application, vertical application and enabling infrastructure categories.
ANEE is an experimental dynamic inference wrapper for pretrained Transformer language models, currently GPT-2. It exposes an energy_budget and performs early exit inside the model's forward pass rather than always running all layers. It adds per-token adaptive computation using a profiler and learned controller to skip redundant layers while keeping the KV-cache aligned.
BayesPy is an open-source Python library that provides tools for performing Bayesian inference. It is hosted as a public repository on GitHub where users can access the code and contribute to its development.
BentoML is a unified model serving framework. It enables users to build model inference APIs, job queues, LLM applications, and multi-model pipelines. The framework supports local execution and deployment via Docker.
An open-source LLM gateway with routing, load balancing, guardrails, and observability for 1000+ models. opensource.
BudgetML is a tool for deploying a machine learning inference service to a secured HTTPS API endpoint with less than 10 lines of code. It runs the model on a Google Cloud Platform preemptible instance, generates a FastAPI server endpoint, and provides interactive Swagger docs. The project states that the library is not being actively maintained.
Open-source project that supports deploying, serving, monitoring, or operating AI and machine-learning systems.
ByteHub is an open-source tool designed to simplify the creation and management of feature stores. It is maintained as a public repository on GitHub under the bytehub-ai organization, with documentation and tutorials available for users.
Clip-as-a-service is an open-source tool that provides scalable embedding, reasoning, and ranking capabilities for images and text using the CLIP model. It is maintained as a public repository on GitHub under the jina-ai organization, with documentation and installation guides available.
Cortex Memory is a production-ready cognitive foundation for autonomous systems such as Embodied-AI and OpenClaw. It provides memory management functionality including extraction, search, and automated optimization, and includes SKILL, CLI, API, MCP, and an insights dashboard out-of-the-box.
Fast inference engine for Transformer models in C++.
Curated list of awesome vector search framework/engine, library, cloud service and research papers to vector similarity search.
Cynative is an open-source project offering security agents for cloud, code, and runtime environments. It includes 45 built-in agents that audit AWS, GCP, Azure, Kubernetes, GitHub, and GitLab for issues including privilege escalation, public exposure, and supply chain vulnerabilities, and supports creating custom agents in a single markdown file with live read-only infrastructure access.
Open-source project that supports deploying, serving, monitoring, or operating AI and machine-learning systems.
MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.
Epsilla is a high-performance vector database hosted on GitHub under the epsilla-cloud organization. It leverages parallel graph computing for its operations, and offers an experimental option to use it as a Python library without requiring a Docker image, alongside Epsilla Cloud as a deployment option.
Eurybia is an open-source tool hosted on GitHub under the MAIF organization. It is designed to monitor model drift over time and secure model deployment processes through data validation functionality, with public documentation covering overview, quickstart, installation, features, and project background.
