Directory
Explore AI Infrastructure & MLOps resources in AI & Machine Learning.
Agenta is an open-source workspace for AI agents. Agents are built through chat, improved with feedback, and shared with a team, either self-hosted or in the cloud. Integrations and messaging in Slack or Telegram are described on the site.
agenttrace is a local-first terminal TUI and report generator for AI coding-agent session history. It reads logs from several coding agents and produces reports on cost, tokens, time, and slow-run diagnosis. Prompts, code, and logs stay on the local machine.
A Hugging Face Space that classifies whether given text was written by a human or a language model. Users enter text in an input box and receive a classification result. The Space is shown as sleeping due to inactivity.
Open-source project that supports deploying, serving, monitoring, or operating AI and machine-learning systems.
Amadeus Code provides music AI infrastructure spanning rights-cleared training data, audio supply and royalty management. Its products include MusicTGA for MIDI songwriting ideas, FUJIYAMA AI SOUND for music and sound materials, and Evoke Music, a royalty-free library. CONNECT is a royalty management platform for copyrights and master rights in Japan.
ANEE is an experimental dynamic inference wrapper for pretrained Transformer language models, currently GPT-2. It exposes an energy_budget and performs early exit inside the model's forward pass rather than always running all layers. It adds per-token adaptive computation using a profiler and learned controller to skip redundant layers while keeping the KV-cache aligned.
Arize Phoenix is an AI observability and evaluation tool built by Arize AI and the open-source community on OpenTelemetry and OpenInference. It provides tracing for debugging individual runs, evaluations to score output quality, a prompt playground, and datasets and experiments for comparing changes on the same inputs.
Banana provides GPU inference hosting for AI teams. The platform scales GPUs up and down automatically and includes monitoring, business analytics, a CLI, SDKs, and an open automation API. Backends can be written with Potassium, an open-source HTTP framework. Paid Team and Enterprise tiers are offered.
BayesPy is an open-source Python library that provides tools for performing Bayesian inference. It is hosted as a public repository on GitHub where users can access the code and contribute to its development.
Beam provides a bare-metal cloud for agents, with persistent forkable microVMs that boot in seconds and can be paused, resumed, network-isolated and GPU-accelerated. Virtual machines are billed per second while running, with no compute charges while stopped. The platform also offers serverless GPU tasks, sandboxes and on-demand GPU machines.
BentoML is a unified model serving framework. It enables users to build model inference APIs, job queues, LLM applications, and multi-model pipelines. The framework supports local execution and deployment via Docker.
An open-source LLM gateway with routing, load balancing, guardrails, and observability for 1000+ models. opensource.
BudgetML is a tool for deploying a machine learning inference service to a secured HTTPS API endpoint with less than 10 lines of code. It runs the model on a Google Cloud Platform preemptible instance, generates a FastAPI server endpoint, and provides interactive Swagger docs. The project states that the library is not being actively maintained.
BurnRate is an AI usage analytics tool that tracks costs, tokens and usage patterns across AI coding providers. It connects OpenAI and Anthropic reporting accounts for provider-reported spend and offers a local CLI for session-level detail. Cloud workspaces come in Free, Pro at $12/month and Team at $29/seat/month plans.
Open-source project that supports deploying, serving, monitoring, or operating AI and machine-learning systems.
ByteHub is an open-source tool designed to simplify the creation and management of feature stores. It is maintained as a public repository on GitHub under the bytehub-ai organization, with documentation and tutorials available for users.
Helps teams build, deploy, observe or operate machine-learning systems.
CHICKEN is a compiler for the Scheme programming language that produces portable and efficient C. It supports the R5RS and R7RS standards and many extensions, runs on Linux, OS X, Windows, and many Unix flavours, and is distributed free under the BSD License. Libraries and extensions are available at Eggs Unlimited.
A personal blog about AI system design and bringing AI into production. Posts cover topics including generative AI applications, agents, multimodal models, LLM research challenges, model routing, generation configurations, and machine learning systems.
Clip-as-a-service is an open-source tool that provides scalable embedding, reasoning, and ranking capabilities for images and text using the CLIP model. It is maintained as a public repository on GitHub under the jina-ai organization, with documentation and installation guides available.
Cog is an open-source tool that packages machine learning models in standard, production-ready containers. Users define the environment in a configuration file, and it generates a Docker image with Nvidia base images and dependency caching. Model inputs and outputs are defined in Python, from which Cog generates an OpenAPI schema and an HTTP inference server. Models can be deployed to own infrastructure or Replicate.
Cortex Memory is a production-ready cognitive foundation for autonomous systems such as Embodied-AI and OpenClaw. It provides memory management functionality including extraction, search, and automated optimization, and includes SKILL, CLI, API, MCP, and an insights dashboard out-of-the-box.
Fast inference engine for Transformer models in C++.
Curated list of awesome vector search framework/engine, library, cloud service and research papers to vector similarity search.
Details from each project's website. Open a listing for its full overview.
