Directory
Published directory entries matching your search.
GraphPipe is a protocol and collection of software designed to simplify machine learning model deployment. It decouples deployment from framework-specific model implementations, allowing models to be served in a consistent manner across different environments.
Mastra is a TypeScript AI framework for building agents and AI applications. It includes built-in memory, tool support, MCP compatibility, and observability features to support development from prototype to production. The framework also offers workflow tools, agent factory functionality, cloud deployment servers, and an agent builder for evaluation and iteration.
Bifrost is an open-source AI gateway for LLMs, MCP and agents, offered by Maxim AI. It provides routing, governance, guardrails and observability, and is described as a drop-in replacement for AI SDKs. Enterprise adds features such as SSO, RBAC, adaptive load balancing, cluster mode and in-VPC deployment, free for 14 days.
Full-stack AI platform focused on multimodal agents and consumer-scale deployment.
TrueFoundry is an enterprise AI gateway that sits between applications and LLM providers and MCP servers. It offers a unified API for accessing more than 1000 LLMs, along with routing, fallbacks, rate limiting, access control, budgets, guardrails and observability. Deployment options include SaaS, hybrid and self-hosted VPC environments.
Vast.ai is a cloud GPU rental platform for AI, machine learning, deep learning and rendering workloads. Prices are set by supply and demand across 40+ data centers, with on-demand, interruptible and reserved instance types and per-second billing. Deployment is available through console, CLI, SDK and REST API.
vLLM is an open-source library for efficient serving of large language models. It provides an API server, supports offline and online inference, deployment options, and features such as automatic prefix caching, batch invariance, context extension, and speculative decoding. It can be used with GPUs, CPUs, and TPUs.
LLM Model VRAM Calculator is a Hugging Face Space created by NyxKrage. The tool allows users to input a Hugging Face model name, select a target GPU, set context length and quantization options, then calculates the model's required memory size and context buffer capacity to aid LLM deployment planning.
Self-hosted control plane that sits between connected AI clients, model providers, and tools. It applies access rules to users and agents, routes supported model requests through a gateway, checks governed tool calls before execution, and records policy decisions, execution records, and usage in the operator's environment. It deploys a Rust runtime with PostgreSQL on infrastructure the operator controls.
TrackingAI compares AI model results on two IQ tests, Mensa Norway and an Offline Test whose questions are not published. It presents charts of AI IQ scores, model rankings, answer speed, cost, question-by-question accuracy and changes over time.
Package, configure, and iterate on a model with Truss at whatever level of control your model needs.
A Hugging Face Space that classifies whether given text was written by a human or a language model. Users enter text in an input box and receive a classification result. The Space is shown as sleeping due to inactivity.
A personal blog about AI system design and bringing AI into production. Posts cover topics including generative AI applications, agents, multimodal models, LLM research challenges, model routing, generation configurations, and machine learning systems.
Dify is a platform for building agentic workflows on one canvas, covering agents, knowledge pipelines, models and tools. Deployments include Dify Cloud, a VPC or self-hosted setup, and a source-available Community Edition. The platform also supports RAG pipelines with AI model and tool support.
Ultravox is a real-time voice AI infrastructure layer for building voice agents. It trains a speech-native model and manages its own inference and infrastructure stack. The site offers developer-friendly APIs and agentic-ready primitives intended for natural, conversational voice agents. Ultravox has been acquired by Inworld. Pricing lists pay-as-you-go at $0 per month with the first 30 minutes free and $0.05 per minute after that.
Guild is a vendor-neutral control plane for AI agents. It lets engineering teams manage, govern, and share agents in production, with security and observability built in. Features include scoped credentials, action approval, policy enforcement, tracing, and evaluations. It supports any model or framework and provides a shared agent catalog and CLI access.
Msty describes private AI for individuals, teams and organizations, with four products connected as one system: Studio, a private AI workspace; Go, for agents; Nexus, a model gateway hub; and Stack, for organizing knowledge. Studio pricing lists a free tier and an Aurum plan billed yearly at $149 per user.
Nexusflow/NexusRaven-V2-13B is a 13-billion parameter language model available on Hugging Face. It is designed for zero-shot function calling and text generation, aiming to advance open-source artificial intelligence. The model can be used with libraries such as Transformers and provides instructions for deployment via inference providers, notebooks, and local applications.
Open WebUI is a self-hosted AI interface for running AI on the user's own hardware. It connects to local or cloud models including Ollama, OpenAI, Anthropic, or compatible services, and can be extended with Python. The project offers community-shared prompts, models, tools, and functions, and lists deployment options including on-premises or air-gapped setups. Installation can be done with a pip command.
Pipeline Conversations is a podcast from ZenML featuring interviews with platform engineers, ML practitioners and technical leaders building production AI systems. Episodes cover MLOps and LLMOps topics including Kubernetes workflows, model fine-tuning and evaluation, LLM security, cost optimization, prompt engineering and agents in production.
PromptLayer is a prompt management platform for AI engineering teams. It offers prompt versioning, large language model evaluation tools, and AI agent observability via tracing, logs, and regression sets, plus a visual editor for prompt iteration and collaboration.
Stanford CS336: Language Modeling from Scratch is the official course website for a Stanford class offered in Spring 2026. The course walks students through the process of developing a language model, including data collection and cleaning for pre-training, transformer model construction, model training, and evaluation before deployment. The site provides logistics, schedule, assignments, and course materials.
Weco is a research and product lab building recursively self-improving AI. Its platform points at an eval script and iteratively optimizes code against a metric the user defines, such as speed, accuracy or cost. Supported model providers include GPT, Claude, Gemini, Kimi, GLM and MiniMax, with bring your own key.
Agenta is an open-source workspace for AI agents. Agents are built through chat, improved with feedback, and shared with a team, either self-hosted or in the cloud. Integrations and messaging in Slack or Telegram are described on the site.
