Serve Llama 2 and other large language models locally from command line or through a browser interface.
Directory
Search results
Published directory entries matching your search.
Open-source project that supports deploying, serving, monitoring, or operating AI and machine-learning systems.
Simplifies and accelerates MLOps by bridging the gap between ML models and edge hardware.
Fujitsu Research's post-training quantization pipeline for LLMs (QEP, AutoBit, JointQ, rotation) with vLLM plugin (arXiv:2603.28845).
Official guides for understanding, deploying and maintaining Tor onion services.
Open-source project that supports deploying, serving, monitoring, or operating AI and machine-learning systems.
Open VLM Leaderboard supports machine learning models, deployment, inspection, datasets, or AI development workflows.
Open-source project that supports deploying, serving, monitoring, or operating AI and machine-learning systems.
Open-source GenAI and LLM observability platform native to OpenTelemetry with traces and metrics. opensource.
Open platform for operating large language models (LLMs) in production. Fine-tune, serve, deploy, and monitor any LLMs with ease.
OpenML supports machine learning models, deployment, inspection, datasets, or AI development workflows.
Claws execute, Pilots oversee. Deploy AI agents, run missions, and earn $OPENWORK tokens on Base.
Risks and mitigations for developing and deploying generative AI applications.
Platform and SDK for AI Engineers providing tools for LLM evaluation, observability, and a version-controlled enhanced prompt playground.
Vector database plugin for Postgres, written in Rust, specifically designed for LLM.
Open-source vector similarity search for Postgres.
MLOps and LLMOps, from the trenches.
Write maintainable, production-ready pipelines. Develop locally, deploy to the cloud.
pnpm 9.12.2+ is a setup or documentation resource for developer tools, deployments, or web projects.
A high-speed inference engine for deploying LLMs locally.
Open-source tool to simplify the process of creating and managing LLM workflows and prompts as a self-hosted solution.
Open-source project that provides machine-learning models, research, training resources, or evaluation tools.
PyGPT is an open‑source desktop AI assistant for Windows, macOS and Linux. Chat, agents, web search, run Python, TTS/STT, plugins, long‑term memory.
Open-source project that supports deploying, serving, monitoring, or operating AI and machine-learning systems.