DocsGPT is described as an open-source private AI assistant and self-hosted RAG platform for an organization's own documents, with cited answers. It is built by Arc53 and deployable in the cloud, on-premises or air-gapped. The platform covers knowledge, agents, workflows and governance.
KoboldAI presents tools for local AI use. KoboldCPP is a local LLM API server for driving a backend, and KoboldAI Lite is a lightweight interface for accessing AI API endpoints. KoboldAI.net delivers KoboldAI Lite as a free web service. Downloads for KoboldCPP are offered for Windows, Linux and Mac, and community support is available on Discord.
A web tool for choosing an AI model that fits a given GPU. Users select a GPU or enter VRAM, then check compatibility by VRAM, bandwidth, and context size. Minimum context window, tokens per second, and required features can be set, and optional system RAM enables offloading to extend context windows or run larger models at reduced speed.
Ollama is a tool for running and building with open AI models locally or in the cloud on macOS, Windows and Linux. Its pricing page lists Free, Pro, Max, Team and Enterprise subscription plans, with paid plans including usage credits and cloud model access. The Free plan includes running models locally and starter usage credits.
Petals is a project for running large language models at home, BitTorrent-style. Users load part of a model and join a network of people serving its other parts. It supports generating text with Llama 3.1, Mixtral, Falcon and BLOOM and fine-tuning them on a consumer-grade GPU or Google Colab.
TavernAI 2 is a desktop AI roleplay chat app distributed as a portable app for Windows and Linux, also installable on a VPS. It runs models locally or connects to built-in and custom AI provider integrations, with branching chats, dynamic participants, a Prompt Manager, and custom AI games.
AI Dungeon is a free AI text adventure game in which players create open-ended stories, explore interactive worlds and guide every choice online or in the app. Players can start a fantasy quest, survive a post-apocalyptic world, build a custom scenario or jump into community-made adventures powered by AI.
Community notes
Be the first to share how this project worked for you.
Sign in with a verified account to leave a review or join the discussion.
Sign in to reviewKeep exploring
KoboldAI presents tools for local AI use. KoboldCPP is a local LLM API server for driving a backend, and KoboldAI Lite is a lightweight interface for accessing AI API endpoints. KoboldAI.net delivers KoboldAI Lite as a free web service. Downloads for KoboldCPP are offered for Windows, Linux and Mac, and community support is available on Discord.
A web tool for choosing an AI model that fits a given GPU. Users select a GPU or enter VRAM, then check compatibility by VRAM, bandwidth, and context size. Minimum context window, tokens per second, and required features can be set, and optional system RAM enables offloading to extend context windows or run larger models at reduced speed.
Ollama is a tool for running and building with open AI models locally or in the cloud on macOS, Windows and Linux. Its pricing page lists Free, Pro, Max, Team and Enterprise subscription plans, with paid plans including usage credits and cloud model access. The Free plan includes running models locally and starter usage credits.
Petals is a project for running large language models at home, BitTorrent-style. Users load part of a model and join a network of people serving its other parts. It supports generating text with Llama 3.1, Mixtral, Falcon and BLOOM and fine-tuning them on a consumer-grade GPU or Google Colab.
TavernAI 2 is a desktop AI roleplay chat app distributed as a portable app for Windows and Linux, also installable on a VPS. It runs models locally or connects to built-in and custom AI provider integrations, with branching chats, dynamic participants, a Prompt Manager, and custom AI games.
AI Dungeon is a free AI text adventure game in which players create open-ended stories, explore interactive worlds and guide every choice online or in the app. Players can start a fantasy quest, survive a post-apocalyptic world, build a custom scenario or jump into community-made adventures powered by AI.
