FictionLab uses AI to draft, edit, summarize, or adapt written content.
Screenshot unavailable. The listing stays available while a preview is prepared.
A web tool for choosing an AI model that fits a given GPU. Users select a GPU or enter VRAM, then check compatibility by VRAM, bandwidth, and context size. Minimum context window, tokens per second, and required features can be set, and optional system RAM enables offloading to extend context windows or run larger models at reduced speed.
KoboldAI presents tools for local AI use. KoboldCPP is a local LLM API server for driving a backend, and KoboldAI Lite is a lightweight interface for accessing AI API endpoints. KoboldAI.net delivers KoboldAI Lite as a free web service. Downloads for KoboldCPP are offered for Windows, Linux and Mac, and community support is available on Discord.
TavernAI 2 is a desktop AI roleplay chat app distributed as a portable app for Windows and Linux, also installable on a VPS. It runs models locally or connects to built-in and custom AI provider integrations, with branching chats, dynamic participants, a Prompt Manager, and custom AI games.
Petals is a project for running large language models at home, BitTorrent-style. Users load part of a model and join a network of people serving its other parts. It supports generating text with Llama 3.1, Mixtral, Falcon and BLOOM and fine-tuning them on a consumer-grade GPU or Google Colab.
Ollama is a tool for running and building with open AI models locally or in the cloud on macOS, Windows and Linux. Its pricing page lists Free, Pro, Max, Team and Enterprise subscription plans, with paid plans including usage credits and cloud model access. The Free plan includes running models locally and starter usage credits.
LocalAI is described as an open source AI engine that runs models, including LLMs, vision, voice, image and video, on any hardware without a GPU. It presents itself as a drop-in replacement for most upstream APIs and includes a built-in agent platform powered by LocalAGI, whose agents can reason, use tools and maintain memory. Image generation with Stable diffusion on CPU is also supported.
Community notes
Be the first to share how this project worked for you.
Sign in with a verified account to leave a review or join the discussion.
Sign in to reviewKeep exploring
A web tool for choosing an AI model that fits a given GPU. Users select a GPU or enter VRAM, then check compatibility by VRAM, bandwidth, and context size. Minimum context window, tokens per second, and required features can be set, and optional system RAM enables offloading to extend context windows or run larger models at reduced speed.
KoboldAI presents tools for local AI use. KoboldCPP is a local LLM API server for driving a backend, and KoboldAI Lite is a lightweight interface for accessing AI API endpoints. KoboldAI.net delivers KoboldAI Lite as a free web service. Downloads for KoboldCPP are offered for Windows, Linux and Mac, and community support is available on Discord.
TavernAI 2 is a desktop AI roleplay chat app distributed as a portable app for Windows and Linux, also installable on a VPS. It runs models locally or connects to built-in and custom AI provider integrations, with branching chats, dynamic participants, a Prompt Manager, and custom AI games.
Petals is a project for running large language models at home, BitTorrent-style. Users load part of a model and join a network of people serving its other parts. It supports generating text with Llama 3.1, Mixtral, Falcon and BLOOM and fine-tuning them on a consumer-grade GPU or Google Colab.
Ollama is a tool for running and building with open AI models locally or in the cloud on macOS, Windows and Linux. Its pricing page lists Free, Pro, Max, Team and Enterprise subscription plans, with paid plans including usage credits and cloud model access. The Free plan includes running models locally and starter usage credits.
LocalAI is described as an open source AI engine that runs models, including LLMs, vision, voice, image and video, on any hardware without a GPU. It presents itself as a drop-in replacement for most upstream APIs and includes a built-in agent platform powered by LocalAGI, whose agents can reason, use tools and maintain memory. Image generation with Stable diffusion on CPU is also supported.
