LLMFlows is a Python framework for building LLM applications such as chatbots, question-answering systems and agents. It provides abstractions for using LLMs and vector stores, with explicit classes that avoid hidden prompts or LLM calls, aiming to make monitoring, maintenance and debugging easier.
TavernAI 2 is a desktop AI roleplay chat app distributed as a portable app for Windows and Linux, also installable on a VPS. It runs models locally or connects to built-in and custom AI provider integrations, with branching chats, dynamic participants, a Prompt Manager, and custom AI games.
Petals is a project for running large language models at home, BitTorrent-style. Users load part of a model and join a network of people serving its other parts. It supports generating text with Llama 3.1, Mixtral, Falcon and BLOOM and fine-tuning them on a consumer-grade GPU or Google Colab.
SiteGPT is a platform that builds custom AI customer support chatbots trained on a website's content. The chatbots answer visitor questions, support over 95 languages, and can be used for lead generation. The service integrates with various tools and provides features such as a knowledge base, multichannel support, and an onboarding process.
Ollama is a tool for running and building with open AI models locally or in the cloud on macOS, Windows and Linux. Its pricing page lists Free, Pro, Max, Team and Enterprise subscription plans, with paid plans including usage credits and cloud model access. The Free plan includes running models locally and starter usage credits.
EmailTriager is described as an AI assistant that automatically organizes incoming emails and drafts ready-to-send replies in the background. It plugs into Gmail and trains on past emails, creating a Knowledge Base used to draft responses. The site states that EmailTriager never sends emails on the user's behalf and only drafts responses for review and sending.
KoboldAI presents tools for local AI use. KoboldCPP is a local LLM API server for driving a backend, and KoboldAI Lite is a lightweight interface for accessing AI API endpoints. KoboldAI.net delivers KoboldAI Lite as a free web service. Downloads for KoboldCPP are offered for Windows, Linux and Mac, and community support is available on Discord.
Community notes
Be the first to share how this project worked for you.
Sign in with a verified account to leave a review or join the discussion.
Sign in to reviewKeep exploring
TavernAI 2 is a desktop AI roleplay chat app distributed as a portable app for Windows and Linux, also installable on a VPS. It runs models locally or connects to built-in and custom AI provider integrations, with branching chats, dynamic participants, a Prompt Manager, and custom AI games.
Petals is a project for running large language models at home, BitTorrent-style. Users load part of a model and join a network of people serving its other parts. It supports generating text with Llama 3.1, Mixtral, Falcon and BLOOM and fine-tuning them on a consumer-grade GPU or Google Colab.
SiteGPT is a platform that builds custom AI customer support chatbots trained on a website's content. The chatbots answer visitor questions, support over 95 languages, and can be used for lead generation. The service integrates with various tools and provides features such as a knowledge base, multichannel support, and an onboarding process.
Ollama is a tool for running and building with open AI models locally or in the cloud on macOS, Windows and Linux. Its pricing page lists Free, Pro, Max, Team and Enterprise subscription plans, with paid plans including usage credits and cloud model access. The Free plan includes running models locally and starter usage credits.
EmailTriager is described as an AI assistant that automatically organizes incoming emails and drafts ready-to-send replies in the background. It plugs into Gmail and trains on past emails, creating a Knowledge Base used to draft responses. The site states that EmailTriager never sends emails on the user's behalf and only drafts responses for review and sending.
KoboldAI presents tools for local AI use. KoboldCPP is a local LLM API server for driving a backend, and KoboldAI Lite is a lightweight interface for accessing AI API endpoints. KoboldAI.net delivers KoboldAI Lite as a free web service. Downloads for KoboldCPP are offered for Windows, Linux and Mac, and community support is available on Discord.
