A web tool for choosing an AI model that fits a given GPU. Users select a GPU or enter VRAM, then check compatibility by VRAM, bandwidth, and context size. Minimum context window, tokens per second, and required features can be set, and optional system RAM enables offloading to extend context windows or run larger models at reduced speed.
Intro
Intro provides conversational AI for questions, tasks, and general assistance.
Links
Tags
-
0
A web tool for choosing an AI model that fits a given GPU. Users select a GPU or enter VRAM, then check compatibility by VRAM, bandwidth, and context size. Minimum context window, tokens per second, and required features can be set, and optional system RAM enables offloading to extend context windows or run larger models at reduced speed.
-
0KoboldAI presents tools for local AI use. KoboldCPP is a local LLM API server for driving a backend, and KoboldAI Lite is a lightweight interface for accessing AI API endpoints. KoboldAI.net delivers KoboldAI Lite as a free web service. Downloads for KoboldCPP are offered for Windows, Linux and Mac, and community support is available on Discord.
-
0EmailTriager is described as an AI assistant that automatically organizes incoming emails and drafts ready-to-send replies in the background. It plugs into Gmail and trains on past emails, creating a Knowledge Base used to draft responses. The site states that EmailTriager never sends emails on the user's behalf and only drafts responses for review and sending.
-
0The AI assistant that actually does the work, not just writes drafts. See how one entrepreneur manages 5 businesses with 15 hours per week.
-
0Vicuna-13B is an open-source chatbot trained by fine-tuning LLaMA on user-shared conversations collected from ShareGPT. Its code, weights and an online demo are publicly available for non-commercial use, and training cost around $300. The team reports a preliminary GPT-4-judged evaluation, described as non-scientific, showing more than 90% quality of ChatGPT and Bard.
-
0TavernAI 2 is a desktop AI roleplay chat app distributed as a portable app for Windows and Linux, also installable on a VPS. It runs models locally or connects to built-in and custom AI provider integrations, with branching chats, dynamic participants, a Prompt Manager, and custom AI games.
Community notes
Reviews and discussion
No reviews yet
Be the first to share how this project worked for you.
Join the discussion
Sign in with a verified account to leave a review or join the discussion.
Sign in to review