An open-source LLM gateway with routing, load balancing, guardrails, and observability for 1000+ models. opensource.
Directory
Search results
Published directory entries matching your search.
Track, log, visualize and evaluate your LLM prompts and prompt chains.
A curation of awesome tools, documents and projects about LLM Security.
Production-grade SDK for observability, automated evaluations and prompt management with sub-100ms guardrails for LLM/agent workflows.
Cloud-Native LLM Routing Engine. Improve LLM app resilience and speed.
A curated list of Large Language Model.
Developer-friendly, serverless vector database for AI applications. Easily add long-term memory to your LLM apps!
LLM App is a Python library that helps you build real-time AI-powered data pipelines with few lines of code.
LLMFlows is a framework for building simple, explicit, and transparent LLM applications such as chatbots, question-answering systems, and agents.
Chinese LLM, Based on LLaMA and fine tune by Stanford Alpaca, Alpaca LoRA, Japanese-Alpaca-LoRA.
A chat LLM based on the state-space model architecture.
Integrate LLM technology quickly and easily into your apps.
The simplest way to run an LLM locally. Supports tool calling and grammar constrained sampling.
A list of open LLMs available for commercial use.
Grok - An LLM by xAI with and open weights. opensource.
Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.
Create customized software using natural language idea (through llm-powered multi-agent collaboration).
Open-source GenAI and LLM observability platform native to OpenTelemetry with traces and metrics. opensource.
Vector database plugin for Postgres, written in Rust, specifically designed for LLM.
File Parser optimised for LLM Ingestion with no loss. Parse PDFs, Docx, PPTx in a format that is ideal for LLMs.
OpenAI-compatible LLM inference server for Apple Silicon using MLX. 2-4x faster than Ollama with tool calling and prompt caching.
RasaGPT is the first headless LLM chatbot platform built on top of Rasa and Langchain.
OpenTelemetry-based observability and monitoring for LLM and agents workflows.
"leaderboard Comparing LLM Performance at Producing Hallucinations when Summarizing Short Documents".