Directory
Published directory entries matching your search.
The SEAL LLM Leaderboard is a resource from Scale Labs that provides expert-driven benchmarks and updated rankings for large language models. It evaluates capabilities including agentic coding, frontier reasoning, and safety alignment, with over 20 benchmarks and assessments of more than 100 models from leading AI labs and open-source contributors.
State of LLM Apps 2023 · Streamlit provides machine-learning models, research, training resources, or evaluation tools.
TensorZero builds open-source tools for production-grade LLM applications, including an LLM gateway, observability, optimization, evaluations, and experimentation. The project remains available on GitHub but is no longer maintained. Its website is tensorzero.com.
The Hugging Face Open LLM Leaderboard provides machine-learning models, research, training resources, or evaluation tools.
The Guide to LLM Evaluation Deci provides machine-learning models, research, training resources, or evaluation tools.
Wiki LLM List is a Wikipedia article that catalogs large language models, organized chronologically by release year from 2018 to 2026. The entry includes a structured list of these AI models, supporting references, and links to related content.
Agentic Signal is an open source visual AI agent workflow automation platform with local large language model (LLM) integration. It lets users build intelligent workflows via a drag-and-drop interface without requiring cloud dependencies. The repository includes a demo video, feature list, and visual workflow builder documentation.
Start building LLM-empowered multi-agent applications in an easier way.
A newsletter post by Jon Stokes introducing the concepts behind AgentGPT, BabyAGI, LangChain and LLM-powered agents. It covers core agent concepts, how LLMs make plans, chain of thought reasoning, action planning, and example prompt-response pairs.
AnythingLLM is an all-in-one AI application for chatting with documents, using AI agents, and connecting local or cloud LLMs. It includes a built-in local LLM engine, vector databases, document pipelines, multi-user support, and a no-code agent builder. It is distributed under an MIT license.
Awesome LLM Resources is a GitHub-hosted curated list of resources for applied AI engineering. The collection is marked as a work in progress and aggregates relevant materials for applied AI engineering work.
Awesome-Code-LLM is a curated list of code large language models for research, covering top code LLMs, evaluation toolkits, leaderboards and related papers. It also lists evaluation frameworks for autoregressive code generation models and a secure sandbox for judging generated code.
An open-source LLM gateway with routing, load balancing, guardrails, and observability for 1000+ models. opensource.
Awesome-Code-LLM is a curated list of language modeling research for code and other software engineering activities, plus related datasets. The GitHub repository is marked TMLR and links to an arXiv paper.
An open-source project that provides tools to debug, evaluate, and monitor large language model (LLM) applications, retrieval-augmented generation (RAG) systems, and agentic workflows, with features including comprehensive tracing, automated evaluations, and production-ready dashboards.
A curation of awesome tools, documents and projects about LLM Security.
A market intelligence site for AI compute that tracks live GPU cloud and LLM API pricing, performance benchmarks and market data across AI infrastructure providers. It publishes comparisons of GPU cloud pricing by provider and of LLM performance versus cost, including articles on Azure, AWS, Google Cloud, CoreWeave and Lambda GPU offerings.
Uncover LLM evaluation's importance and explore methods for assessing its performance and impact across industries.
Collection of patterns for experimenting with agents, llm pipelines, and ChainOfThoughtStrategy.
FEDSTR is a proposed approach on the NOSTR protocol for a decentralized marketplace for federated learning and LLM training. Customers provide a dataset for training an AI model; service providers receive parts of the dataset, train the model, and return the optimized model in exchange for payment. A proof-of-concept implementation over public NOSTR relays is presented.
FlowiseAI is an open source generative AI development platform for visually building AI agents and LLM orchestration systems. It offers features including multi-agent workflow orchestration, chat assistants with retrieval-augmented generation support, human-in-the-loop task review, execution tracing, and APIs, SDKs and embedded chat options for integration. The project notes it is being sunset.
Cloud-Native LLM Routing Engine. Improve LLM app resilience and speed.
An LLM by xAI with open source and open weights. opensource.
A curated list of Large Language Model.
