A blog guide on FinetuneDB covering best practices for evaluating Large Language Model outputs. It explains what LLM output evaluation is, why it matters, and describes evaluation datasets, model-based judgments and human judgments as approaches for structuring the process.
Directory
Search results
Published directory entries matching your search.
huggingface.co
This is a Hugging Face Space created by AllenAI that hosts an interactive RewardBench leaderboard. Users can filter the leaderboard by model name pattern or model type to view scores for each model across RewardBench evaluation categories, and can download the full evaluation results.
This is a blog post from Confident AI that serves as a guide to LLM evaluation metrics. It covers retrieval-augmented generation (RAG) metrics such as faithfulness and answer relevancy, agent metrics, LLM-as-a-judge approaches, and includes working DeepEval code examples.
blogs.nvidia.com
The Guide to LLM Evaluation Deci provides machine-learning models, research, training resources, or evaluation tools.
aimultiple.com
This webpage provides a curated list of large language model examples, alongside insights on business adoption, language model training, and influential models. It includes comparative analysis of leading LLMs such as OpenAI’s GPT-5, Claude 4.6, Gemini, DeepSeek-R1, Qwen, Llama 4, and xAI Grok-4 and Grok-4.1.
llm-eval.github.io
Research on evaluation of LLMs conducted by Microsoft Research and other collaborated institutes. (Updated at: 2023/10).
airtrain.ai
No-code batch compute platform for LLM evaluation and tuning workloads.
docs.clarifai.com
Documentation for LLM Evaluation Clarifai Guide, covering setup, features, and practical usage.
huggingface.co
The Open VLM Leaderboard is an interactive Hugging Face Space that displays the Open VLM main leaderboard and individual dataset leaderboards. Users can filter results by evaluation dimensions, model size, model type and other related criteria.
promptlayer.com
PromptLayer is a prompt management platform for AI engineering teams. It offers prompt versioning, large language model evaluation tools, and AI agent observability via tracing, logs, and regression sets, plus a visual editor for prompt iteration and collaboration.
huggingface.co
VBench is a Hugging Face Space created by Vchitect that hosts a leaderboard for AI video generation models. Users can upload a zip file with their model's evaluation JSON files and provide details such as model name, link, team, and contact email. The application extracts the metrics and updates the benchmark leaderboard accordingly.
ernie.baidu.com
ERNIE is Baidu's blog covering its model releases. Posts describe ERNIE 5.1, a model trained with disaggregated fully-asynchronous reinforcement learning and scaled agentic post-training, and ERNIE 5.0, a 2.4 trillion-parameter unified multimodal model trained from scratch that integrates text, image, video and audio in a single autoregressive framework. ERNIE-Image is a text-to-image generation model built on a single-stream Diffusion Transformer.
huggingface.co
LLM Model VRAM Calculator is a Hugging Face Space created by NyxKrage. The tool allows users to input a Hugging Face model name, select a target GPU, set context length and quantization options, then calculates the model's required memory size and context buffer capacity to aid LLM deployment planning.
scaler.com
This is a Scaler blog category page collecting articles on artificial intelligence and machine learning. Posts listed include MLOps projects, becoming an AI research scientist, model drift detection and monitoring, and retrieval-augmented generation evaluation metrics. The page also links to categories such as software development and data science, and offers career counselling.
deepseek.com
DeepSeek provides machine-learning models, research, training resources, or evaluation tools.
humanloop.com
Humanloop was a development platform for LLM applications that provided management and evaluation of AI applications. The team announced it is joining Anthropic, and the Humanloop platform is to be sunset on September 8th, 2025. A migration guide covers exporting Files, Versions, Logs and Evaluations.
hume.ai
Hume provides voice AI evaluation infrastructure through its VoiceEQ platform. It turns real-world use cases into targeted evaluation suites and combines automated measurement with human judgment to diagnose failures in voice models and agents. The platform covers TTS, speech-to-speech, ASR, and cascaded systems, and the company reports support for over 50 languages.
docs.ragas.io
Ragas is a library for evaluating Large Language Model applications, described as moving from manual checks to systematic evaluation loops. It offers LLM-driven metrics, custom metrics, an experiments-first approach, and built-in dataset management and integration with frameworks such as LangChain and LlamaIndex.
huggingface.co
A blog article about red-teaming large language models, described as a form of evaluation that elicits model vulnerabilities that might lead to undesirable behaviors. It discusses undesirable behaviors such as revealing personal information, misinformation, bias, hatefulness and toxic content, and compares red-teaming with adversarial attacks. It notes that red-teaming prompts look like regular natural language prompts.
teamorouter.com
TeamoRouter provides machine-learning models, research, training resources, or evaluation tools.
lmcouncil.ai
LM Council presents source-dated benchmark snapshots for AI models. It covers GPT, Claude, Gemini and other frontier models across benchmarks including Humanity's Last Exam, FrontierMath, GPQA and SWE-bench, with a comparison tool selecting two models. Each snapshot links its source and checked date, and evaluation settings and metrics vary.
qwenlm.github.io
Qwen is an AI project whose site lists models including Qwen3Guard, a safety guardrail model built on Qwen3 foundation models for detecting risk in prompts and responses. It also lists Qwen-Image-Edit, an image editing version of a 20B Qwen-Image model, and Qwen-MT, a translation model via Qwen API supporting 92 languages.
brev.nvidia.com
A simple guide to fine-tuning Llama 2 Brev docs provides machine-learning models, research, training resources, or evaluation tools.
ability.ai
Ability AI provides machine-learning models, research, training resources, or evaluation tools.