Directory
Published directory entries matching your search.
Sophon is an AI research paper platform. It showcases trending AI research papers, with each paper linked to the benchmarks, methods and models it introduces. The platform's filtering view covers the 2,000 most recent papers, and it maintains a full index of 22,445 papers.
StudyForrest is a dataset collection built around the movie Forrest Gump, providing reproducible complex sensory input for brain research. It includes fMRI scans, structural brain scans, eye-tracking data and extensive annotations of the movie. The project offers reference datasets for benchmarking brain imaging algorithms and for studying cognition under natural stimulation.
SWE-bench is a benchmark for evaluating large language models on real-world software issues collected from GitHub. Given a codebase and an issue, a language model generates a patch that resolves the described problem.
TestUFO is a web-based tool that provides motion and display benchmarks for monitors and screens. It offers tests for ghosting, frame rate comparisons, PWM, motion blur, judder, and other display performance metrics.
The Pile is an 825 GiB open source language modelling data set made of 22 smaller high-quality datasets combined together. It is offered as a training set and as a benchmark, and is distributed as jsonlines data compressed with zstandard.
A visualisation of major large-language models ranked by performance using the MMLU benchmark, which consists of 16,000 multiple-choice questions across 57 academic subjects. It also presents selected lawsuits filed against AI companies and notes that MMLU has some critiques.
TruLens instruments your AI agent with OpenTelemetry, scores every step with benchmarked LLM judges, and tells you which version to ship.
VBench is a Hugging Face Space created by Vchitect that hosts a leaderboard for AI video generation models. Users can upload a zip file with their model's evaluation JSON files and provide details such as model name, link, team, and contact email. The application extracts the metrics and updates the benchmark leaderboard accordingly.
Voltaic is an educational community and elite aiming team focused on improvement, aim and esports talent in first-person shooter games. It offers aim benchmarks and FPS and aim resources, and hosts tournaments, competitions and benchmark rankings.
VRP-REP is a collaborative open-data platform for sharing vehicle routing problem benchmark instances and solutions. Users can upload VRP instances, share them publicly or privately with referees and editors during review, and download instances shared by other users.
The Wolfram LLM Benchmarking Project is an ongoing initiative that tracks large language model performance using a benchmark centered on Wolfram Language code generation tasks. It publishes the results of its ongoing performance tracking for LLMs.
