github.com
Open-source project that provides machine-learning models, research, training resources, or evaluation tools.
Directory
Search results
Published directory entries matching your search.
Filters
deepseek.com
DeepSeek provides machine-learning models, research, training resources, or evaluation tools.
github.com
Open-source project that provides machine-learning models, research, training resources, or evaluation tools.
github.com
Open-source project that provides machine-learning models, research, training resources, or evaluation tools.
github.com
Open-source project that provides machine-learning models, research, training resources, or evaluation tools.
github.com
Hera is a GitHub repository that enables training and evaluation of Keras models, with model metrics streamed to a browser-based dashboard. It includes setup steps for installing the spy component, starting the server, and launching the dashboard.
humanloop.com
Humanloop was a development platform for LLM applications that provided management and evaluation of AI applications. The team announced it is joining Anthropic, and the Humanloop platform is to be sunset on September 8th, 2025. A migration guide covers exporting Files, Versions, Logs and Evaluations.
hume.ai
Hume provides voice AI evaluation infrastructure through its VoiceEQ platform. It turns real-world use cases into targeted evaluation suites and combines automated measurement with human judgment to diagnose failures in voice models and agents. The platform covers TTS, speech-to-speech, ASR, and cascaded systems, and the company reports support for over 50 languages.
github.com
Hyperas is a wrapper that combines Keras model definition with Hyperopt hyperparameter optimization. Users define models as usual and wrap parameters in double curly brackets with a chosen distribution. It is installed via pip and runs optimization using algorithms such as TPE with a set number of evaluation runs.
github.com
ChainForge is an open-source visual programming environment for battle-testing prompts to large language models. It supports querying multiple models at once, comparing response quality across prompts, models and model settings, and setting evaluation metrics to visualize results. Built on ReactFlow and Flask, it can be installed locally with pip or tried on the web, where features are limited.
github.com
Open-source project that provides machine-learning models, research, training resources, or evaluation tools.
Open-source project that provides machine-learning models, research, training resources, or evaluation tools.
github.com
A collection of tutorials and examples for solving and understanding machine learning and pattern classification tasks. Materials are organized into sections covering preprocessing, model evaluation, parameter estimation, algorithms, clustering and data visualization.
github.com
Petastorm is a library developed by Uber for deep learning model training and evaluation. It supports single-machine and distributed workflows with datasets in Apache Parquet format, is compatible with TensorFlow, PyTorch, and PySpark, and can be used via pure Python code.
github.com
Open-source project that provides machine-learning models, research, training resources, or evaluation tools.
docs.ragas.io
Ragas is a library for evaluating Large Language Model applications, described as moving from manual checks to systematic evaluation loops. It offers LLM-driven metrics, custom metrics, an experiments-first approach, and built-in dataset management and integration with frameworks such as LangChain and LlamaIndex.
github.com
Open-source project that provides machine-learning models, research, training resources, or evaluation tools.
huggingface.co
A blog article about red-teaming large language models, described as a form of evaluation that elicits model vulnerabilities that might lead to undesirable behaviors. It discusses undesirable behaviors such as revealing personal information, misinformation, bias, hatefulness and toxic content, and compares red-teaming with adversarial attacks. It notes that red-teaming prompts look like regular natural language prompts.
github.com
Open-source project that provides machine-learning models, research, training resources, or evaluation tools.
teamorouter.com
TeamoRouter provides machine-learning models, research, training resources, or evaluation tools.
github.com
xTuring is an open-source project for building, personalizing, and controlling LLMs, covering data pre-processing through fine-tuning. It includes a simple API for data prep, training, and inference, LoRA and low-precision (INT8/INT4) support, and built-in evaluation metrics such as perplexity. Models can run locally or in a private VPC and scale from CPU to multi-GPU.
github.com
BELLE, short for Be Everyone's Large Language model Engine, is an open-source Chinese conversational large language model hosted on GitHub by LianjiaTech. The project provides relevant training code and open datasets for the model.
github.com
LLMKube is a Kubernetes operator for self-hosted large language model inference across heterogeneous GPU fleets supporting NVIDIA CUDA, AMD Vulkan, and Apple Silicon Metal. It supports runtimes including llama.cpp, vLLM, TGI, and mlx-server, offers multi-GPU sharding, model caching, and OpenAI-compatible endpoints. It is licensed under Apache-2.0 and designed for homelab and on-prem fleet deployment, and is actively developed.
lmcouncil.ai
LM Council presents source-dated benchmark snapshots for AI models. It covers GPT, Claude, Gemini and other frontier models across benchmarks including Humanity's Last Exam, FrontierMath, GPQA and SWE-bench, with a comparison tool selecting two models. Each snapshot links its source and checked date, and evaluation settings and metrics vary.