The Guide to LLM Evaluation Deci provides machine-learning models, research, training resources, or evaluation tools.
Chain of Thought is a podcast hosted by Conor Bronsdon about AI and software infrastructure, featuring conversations with people building AI agents and infrastructure. Guests include people from NVIDIA, Google DeepMind, AMD, Databricks and Vercel. The show has 78 episodes and is available on YouTube, Spotify, Apple Podcasts and RSS.
The MXNet Clojure package brings GPU computing and deep learning to the Clojure programming language. It enables tensor and matrix computation with multiple GPUs in Clojure, and allows constructing and customizing deep learning models for tasks such as image classification and data science challenges.
MALLET is a Java-based package for statistical natural language processing, document classification, clustering, topic modeling, information extraction, and other machine learning applications to text. It includes tools for converting text to features, classifiers such as Naïve Bayes, Maximum Entropy and Decision Trees, sequence tagging with Hidden Markov Models and Conditional Random Fields, and sampling-based topic model implementations.
Annotated talk slides by Arvind Narayanan and Sayash Kapoor of Princeton University, dated October 4, 2023, on evaluating large language models. The slides discuss three hard problems in LLM evaluation: prompt sensitivity, construct validity and contamination, and examine questions about ChatGPT's behavior over time and its political bias.
Apache SINGA is an Apache Top Level Project focused on distributed training of deep learning and machine learning models. It supports data parallel training across multiple GPUs on a single node or across different nodes, automatic gradient calculation, and loading and saving ONNX format models. Models trained with SINGA can be queried as stored procedures in an RDBMS.
Charisma.ai is a conversational AI platform for building interactive scenarios for online training and campaigns. It offers realistic conversation simulations and real-time analytics on engagement, with publication to web, VR or game engine experiences through SDKs. Plans include a pay-as-you-go option and an enterprise tier with development options.
Community notes
Be the first to share how this project worked for you.
Sign in with a verified account to leave a review or join the discussion.
Sign in to reviewKeep exploring
Chain of Thought is a podcast hosted by Conor Bronsdon about AI and software infrastructure, featuring conversations with people building AI agents and infrastructure. Guests include people from NVIDIA, Google DeepMind, AMD, Databricks and Vercel. The show has 78 episodes and is available on YouTube, Spotify, Apple Podcasts and RSS.
The MXNet Clojure package brings GPU computing and deep learning to the Clojure programming language. It enables tensor and matrix computation with multiple GPUs in Clojure, and allows constructing and customizing deep learning models for tasks such as image classification and data science challenges.
MALLET is a Java-based package for statistical natural language processing, document classification, clustering, topic modeling, information extraction, and other machine learning applications to text. It includes tools for converting text to features, classifiers such as Naïve Bayes, Maximum Entropy and Decision Trees, sequence tagging with Hidden Markov Models and Conditional Random Fields, and sampling-based topic model implementations.
Annotated talk slides by Arvind Narayanan and Sayash Kapoor of Princeton University, dated October 4, 2023, on evaluating large language models. The slides discuss three hard problems in LLM evaluation: prompt sensitivity, construct validity and contamination, and examine questions about ChatGPT's behavior over time and its political bias.
Apache SINGA is an Apache Top Level Project focused on distributed training of deep learning and machine learning models. It supports data parallel training across multiple GPUs on a single node or across different nodes, automatic gradient calculation, and loading and saving ONNX format models. Models trained with SINGA can be queried as stored procedures in an RDBMS.
Charisma.ai is a conversational AI platform for building interactive scenarios for online training and campaigns. It offers realistic conversation simulations and real-time analytics on engagement, with publication to web, VR or game engine experiences through SDKs. Plans include a pay-as-you-go option and an enterprise tier with development options.
