A Hugging Face blog post by Daniel Huynh describing an experiment assessing SelfCheckGPT NLI as a measure of LLM inconsistencies for predicting hallucinated outputs. It reports that scores were highly precise after a threshold and that a score of 0.8 corresponded to close to 80% of hallucinations being identified.
Petastorm
Petastorm is a library developed by Uber for deep learning model training and evaluation. It supports single-machine and distributed workflows with datasets in Apache Parquet format, is compatible with TensorFlow, PyTorch, and PySpark, and can be used via pure Python code.
Links
Tags
-
0A Hugging Face blog post by Daniel Huynh describing an experiment assessing SelfCheckGPT NLI as a measure of LLM inconsistencies for predicting hallucinated outputs. It reports that scores were highly precise after a threshold and that a score of 0.8 corresponded to close to 80% of hallucinations being identified.
-
0SillyTavern is a locally installed user interface for interacting with text generation LLMs, image generation engines and TTS voice models. It began in February 2023 as a fork of TavernAI 1.2.8 and is built around character cards, collections of prompts that set the behavior of the LLM. It is free and open-sourced.
-
0An Ahead of AI article by Sebastian Raschka sharing lessons from hundreds of experiments on finetuning LLMs with low-rank adaptation (LoRA), billed as an essential technique for efficiently training custom open-source LLMs. It covers LoRA consistency, QLoRA compute-memory trade-offs, learning rate schedulers, Adam versus SGD, multiple epochs, enabling LoRA for more layers, and balancing rank and alpha.
-
0Flux is a machine learning library built as a pure-Julia stack, offering lightweight abstractions over Julia's native GPU and automatic differentiation support. It is compiled and eager, and existing Julia libraries can be incorporated into Flux models. Its ecosystem includes probabilistic programming, graph neural networks, computer vision and natural language processing packages, and it is maintained by a community team.
-
0Magenta is an open source research project exploring the role of machine learning as a tool in the creative process, focused on art and music. It includes Magenta Studio, a collection of music plugins for Ableton Live, and Magenta RealTime 2, an open model and real-time neural synthesis engine.
-
0gotoHuman is a platform for supervising AI agents, letting workflows request human review of critical steps. Reviewers approve and edit AI-generated content in an Agent Inbox, with email and Slack notifications, and completed reviews return to the workflow via webhook. Review types are configured in a no-code editor and can capture text, images, markdown and JSON.
Community notes
Reviews and discussion
No reviews yet
Be the first to share how this project worked for you.
Join the discussion
Sign in with a verified account to leave a review or join the discussion.
Sign in to review