Repository containing the source code of the Python package loralib and examples of integrating it with PyTorch models, such as those in Hugging Face. LoRA learns pairs of rank-decomposition matrices while freezing the original weights, reducing the number of trainable parameters. PyTorch is the only supported framework for now.
An Ahead of AI article by Sebastian Raschka sharing lessons from hundreds of experiments on finetuning LLMs with low-rank adaptation (LoRA), billed as an essential technique for efficiently training custom open-source LLMs. It covers LoRA consistency, QLoRA compute-memory trade-offs, learning rate schedulers, Adam versus SGD, multiple epochs, enabling LoRA for more layers, and balancing rank and alpha.
Flux is a machine learning library built as a pure-Julia stack, offering lightweight abstractions over Julia's native GPU and automatic differentiation support. It is compiled and eager, and existing Julia libraries can be incorporated into Flux models. Its ecosystem includes probabilistic programming, graph neural networks, computer vision and natural language processing packages, and it is maintained by a community team.
Magenta is an open source research project exploring the role of machine learning as a tool in the creative process, focused on art and music. It includes Magenta Studio, a collection of music plugins for Ableton Live, and Magenta RealTime 2, an open model and real-time neural synthesis engine.
gotoHuman is a platform for supervising AI agents, letting workflows request human review of critical steps. Reviewers approve and edit AI-generated content in an Agent Inbox, with email and Slack notifications, and completed reviews return to the workflow via webhook. Review types are configured in a no-code editor and can capture text, images, markdown and JSON.
An index page from LabLab for discovering AI technologies and related topics. Each technology page is described as offering tutorials, upcoming hackathons, frameworks and boilerplates. Listed technologies include GPT-4, ChatGPT, BERT, AI21 Labs, Anthropic, AWS, Cohere, Hugging Face and DeepSeek.
Accord.NET is a .NET machine learning framework combined with audio and image processing libraries written in C#. It covers classification, regression, clustering, distributions, hypothesis tests and kernel methods, with imaging and signal processing components. The framework is intended for building computer vision, audition, signal processing and statistics applications, including commercial use. It offers sample applications, documentation and a wiki.
Community notes
Be the first to share how this project worked for you.
Sign in with a verified account to leave a review or join the discussion.
Sign in to reviewKeep exploring
An Ahead of AI article by Sebastian Raschka sharing lessons from hundreds of experiments on finetuning LLMs with low-rank adaptation (LoRA), billed as an essential technique for efficiently training custom open-source LLMs. It covers LoRA consistency, QLoRA compute-memory trade-offs, learning rate schedulers, Adam versus SGD, multiple epochs, enabling LoRA for more layers, and balancing rank and alpha.
Flux is a machine learning library built as a pure-Julia stack, offering lightweight abstractions over Julia's native GPU and automatic differentiation support. It is compiled and eager, and existing Julia libraries can be incorporated into Flux models. Its ecosystem includes probabilistic programming, graph neural networks, computer vision and natural language processing packages, and it is maintained by a community team.
Magenta is an open source research project exploring the role of machine learning as a tool in the creative process, focused on art and music. It includes Magenta Studio, a collection of music plugins for Ableton Live, and Magenta RealTime 2, an open model and real-time neural synthesis engine.
gotoHuman is a platform for supervising AI agents, letting workflows request human review of critical steps. Reviewers approve and edit AI-generated content in an Agent Inbox, with email and Slack notifications, and completed reviews return to the workflow via webhook. Review types are configured in a no-code editor and can capture text, images, markdown and JSON.
An index page from LabLab for discovering AI technologies and related topics. Each technology page is described as offering tutorials, upcoming hackathons, frameworks and boilerplates. Listed technologies include GPT-4, ChatGPT, BERT, AI21 Labs, Anthropic, AWS, Cohere, Hugging Face and DeepSeek.
Accord.NET is a .NET machine learning framework combined with audio and image processing libraries written in C#. It covers classification, regression, clustering, distributions, hypothesis tests and kernel methods, with imaging and signal processing components. The framework is intended for building computer vision, audition, signal processing and statistics applications, including commercial use. It offers sample applications, documentation and a wiki.
