Directory
Published directory entries matching your search.
Candle is a minimalist machine learning framework for Rust with a focus on performance, including GPU support, and ease of use. It provides examples and online browser demos for models such as whisper, LLaMA2, T5, yolo and Segment Anything.
A toolkit for deploying and serving open source text embeddings and sequence classification models. It supports models including FlagEmbedding, Ember, GTE and E5, and features token based dynamic batching, Flash Attention and Candle optimized inference, Safetensors and ONNX weight loading, and Metal support for local execution on Macs.
