text-embeddings-inference

A toolkit for deploying and serving open source text embeddings and sequence classification models. It supports models including FlagEmbedding, Ember, GTE and E5, and features token based dynamic batching, Flash Attention and Candle optimized inference, Safetensors and ONNX weight loading, and Metal support for local execution on Macs.

GitHub repo Directory import
0 shouts Added Sep 23, 2026 github.com
github.com/huggingface/text-embeddings-inference
text-embeddings-inference website preview

Features

  • a toolkit for deploying and serving open source text embeddings and sequence classification models Source: github.com

Links

Tags