github.com
Agent Framework / shim to use Pydantic with LLMs.
Directory
Published directory entries matching your search.
Agent Framework / shim to use Pydantic with LLMs.
Python-free Rust inference server with OpenAI API compatibility and hot model swapping.
Pure-Rust tokenizer for GGUF models, compatible with llama.cpp tokenization.