S S Shimmy github.com Python-free Rust inference server with OpenAI API compatibility and hot model swapping. AI Infrastructure & MLOps MLOps 0
S S shimmytok github.com Pure-Rust tokenizer for GGUF models, compatible with llama.cpp tokenization. Models & Machine Learning machine learning 0