Search results

Published directory entries matching your search.

Filters
Clear filters

Search results

11 listings
Preview unavailable

apple/ml-no-token-left-behind

PyTorch Implementation of No Token Left Behind: Explainability-Aided Image Classification and Generation.

AI Image Generation GitHub repo
Preview unavailable

Privacy Pass

Browser extension for privacy-preserving tokens that can reduce repeated CAPTCHA challenges.

Internet Utilities GitHub repo
Preview unavailable

Word Tokenizers

Tokenizers for Natural Language Processing in Julia.

Models & Machine Learning GitHub repo
Preview unavailable

promptext

Smart code context extractor for AI assistants with accurate token counting and budget management.

AI Assistants & Chatbots GitHub repo
Preview unavailable

science-skills

GDM Science Skills to speed up agentic scientific workflows with better grounding and higher token efficiency. Integrate insights from AlphaGenome, AFDB, UniProt and 30+ other databases and tools.

Google Communities & Tools GitHub repo
Preview unavailable

SentencePiece

A C++ library for unsupervised text tokenization and detokenization, widely used in modern NLP models.

Models & Machine Learning GitHub repo
Preview unavailable

sentences

Golang implementation of Punkt sentence tokenizer.

Models & Machine Learning GitHub repo
Preview unavailable

Shhgit

GitHub secret scanner that finds exposed tokens, keys, and sensitive strings in public code.

Code & Repository Search GitHub repo
Preview unavailable

shimmytok

Pure-Rust tokenizer for GGUF models, compatible with llama.cpp tokenization.

Models & Machine Learning GitHub repo
Preview unavailable

vaibkumr/prompt-optimizer

Minimize LLM token complexity to save API costs and model computations.

Models & Machine Learning GitHub repo