Search results

A

apple/ml-no-token-left-behind

PyTorch Implementation of No Token Left Behind: Explainability-Aided Image Classification and Generation.

AI Image Generation GitHub repo

P

Privacy Pass

Browser extension for privacy-preserving tokens that can reduce repeated CAPTCHA challenges.

Internet Utilities GitHub repo

W

Word Tokenizers

Tokenizers for Natural Language Processing in Julia.

Models & Machine Learning GitHub repo

S

science-skills

GDM Science Skills to speed up agentic scientific workflows with better grounding and higher token efficiency. Integrate insights from AlphaGenome, AFDB, UniProt and 30+ other databases and tools.

Google Communities & Tools GitHub repo

P

promptext

Smart code context extractor for AI assistants with accurate token counting and budget management.

AI Assistants & Chatbots GitHub repo

S

SentencePiece

A C++ library for unsupervised text tokenization and detokenization, widely used in modern NLP models.

Models & Machine Learning GitHub repo

S

sentences

Golang implementation of Punkt sentence tokenizer.

Models & Machine Learning GitHub repo

S

Shhgit

GitHub secret scanner that finds exposed tokens, keys, and sensitive strings in public code.

Code & Repository Search GitHub repo

S

shimmytok

Pure-Rust tokenizer for GGUF models, compatible with llama.cpp tokenization.

Models & Machine Learning GitHub repo

T

tiktok-signature

Generate tiktok signature token using node

TikTok GitHub repo

V

vaibkumr/prompt-optimizer

Minimize LLM token complexity to save API costs and model computations.

Models & Machine Learning GitHub repo

C

CKAN

Open-source DMS (data management system) for powering data hubs and data portals.

AI Data & Analytics GitHub repo

K

kuwala

Kuwala is the no-code data platform for BI analysts and engineers enabling you to build powerful analytics workflows. We are set out to bring state-of-the-art data engineering tools you love, such as Airbyte, dbt, or Great Expectations together in one intuitive interface built with React Flow. In addition we provide third-party data into data science models and products with a focus on geospatial data. Currently, the following data connectors are available worldwide: a) High-resolution demograph

Google Communities & Tools GitHub repo

M

Magda

A federated, open-source data catalog for all your big data and small data.

AI Data & Analytics GitHub repo

A

AWS Data Wrangler

Open-source project that applies AI to data analysis, extraction, visualization, or business intelligence.

AI Data & Analytics GitHub repo

C

ChatGPT Prompts for Data Science

A repository of useful data science prompts for ChatGPT.

AI Data & Analytics GitHub repo

D

Data Science Lifecycle Template Repo

Template repository for data science lifecycle project.

AI Data & Analytics GitHub repo

D

DVC

Data Version Control - Git for Data & Models - ML Experiments Management.

AI Data & Analytics GitHub repo

I

Intake

A lightweight set of tools for loading and sharing data in data science projects.

AI Data & Analytics GitHub repo

I

Intel® oneAPI Data Analytics Library

Open-source project that applies AI to data analysis, extraction, visualization, or business intelligence.

AI Data & Analytics GitHub repo

K

Koalas

Pandas API on Apache Spark. Makes data scientists more productive when interacting with big data.

AI Data & Analytics GitHub repo

L

Lux

Fast and easy data exploration by automating the visualization and data analysis process.

AI Data & Analytics GitHub repo

M

MeTA

MeTA: ModErn Text Analysis is a C++ Data Sciences Toolkit that facilitates mining big text data.

AI Data & Analytics GitHub repo

P

Piperider

CLI tool that allows you to build data profiles and write assertion tests for easily evaluating and tracking your data's reliability over time.

AI Data & Analytics GitHub repo