ANEE

ANEE is an experimental dynamic inference wrapper for pretrained Transformer language models, currently GPT-2. It exposes an energy_budget and performs early exit inside the model's forward pass rather than always running all layers. It adds per-token adaptive computation using a profiler and learned controller to skip redundant layers while keeping the KV-cache aligned.

GitHub repo Directory import
0 shouts Added Sep 23, 2026 github.com
github.com/abkmystery/ANEE
ANEE website preview

Features

  • exposes an energy_budget and performs early exit inside the model’s forward pass Source: github.com

Links

Tags