naklecha/llama3-from-scratch

A notebook project that implements llama3 from scratch, one tensor and matrix multiplication at a time. It loads tensors directly from the model file Meta provided for llama3, and the weights must be downloaded before running the file. The author does not implement a BPE tokenizer and instead uses tiktoken.

GitHub repo Directory import
0 shouts Added Sep 23, 2026 github.com
github.com/naklecha/llama3-from-scratch
naklecha/llama3-from-scratch website preview

Limitations

  • you need to download the weights before running this file Source: github.com

Links

Tags