grab-site

grab-site is a web crawler developed by ArchiveTeam for web archiving. It outputs WARC files, offers a dashboard for monitoring all crawls, and supports dynamic ignore patterns to customize crawling behavior.

GitHub repo Directory import
0 shouts Added Sep 23, 2026 github.com
github.com/ArchiveTeam/grab-site
grab-site website preview

Links

Tags