Search results

Published directory entries matching your search.

Search results

3 listings

All New Top Verified makers Featured

Filters

Heritrix

heritrix.readthedocs.io

Heritrix is a web archiving or scraping tool for saving pages, data, or online content.

Internet Utilities 0

Heritrix3

github.com

Heritrix is the Internet Archive's open-source web crawler project, described as extensible, web-scale and archival-quality. It is designed to respect robots.txt exclusion directives and META nofollow tags. Documentation covers getting started, operating, configuring crawl jobs and the REST API. It is free software under the Apache License, Version 2.0, with some files under other licenses.

Internet Utilities 0

WAIL

machawk1.github.io

WAIL (Web Archiving Integration Layer) is a desktop application that provides a graphical user interface atop multiple pre-configured web archiving tools, intended as an easy way to preserve and replay web pages. It includes Heritrix 3.7.0 for web crawling and OpenWayback 2.4.0 for replaying web archives, is written in Python and compiled with PyInstaller, and is licensed under MIT.

Web Archives 0