A 2001 book by Chris Sherman and Gary Price examining the nature and extent of the Invisible Web and offering pathfinders for accessing its content, aimed at novice and advanced web searchers. Chapters cover the development of the Internet, search engines and web directories, why search engines cannot see invisible web content, how to recognize it, and when to use it. A directory section lists more than 1,000 Invisible Web sites by topic.
Directory
Search results
Published directory entries matching your search.
Filters
onlinelibrary.london.ac.uk
A library support page explaining the invisible web, also called the deep web or hidden web. It states that search engines cover about 16% of the internet and advises against relying on them alone, especially for academic information. It lists content search engines cannot find, such as dynamically changing content, password protected resources and sites requiring registration, and suggests web directories and asking a librarian.
arxiv.org
This arXiv paper by Dirk Lewandowski and Philipp Mayr provides a critical review of Bergman's 2001 study on the Deep Web. It introduces the concept of the Academic Invisible Web, defined as databases and collections relevant to academia but not searchable by general-purpose internet search engines, and reviews approaches for indexing it. The authors question Bergman's size estimate and suggest collaboration.
oedb.org
Guide to search tools and databases that surface information outside conventional web indexes.