Open-source utility for gathering public metadata about onion services during authorized research.
onionsearch is a Python script that scrapes URLs on different .onion search engines. It is distributed on PyPI as version 1.3, released on October 22, 2021, under the GNU General Public License v3. The package page states the author has not provided a project description.
Ahmia is a search engine for services on the Tor network. It indexes hidden services, which require the Tor browser bundle to access, and states that abuse material is not allowed and is removed from the index. The project is developed as free and open source software, with a crawler, an index and a search website.
Tor Stack Exchange is a question-and-answer site for researchers, developers, and users of Tor. Questions cover topics such as onion services, exit relays, Tails, the Tor Browser Bundle, anonymity, and configuration.
Nyx is a command-line monitor for Tor, providing real-time information about a relay such as bandwidth usage, connections and logs. It is a curses interface suited to ssh connections and tty terminals. It requires Stem 1.5.4 or later and works with Python 2.7 and greater, including Python 3.x.
Dizzy is an open-source crawling and analysis system for onion services. It implements techniques to explore, update, check, and classify onion services at scale without overwhelming the Tor network. It was deployed in April 2021 and used to analyze more than 63.3 million crawled onion webpages, focusing on domain operations, web content, cryptocurrency usage, and web graph.
An arXiv paper presenting a large-scale analysis of the Tor network using a crawler called Mimir, which collects and visits linked content. The authors report a dataset of pages from more than 25k sites and examine network topology, replicated content and content types.
Community notes
Be the first to share how this project worked for you.
Sign in with a verified account to leave a review or join the discussion.
Sign in to reviewKeep exploring
onionsearch is a Python script that scrapes URLs on different .onion search engines. It is distributed on PyPI as version 1.3, released on October 22, 2021, under the GNU General Public License v3. The package page states the author has not provided a project description.
Ahmia is a search engine for services on the Tor network. It indexes hidden services, which require the Tor browser bundle to access, and states that abuse material is not allowed and is removed from the index. The project is developed as free and open source software, with a crawler, an index and a search website.
Tor Stack Exchange is a question-and-answer site for researchers, developers, and users of Tor. Questions cover topics such as onion services, exit relays, Tails, the Tor Browser Bundle, anonymity, and configuration.
Nyx is a command-line monitor for Tor, providing real-time information about a relay such as bandwidth usage, connections and logs. It is a curses interface suited to ssh connections and tty terminals. It requires Stem 1.5.4 or later and works with Python 2.7 and greater, including Python 3.x.
Dizzy is an open-source crawling and analysis system for onion services. It implements techniques to explore, update, check, and classify onion services at scale without overwhelming the Tor network. It was deployed in April 2021 and used to analyze more than 63.3 million crawled onion webpages, focusing on domain operations, web content, cryptocurrency usage, and web graph.
An arXiv paper presenting a large-scale analysis of the Tor network using a crawler called Mimir, which collects and visits linked content. The authors report a dataset of pages from more than 25k sites and examine network topology, replicated content and content types.
