An arXiv paper presenting a large-scale analysis of the Tor network using a crawler called Mimir, which collects and visits linked content. The authors report a dataset of pages from more than 25k sites and examine network topology, replicated content and content types.
Directory
Search results
Published directory entries matching your search.
Moz On-Page Grader is an SEO tool that takes a URL and keyword and returns a page optimization score with a checklist of recommended fixes. It is accessed through a Moz Pro free trial, which also includes Link Explorer, Keyword Explorer and On-Demand Crawl.
Mwmbl is an open source, non-profit web search engine that operates without ads, tracking or profit motive, and aims to serve as a replacement for commercial search engines. The project uses a centralized index with distributed volunteer-run web crawling, and community members determine search result rankings. Volunteers can contribute by running a command line crawler or installing a Firefox extension to help evaluate search ranking performance. Official documentation is available at https://book.mwmbl.org.
Nekoweb is a free website hosting service created by a group of coders, programmers and artists. It supports custom domains, password-protected pages, SSI, FTP, WebDAV and Git support as donator features, a file editor, and blocking of generative AI crawlers. It is ad-free and run by donations.
Network Tool helps audit websites, improve search visibility, and monitor SEO or analytics performance.
Python SEO Analyzer crawls websites to audit SEO, accessibility, performance, and technical page issues.
qiaomu-seo crawls websites to audit SEO, accessibility, performance, and technical page issues.
Screpy helps audit websites, improve search visibility, and monitor SEO or analytics performance.
SEO Gets is a Google Search Console and GA4 analytics tool for SEO professionals. It offers a master dashboard consolidating search console websites, content groups, striking distance, cannibalization and content decay analysis, index reporting and monitoring, and an MCP server for plugging SEO data into AI assistants. Magic share links share dashboards without requiring account creation.
SEO Toolbox helps audit websites, improve search visibility, and monitor SEO or analytics performance.
SEO Utils is an SEO desktop application for macOS, Windows and Linux. It covers traditional SEO, local SEO and AI search optimization, with tools for tracking rankings across Google, Bing, ChatGPT, AI Overviews and AI Mode, LLM rank tracking, log file analysis, an MCP server, NLP text analysis and an embedding database.
seo-audit-skill crawls websites to audit SEO, accessibility, performance, and technical page issues.
Seo-Promt-Master crawls websites to audit SEO, accessibility, performance, and technical page issues.
Seodity is an SEO toolkit offering keyword research, competitor analysis, content generation with AI, rank tracking and backlink checking. Plans have monthly limits covering projects, tracked keywords, audits and AI articles.
SEOnaut is an open source SEO auditing and reporting tool. It crawls websites and checks for broken links, redirects, duplicated or missing meta tags, heading issues, hreflang problems and missing image alt attributes. The tool can be configured to crawl subdomains or sitemaps, follow nofollow links, check external links and access password-protected sites via HTTP Basic Authentication. It can also create WACZ archives of a site.
SEOquake helps audit websites, improve search visibility, and monitor SEO or analytics performance.
Server-side Rendering (SSR) Checker crawls websites to audit SEO, accessibility, performance, and technical page issues.
Social Trends helps audit websites, improve search visibility, and monitor SEO or analytics performance.
SpiderSuite is a web crawling and security testing platform for security professionals, penetration testers and researchers. It offers specialized crawlers, traffic interception, request crafting and fuzzing, along with source and graph views of crawl data, plus import and export in formats such as HAR, WARC, CSV and JSON.
tech-seo-audit-skill crawls websites to audit SEO, accessibility, performance, and technical page issues.
Trends Tool helps audit websites, improve search visibility, and monitor SEO or analytics performance.
Ubersuggest helps audit websites, improve search visibility, and monitor SEO or analytics performance.
A simple web scraper powered by Cloudflare Workers, built by Adam Schwartz. Users provide a URL and CSS selector, and the tool returns JSON containing the text contents of matching webpage elements. The project is open-source and available on GitHub.
WebCEO is an all-in-one SEO platform offering 24 online SEO tools for digital marketing, including keyword research, rankings, audits, backlink monitoring, link building and competitor research. It provides team collaboration, task management and branded SEO reports. A 14-day free trial is offered, and plans start from $99 per month.