Directory

Search results

Published directory entries matching your search.

Search results

6,400 listings

Awesome Web Scraping is an open source network utility for diagnostics, connectivity checks, or internet testing.

Internet Utilities 217
webscraping.fyi

Web Scraping FYI helps crawl, scrape, copy, or extract data and pages from websites.

Internet Utilities 158
github.com

Dev Scraping APIs is a GitHub repository or organization with source code, releases, documentation, or project resources.

APIs & Databases 231
datahoarding.org

Data Hoarding is a web archiving or scraping tool for saving pages, data, or online content.

Web Archives 279
gitlab.com

Wget2 is an open source project with code, documentation, and setup resources for web archiving and scraping.

Web Archives 191
pypi.org

Python tool for scraping public posts and profiles from social networks without using official platform APIs.

Social Networks 348
airtable.com

Airtable-based OSINT resource list for simple scraping workflows and Twitter-focused research links.

X / Twitter 339
web.scraper.workers.dev

web.scraper.workers.dev helps crawl, scrape, copy, or extract data and pages from websites.

Internet Utilities 236
import.io

Import.io helps businesses scale web scraping and data extraction for real-time pricing, competitor tracking, and high-quality web data.

AI Data & Analytics 341
pypi.org

Python tool for collecting email addresses from search engines and public web sources during authorized research.

Email Lookup 197
80legs.com

80legs is a web archiving or scraping tool for saving pages, data, or online content.

Internet Utilities 243
archtools.dev

One API key, 63 AI agent tools: web search, scraping, AI generation, OCR, crypto data. LangChain + MCP ready. Pay per call with credits or x402/USDC.

AI Agents & Automation 155
github.com

brozzler is an open source project with code, documentation, and setup resources for web archiving and scraping.

Internet Utilities 264
cachedview.nl

CachedView is a web archiving or scraping tool for saving pages, data, or online content.

Web Archives 243
whatismybrowser.com

Commands is a web archiving or scraping tool for saving pages, data, or online content.

Web Archives 316
xdan.ru

CopySite helps crawl, scrape, copy, or extract data and pages from websites.

Web Archives 335
cyotek.com

Cyotek WebCopy helps crawl, scrape, copy, or extract data and pages from websites.

Web Archives 334

datahoarder-website-to-markdown is an open source project with code, documentation, and setup resources for web archiving and scraping.

Web Archives 186
github.com

Dorks Eye Google Hacking Dork Scraping and Searching Script. Dorks Eye is a script I made in python 3. With this tool, you can easily find Google Dorks. Dork Eye collects potentially vulnerable web pages and applications on the Internet or other awesome info that is picked up by Google's search bots. Author: Jolanda de Koff

Google Communities & Tools 195
github.com

DownloadNet (dn) is an open source project with code, documentation, and setup resources for web archiving and scraping.

Web Archives 154
github.com

grab-site is an open source web scraping or crawling project for collecting website data.

Internet Utilities 193
heritrix.readthedocs.io

Heritrix is a web archiving or scraping tool for saving pages, data, or online content.

Internet Utilities 256
github.com

Heritrix3 is an open source project with code, documentation, and setup resources for web archiving and scraping.

Internet Utilities 309
github.com

Httrack is an open source project with code, documentation, and setup resources for web archiving and scraping.

Web Archives 286