Search results

80legs is a web archiving or scraping tool for saving pages, data, or online content.

Open source data scraping software project.

Arch Tools

archtools.dev

One API key, 63 AI agent tools: web search, scraping, AI generation, OCR, crypto data. LangChain + MCP ready. Pay per call with credits or x402/USDC.

Beautiful Soup: a library designed for screen-scraping HTML and XML.

brozzler

github.com

brozzler is an open source project with code, documentation, and setup resources for web archiving and scraping.

CachedView is a web archiving or scraping tool for saving pages, data, or online content.

Commands is a web archiving or scraping tool for saving pages, data, or online content.

CopySite helps crawl, scrape, copy, or extract data and pages from websites.

Cyotek WebCopy helps crawl, scrape, copy, or extract data and pages from websites.

datahoarder-website-to-markdown is an open source project with code, documentation, and setup resources for web archiving and scraping.

Dorks Eye Google Hacking Dork Scraping and Searching Script. Dorks Eye is a script I made in python 3. With this tool, you can easily find Google Dorks. Dork Eye collects potentially vulnerable web pages and applications on the Internet or other awesome info that is picked up by Google's search bots. Author: Jolanda de Koff

DownloadNet (dn) is an open source project with code, documentation, and setup resources for web archiving and scraping.

FlareSolverr

github.com

Proxy service that helps scraping tools handle Cloudflare and browser-based anti-bot challenges.

A Playwright-based Node.js tool that bypasses search engine anti-scraping mechanisms to execute Google searches. Local alternative to SERP APIs with MCP server integration.

grab-site

github.com

grab-site is an open source web scraping or crawling project for collecting website data.

Heritrix is a web archiving or scraping tool for saving pages, data, or online content.

Heritrix3

github.com

Heritrix3 is an open source project with code, documentation, and setup resources for web archiving and scraping.

Httrack is an open source project with code, documentation, and setup resources for web archiving and scraping.

Import.io helps businesses scale web scraping and data extraction for real-time pricing, competitor tracking, and high-quality web data.

Instant Data Scraper

chromewebstore.google.com

Browser extension for Instant Data Scraper, adding useful tools or workflow improvements inside the browser.

Irchiver is a web archiving or scraping tool for saving pages, data, or online content.

MarkdownDown is a web archiving or scraping tool for saving pages, data, or online content.

MarkSnip is an open source project with code, documentation, and setup resources for web archiving and scraping.

PageRip is a web archiving or scraping tool for saving pages, data, or online content.