Web Scraping FYI helps crawl, scrape, copy, or extract data and pages from websites.
Directory
Search results
Published directory entries matching your search.
Python tool for scraping public posts and profiles from social networks without using official platform APIs.
Data Hoarding is a web archiving or scraping tool for saving pages, data, or online content.
Airtable-based OSINT resource list for simple scraping workflows and Twitter-focused research links.
Wget2 is an open source project with code, documentation, and setup resources for web archiving and scraping.
Search tool for finding public social profiles and mentions across multiple social networks.
Social-Searcher is a social media tool for privacy frontends, link previews, analytics, or platform utilities.
Python tool for collecting email addresses from search engines and public web sources during authorized research.
Python OSINT tool for collecting public tweets, followers, likes, and profile data from Twitter.
80legs is a web archiving or scraping tool for saving pages, data, or online content.
Open source data scraping software project.
One API key, 63 AI agent tools: web search, scraping, AI generation, OCR, crypto data. LangChain + MCP ready. Pay per call with credits or x402/USDC.
Beautiful Soup: a library designed for screen-scraping HTML and XML.
CachedView is a web archiving or scraping tool for saving pages, data, or online content.
Commands is a web archiving or scraping tool for saving pages, data, or online content.
CopySite helps crawl, scrape, copy, or extract data and pages from websites.
Cyotek WebCopy helps crawl, scrape, copy, or extract data and pages from websites.
Heritrix is a web archiving or scraping tool for saving pages, data, or online content.
Import.io helps businesses scale web scraping and data extraction for real-time pricing, competitor tracking, and high-quality web data.
Browser extension for Instant Data Scraper, adding useful tools or workflow improvements inside the browser.
Irchiver is a web archiving or scraping tool for saving pages, data, or online content.
MarkdownDown is a web archiving or scraping tool for saving pages, data, or online content.
PageRip is a web archiving or scraping tool for saving pages, data, or online content.
Quick Cache is a web archiving or scraping tool for saving pages, data, or online content.