Search results

Scoop is an open source project with code, documentation, and setup resources for web archiving and scraping.

Scrapling

github.com

Scrapling is an open source web scraping or crawling project for collecting website data.

Spider Suite

github.com

Spider Suite is an open source web scraping or crawling project for collecting website data.

SpiderSuite

spidersuite.io

SpiderSuite helps crawl, scrape, copy, or extract data and pages from websites.

SuckIT is an open source project with code, documentation, and setup resources for web archiving and scraping.

Digital Methods tool for scraping search engine results and collecting web research data.

Trawl

github.com

Trawl is an open source project with code, documentation, and setup resources for web archiving and scraping.

Vandal is a web archiving or scraping tool for saving pages, data, or online content.

WAIL is a web archiving or scraping tool for saving pages, data, or online content.

Waymore

github.com

Waymore is an open source project with code, documentation, and setup resources for web archiving and scraping.

Webscrape AI is the perfect tool for collecting data from the web without the hassle of manual scraping. No coding skills required.

Wiki DL Guide is a web archiving or scraping tool for saving pages, data, or online content.

Python OSINT tool for collecting public tweets, followers, likes, and profile data from Twitter.

Open source data scraping software project.

Beautiful Soup: a library designed for screen-scraping HTML and XML.

FlareSolverr

github.com

Proxy service that helps scraping tools handle Cloudflare and browser-based anti-bot challenges.

A Playwright-based Node.js tool that bypasses search engine anti-scraping mechanisms to execute Google searches. Local alternative to SERP APIs with MCP server integration.

Project Eyes On is a high-speed, multi-threaded surveillance tool by Y0oshi (@rde0) for locating open IP cameras worldwide. Unifies Google Dorking and Directory Scraping into a single OSINT engine.

Kotlin/Java library and cli tool for scraping posts and media from various sources with neither authorization nor full page rendering (Facebook, Instagram, Twitter, Youtube, Tiktok, Telegram, Twitch, Reddit, 9GAG, Pinterest, Flickr, Tumblr, Coub, Vimeo, IFunny, VK, Odnoklassniki, Pikabu)

全自动短视频搬运工具，支持自动下载、去重、AI生成标题+标签、上传，可二开扩展至多平台，例如：TikTok->视频号/抖音/小红书、抖音->TikTok/视频号/小红书......video-processing, automation, tiktok, selenium, pyqt5, ffmpeg, bot, data-scraping, video-deduplication.

April Fools Day On The Web is a miscellaneous web resource for discovery, directories, archives, web culture, or useful tools.

The Useless Web is a miscellaneous web resource for discovery, directories, archives, web culture, or useful tools.

Web Neko is a miscellaneous web resource for discovery, directories, archives, web culture, or useful tools.

Web Rewind is a miscellaneous web resource for discovery, directories, archives, web culture, or useful tools.