Directory
Published directory entries matching your search.
A GitHub repository listing packages, services and manuals related to web scraping. It covers libraries for Python, PHP, Ruby, JavaScript and Go, command line tools, and web-scraping manuals. It also lists headless browsers, DNS over HTTPS providers, pastebin sites, tunneling software and captcha solving services.
Dev Scraping APIs is a GitHub repository or organization with source code, releases, documentation, or project resources.
Proxy service that helps scraping tools handle Cloudflare and browser-based anti-bot challenges.
brozzler is an open source project with code, documentation, and setup resources for web archiving and scraping.
datahoarder-website-to-markdown is an open source project with code, documentation, and setup resources for web archiving and scraping.
DownloadNet (dn) is an open source project with code, documentation, and setup resources for web archiving and scraping.
Httrack is an open source project with code, documentation, and setup resources for web archiving and scraping.
MarkSnip is an open source project with code, documentation, and setup resources for web archiving and scraping.
Resurrect Pages Fork is an open source project with code, documentation, and setup resources for web archiving and scraping.
Scoop is an open source project with code, documentation, and setup resources for web archiving and scraping.
Scrapling is an adaptive web scraping framework that supports tasks ranging from a single request to full-scale crawling. The project offers community channels on Discord and Twitter for tips and support.
Spider Suite is an open source web scraping or crawling project for collecting website data.
SuckIT is an open source project with code, documentation, and setup resources for web archiving and scraping.
Trawl is a self-hosted scraping engine designed to bypass JavaScript challenges and CAPTCHAs including Cloudflare, Turnstile, reCAPTCHA, hCaptcha and GeeTest. It is positioned as an alternative to FlareSolverr and Byparr, and can serve as a drop-in replacement for *arr stack applications.
