Directory
Explore Internet Utilities resources in Software & Online Tools.
Waymore gathers links from the Wayback Machine, Common Crawl, Alien Vault OTX, URLScan, VirusTotal, GhostArchive and Intelligence X. It can also download archived responses for URLs on the Wayback Machine so those can be searched for more links, developer comments and extra parameters. The tool is intended for coverage rather than speed.
Binary Eye is a free, ad-free, open source barcode scanner for Android. It works in portrait and landscape orientation, can read inverted codes, uses Material Design and can also generate barcodes, using the ZXing-C++ barcode scanning library. It can be invoked through web URI intents or from other apps using an Intent.
Ladder is a self-hosted HTTP web proxy and developer tool for testing and analyzing paywall implementations and content delivery behavior on websites. It can remove or modify CORS and other headers, inject custom code, apply domain-based rulesets and emulate different client types. The project states it does not circumvent advanced access restrictions and may not function on services that actively restrict access.
A GitHub repository listing packages, services and manuals related to web scraping. It covers libraries for Python, PHP, Ruby, JavaScript and Go, command line tools, and web-scraping manuals. It also lists headless browsers, DNS over HTTPS providers, pastebin sites, tunneling software and captcha solving services.
Open source web crawler built for extracting clean website data for AI and LLM workflows.
Proxy service that helps scraping tools handle Cloudflare and browser-based anti-bot challenges.
grab-site is a web crawler developed by ArchiveTeam for web archiving. It outputs WARC files, offers a dashboard for monitoring all crawls, and supports dynamic ignore patterns to customize crawling behavior.
Link Stack is an open-source link sharing platform for creating personalized profile pages. It provides a highly customizable interface that lets users showcase multiple links in one place, overcoming the single-link limitation of many social media platforms. It can be self-hosted on a user's own server.
Scrapling is an adaptive web scraping framework that supports tasks ranging from a single request to full-scale crawling. The project offers community channels on Discord and Twitter for tips and support.
Spider Suite is an open source web scraping or crawling project for collecting website data.
User Scanner is a two-in-one email and username OSINT suite with native MCP support. It performs deep data extraction from a single email or username, analyzing over 1080 maintained scan vectors, including more than 200 email and 880 username sources. It is intended for security research, investigations, and digital footprinting.
A wiki page listing resources around the wallabag ecosystem, for a self-hostable application for saving web pages. It covers official third-party applications such as smartphone apps and browser addons, compatible RSS and Atom readers, ereader clients and unofficial clients, plus integrations with third-party tools.
Buster is an open source browser extension designed to solve CAPTCHAs for human end users. It is compatible with Google Chrome, Microsoft Edge and Mozilla Firefox desktop browsers, and is distributed as free software.
byp4xx is an open source security tool written in the Go programming language, intended for bypassing 40X HTTP status responses during web testing. Its features include HTTP verb tampering, custom header modification, User-Agent switching, extension handling, and testing of default credentials, with resources relevant to bug bounty workflows.
This repository hosts a curated list of self-hostable cloud services suitable for personal or small-scale everyday use. Included service categories cover self-hosted VPN, music streaming, photo hosting, and eBook catalog software for users who want to run their own services.
Medium Parser is an open source browser tool for improving tabs, bookmarks, extensions, or browsing workflows.
Pake is a tool that turns any website into a lightweight desktop app with one command, supporting macOS, Windows and Linux. It is built with Rust Tauri and offers one-command packaging via CLI, an online build option, and ready-made packages for popular sites. It supports shortcuts, immersive windows, drag and drop, style customization and ad removal.
Silk is a browser extension implementing the client side of the Privacy Pass protocol, which provides unlinkable cryptographic tokens. It supports Public-Verifiable tokens (Blind-RSA), while Private-Verifiable, batched and rate limited tokens are marked as in progress. When a website requests a token, the extension opens a challenge page that must be solved.
PingMe is an open source notification tool that provides both a command-line interface and a web service, allowing users to send alerts across a wide range of supported messaging platforms from a single unified tool.
