Scraper is an open source project for reading, generating, or managing RSS and web feeds.
Directory
Search results
Published directory entries matching your search.
Browser extension for Instant Data Scraper, adding useful tools or workflow improvements inside the browser.
proxy-scraper is a code project with source, releases, documentation, or setup notes.
proxy-scraper-checker is a code project with source, releases, documentation, or setup notes.
A simple web scraper powered by Cloudflare Workers, built by Adam Schwartz. Users provide a URL and CSS selector, and the tool returns JSON containing the text contents of matching webpage elements. The project is open-source and available on GitHub.
Google Maps Scraper & Lead Generation Tool. Extract 50+ data points including business emails, phone numbers, and social profiles. Includes enrichment features, API access, and no recurring fees
سناب شات سكرابر تتيح لك تحميل القصص العامة من سناب شات مع الصور والفيديوهات، وتعرض التواريخ الزمنية لكل قصة. تركز على الخصوصية ولا تصل للقصص الخاصة. | The Snapchat Scraper tool allows you to download public Snapchat stories with images, videos, and timestamps. It focuses on privacy and does not access private stories.
The @unitedstates project is a shared commons of data and tools for the United States. It includes detailed data on members of Congress, scrapers and parsers for congressional work, a stand-alone legal citation detector, a parser for the US Code, licensing guidelines, bill nicknames, inspectors general data, contact form tools, district shape files, public domain photos, and a glossary of congressional terms.
A blog post listing OSINT utilities for the Google Chrome browser. It states that browser extensions can aid investigators, recommends a clean browser installation for sensitive investigations, and includes items such as Exif Viewer Pro, Hunter Email Finder, and Instant Data Scraper.
A page for browsing, searching and sharing community-built OpenGameInstaller addons from independent developers. Listings come from an official community marketplace and are not affiliated with OpenGameInstaller. Listed addons include FatBoy Unpack, Local Files, Steam Integration and Steamrip Scraper, each linking to an open repository.
All The Places is an open data project that indexes over 20 million points of interest from more than 4,100 web scrapers worldwide. Its downloads are gzipped ndjson files, each line a GeoJSON feature with consistent properties, updated weekly. The downloads and data are released under the CC-0 waiver; the spider software is MIT licensed.
AnimeTV is a free open-source anime app for Android, Android TV, Fire TV and Windows. It streams from multiple scrapers at 1080p and supports AniList, MyAnimeList and Trakt sync. It has no ads or tracking and supports D-pad remotes and external players.
Bardeen is a platform for sourcing leads with an agentic web scraper, researching leads with AI search, enriching them with validated contact info, and qualifying them with AI. It supports exporting data to CSV, Google Sheets, Airtable and Notion, and lists use cases for solopreneurs, real estate and music.
Claygent is Clay's AI web scraper used for enrichment in Clay. Unlike traditional enrichment providers that return static database results, it browses websites and reads pages to return insights, addressing last mile data that is too niche for data providers. Company enrichment requires a company domain, and people enrichment requires a LinkedIn profile URL.
An exporter that converts lists from MyAnimeList, Kitsu, AniList and Anime-Planet into MAL XML format for import into MyAnimeList. The MyAnimeList exporter only works for publicly accessible lists. The Anime-Planet scraper relies on a static offline mapping current as of 2022/01/01, so newly added entries may not map.
Focsec is an API for detecting VPNs, proxies, TOR and bot traffic. It provides IP check data for protecting applications, identifying suspicious logins, detecting fraudulent signups and stopping scrapers and crawlers. Plans are billed monthly, and a free 14 day trial is offered.
A scraper that converts varied content into a single text file for training custom ChatGPT chatbots. It handles YouTube transcriptions, public websites and many file formats, processing data on the device. It is a free weekend project with some known limitations.
Scrapes all photos and videos in a web page / Instagram / Twitter / Tumblr / Reddit / pixiv / TikTok
MediaElch is a media manager for movies, TV shows, concerts and music. It imports new files, renames them automatically and creates nfo files for use with Kodi, and it comes with scrapers including The Movie DB, The TV DB, IMDB, fanart.tv and The Audio DB. It is available for macOS, Windows and Linux and is open source.
SerpBear is an open source search engine position tracking app. It tracks a website's keyword positions in Google and sends email notifications about position changes. It uses third-party scrapers or proxy IPs to scrape Google search results, with Basic, Custom and Smart scrape strategies. A built-in API supports reporting tools, and Google Ads and Search Console integrations are available.
Virgil is a search engine for finding links to games, Android APKs and software. It indexes trusted links and uses Google for searching, and supports quick bangs configured in the browser. The project is described as a scraper and aggregator of third-party sites; it states that it does not host files or endorse those sites.
Agent skill and MCP server for tweet search, user lookup, follower export, media download, webhooks, and confirmation-gated X actions. MIT.