Python OSINT crawler for extracting URLs, files, endpoints, and related website data.
Internet Census 2012 is a research paper describing a distributed port scanner built on insecure embedded devices with empty or default credentials. It scanned all IPv4 addresses and includes service probes for common ports, ICMP ping, reverse DNS and SYN scans. Data gathered during the research was released into the public domain.
The Network Entity Reputation Database IP search is a CESNET page that searches and lists IP addresses with hostname, ASN, country, events, reputation score, threat category, other properties, time added and last activity. It provides links to services including Shodan, Censys, AbuseIPDB, Talos Intelligence Center, Greynoise Visualizer and DShield. Results shown include DShield reports and OTX pulses.
CentralOps collection of DNS, WHOIS, traceroute, email, and network lookup tools.
OSINT Toolkit Website Information is a collection of tools for researching websites, IP addresses, domains, emails and MAC addresses. It lists lookups including Ping Website, Whois, reverse Whois, network and TLD lookup, IP history and geolocation, MAC vendor lookup, DNS report and header and source code search. The page states that some tools require the IP address, email address, domain name or MAC address of the target.
A custom OSINT tool from Aware Online Academy for investigating a target website. It provides scripts to view historical WHOIS data, check website text and source code on third-party sites, visualise links, map web pages, check Reddit presence, find open FTP ports and find other top level domains.
Wappalyzer is a website technology checker that identifies the technologies a site is built with, including CMS and ecommerce platforms, analytics tools, frameworks and infrastructure services. It supports single-domain lookups or bulk analysis of thousands of sites, and can also be used in the browser, in a CRM, or through an API.
Community notes
Be the first to share how this project worked for you.
Sign in with a verified account to leave a review or join the discussion.
Sign in to reviewKeep exploring
Internet Census 2012 is a research paper describing a distributed port scanner built on insecure embedded devices with empty or default credentials. It scanned all IPv4 addresses and includes service probes for common ports, ICMP ping, reverse DNS and SYN scans. Data gathered during the research was released into the public domain.
The Network Entity Reputation Database IP search is a CESNET page that searches and lists IP addresses with hostname, ASN, country, events, reputation score, threat category, other properties, time added and last activity. It provides links to services including Shodan, Censys, AbuseIPDB, Talos Intelligence Center, Greynoise Visualizer and DShield. Results shown include DShield reports and OTX pulses.
CentralOps collection of DNS, WHOIS, traceroute, email, and network lookup tools.
OSINT Toolkit Website Information is a collection of tools for researching websites, IP addresses, domains, emails and MAC addresses. It lists lookups including Ping Website, Whois, reverse Whois, network and TLD lookup, IP history and geolocation, MAC vendor lookup, DNS report and header and source code search. The page states that some tools require the IP address, email address, domain name or MAC address of the target.
A custom OSINT tool from Aware Online Academy for investigating a target website. It provides scripts to view historical WHOIS data, check website text and source code on third-party sites, visualise links, map web pages, check Reddit presence, find open FTP ports and find other top level domains.
Wappalyzer is a website technology checker that identifies the technologies a site is built with, including CMS and ecommerce platforms, analytics tools, frameworks and infrastructure services. It supports single-domain lookups or bulk analysis of thousands of sites, and can also be used in the browser, in a CRM, or through an API.
