| 1 | [aA]cunetix | Mozilla/5.0 (Windows NT 6.1; WOW64) acunetix-product/wvs (Acunetix Web Vulnerability Scanner - Free… | Acunetix web vulnerability scanner bot |
| 2 | [dD]ir[Bb]uster | DirBuster-1.0-RC1 (http://www.owasp.org/index.php/Category:OWASP_DirBuster_Project) | DirBuster directory scanner web crawler |
| 3 | abuse\.xmco\.fr | Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:103.0) Gecko/20100101 Firefox/103.0 abuse.xmco.fr | Cybersecurity crawler scanning websites for vulnerabilities and threat analysis signals |
| 4 | air\.ai\/scanning | air.ai/scanning Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) Chrome/126.0.0.0 Safari/537.36 | Air.ai web crawler for scanning |
| 5 | AliyunSecBot | AliyunSecBot/Aliyun AliyunSecBot@service.alibaba.com | Alibaba Aliyun security web crawler bot |
| 6 | ArtemisBot | ArtemisBot | Vulnerability scanning and cybersecurity research bot |
| 7 | Bad Neighborhood Header Detector | Bad Neighborhood Header Detector (http://www.bad-neighborhood.com/header_detector.php) | Website security risk analysis for link quality |
| 8 | bitdiscovery | bitdiscovery | Security vulnerability scanner identifying weaknesses and compliance issues in web infrastructure |
| 9 | BitSightBot\/ | Mozilla/5.0 (compatible; BitSightBot/1.0) | BitSight web crawler for security |
| 10 | BlackDuck-FD | BlackDuck-FD | Vulnerability scanner for application security testing |
| 11 | BrowserBot-Observer | BrowserBot-Observer (+https://siteobserver.co) | Observer third-party risk security scanner |
| 12 | CensysInspect\/ | Mozilla/5.0 (compatible; CensysInspect/1.1; +https://about.censys.io/) | Censys web crawler for security scanning |
| 13 | CERT PL | Mozilla/5.0 (compatible; Artemis; CERT PL; +https://cert.pl/skanowanie) | Polish cybersecurity vulnerability and threat scanner |
| 14 | CISPA Webcrawler | CISPA Webcrawler (https://vuln-notify-checker.cispa.saarland) | CISPA web crawler for vulnerability |
| 15 | Cloudflare-Radar-Scanner | Cloudflare-Radar-Scanner | URL scanning for traffic and threat intelligence |
| 16 | CloudflareRadarURLScanner | Mozilla/5.0 (compatible; CloudflareRadarURLScanner; +https://radar.cloudflare.com/) | Cloudflare URL security scanner |
| 17 | cookie-maestro | Mozilla/5.0 (compatible; cookie-maestro; +https://www.cookiemaestro.com/) | Cookie Maestro GDPR compliance scanner |
| 18 | Cookiebot | Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko; compatible; Cookiebot/1… | Cookiebot web crawler for cookie scanning |
| 19 | CookieHubScan | Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 S… | CookieHub web crawler for cookie scanning |
| 20 | CookieHubVerify | Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 S… | CookieHub consent banner verification scanner |
| 21 | CookieYesbot | Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko; CookieYesbot/1.0; … | CookieYes consent compliance scanner |
| 22 | csirt\.cz | Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.131 Safari/537.36 1.6.4 (+https… | Czech cybersecurity team vulnerability scanning bot |
| 23 | cypex\.ai\/scanning | cypex.ai/scanning Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) Chrome/126.0.0.0 Safari/537.36 | Cypex security vulnerability scanner |
| 24 | Detectify | Mozilla/5.0 (compatible; Detectify) +https://detectify.com/bot/ | Vulnerability and attack surface scanning bot |
| 25 | DigiCert DCV | DigiCert DCV/1.1 | DigiCert domain validation scanner |
| 26 | DNSScanner | DNSScanner | DNS and network infrastructure security scanning crawler bot |
| 27 | Do Not Track Verifier | Electronic Frontier Foundation's Do Not Track Verifier (for questions or concerns email dnt-policy@… | Privacy practices and security protocol analyzer |
| 28 | ec2linkfinder | ec2linkfinder | EC2 link finder web crawler bot |
| 29 | Foregenix | Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko, Foregenix) Chrome/… | Cybersecurity vulnerability and weakness scanner |
| 30 | Hardenize | Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.… | Hardenize security configuration scanner |
| 31 | https:\/\/developers\.cloudflare\.com\/security-center\/ | Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/92.0.… | CloudFlare security center web crawler |
| 32 | ISSCyberRiskCrawler\/ | Mozilla/5.0 (Macintosh; Intel Mac OS X 13_0_1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.… | Cybersecurity risk crawler scanning websites for vulnerabilities and exposures |
| 33 | Jugendschutzprogramm-Crawler | Jugendschutzprogramm-Crawler; Info: http://www.jugendschutzprogramm.de | Jugendschutzprogramm web crawler bot |
| 34 | K7MLWCBot | K7MLWCBot/1.0 (+http://www.k7computing.com) | Virus scanner |
| 35 | Keydrop\.io | Mozilla/5.0; Keydrop.io/1.0(onlyscans.com/about); | Keydrop gaming marketplace security scanning and monitoring crawler |
| 36 | l9explore | l9explore/1.2.2 | L9explore web crawler for discovery |
| 37 | l9scan | Mozilla/5.0 (l9scan/2.0; +https://github.com/LeakIX/l9scan) | L9scan web crawler for scanning |
| 38 | LegalMonster | LegalMonster | Compliance monitoring scanner detecting cookies and tracking consent |
| 39 | LightspeedSystemsCrawler | LightspeedSystemsCrawler Mozilla/5.0 (Windows; U; MSIE 9.0; Windows NT 9.0; en-US | Lightspeed Systems web crawler bot |
| 40 | ltx71 | ltx71 - (http://ltx71.com/) | LTX71 web crawler for content discovery |
| 41 | masscan | masscan/1.0 (https://github.com/robertdavidgraham/masscan) | Masscan network scanner web crawler bot |
| 42 | MRGbot\/ | Mozilla/5.0 (compatible; MRGbot/1.0; +https://www.mrg.ro/bot.html) | Security testing lab crawler for anti-fraud control evaluation |
| 43 | Nessus | Mozilla/5.0 (compatible; Nessus; http://www.nessus.org) | Nessus vulnerability scanner web crawler |
| 44 | Netcraft SSL Server Survey | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; Netcraft SSL Server Survey - contact info@netcra… | Netcraft SSL certificate intelligence scanner |
| 45 | NetSystemsResearch | NetSystemsResearch studies the availability of various services across the internet. Our website is… | NetSystemsResearch web crawler bot |
| 46 | Nikto | Mozilla/5.00 (Nikto/2.1.5) (Evasions:None) (Test:Port Check) | Nikto web server security scanner bot |
| 47 | NINJA bot | NINJA bot | NINJA web crawler for content discovery |
| 48 | Nmap Scripting Engine | Mozilla/5.0 (compatible; Nmap Scripting Engine; https://nmap.org/book/nse.html) | Nmap NSE web crawler for security scanning |
| 49 | NsToolsBot\/ | NsToolsBot/analyse | Network and security analysis tool crawler gathering server data |
| 50 | OpenVAS | Mozilla/5.0 [en] (X11, U; OpenVAS) | Vulnerability scanner crawler identifying security weaknesses |
| 51 | ProbelySPDR\/ | Mozilla/5.0 (compatible; +https://probely.com/sos) ProbelySPDR/0.1.0 | Security testing crawler identifying web vulnerabilities |
| 52 | ProjectShield-UrlCheck | Mozilla/5.0 (compatible; ProjectShield-UrlCheck; +http://g.co/projectshield) | Google DDoS protection bot validating customer origins |
| 53 | Qualys | Mozilla/5.0 (compatible; Qualys; +https://www.qualys.com/) | Qualys security scanning |
| 54 | ReverseEngineeringBot | Mozilla/5.0 (compatible; ReverseEngineeringBot/0.1; +https://torus.company/bot.html) | Torus reverse engineering web crawler |
| 55 | Riddler \(http:\/\/riddler\.io | Riddler (http://riddler.io/about) | Internet scanning crawler gathering domain and IP metadata |
| 56 | SafeDNSBot | SafeDNSBot (https://www.safedns.com/searchbot) | SafeDNS web crawler for security analysis |
| 57 | Sansec Security Monitor\/ | Mozilla/5.0 (compatible; Sansec Security Monitor/1.0; +https://sansec.io/monitor) | E-commerce malware detection scanner for skimmers |
| 58 | SecurityHeaders | Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 S… | HTTP security headers analyzer and evaluator |
| 59 | Software-Security-Research | Mozilla/5.0 (compatible; Software-Security-Research; +https://www.ruhr-uni-bochum.de/) | Ruhr University CDN security research crawler |
| 60 | sqlmap | sqlmap/1.7.8#stable (https://sqlmap.org) | SQLMap SQL injection testing web crawler |
| 61 | SSL Labs$ | SSL Labs | Qualys SSL Labs scanner testing TLS configuration and certificate grades |
| 62 | Sucuri | Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.2) Gecko/20100115 Firefox/3.6 MSIE 7.0; Sucu… | Security scanner identifying malware blacklist status and checking plugin vulnerability compliance |
| 63 | Testcrawler | Testcrawler | Testing crawler evaluating website performance security vulnerabilities and SEO optimization |
| 64 | TLS tester | TLS tester from https://testssl.sh/ | SSL/TLS security testing and vulnerability scanning crawler bot |
| 65 | TwinWaveScanner | TwinWaveScanner | Security threat analysis and phishing detection bot |
| 66 | Unshorten\.It\! | Unshorten.It!/1.0 (https://unshorten.it/) | URL expansion crawler revealing shortened link destinations for cybersecurity threat intelligence |
| 67 | UrlBeeBot | UrlBeeBot | URL analysis and threat detection security crawler bot |
| 68 | UT-Dorkbot | UT-Dorkbot/1.0 | University of Texas security web crawler |
| 69 | VaultPress | VaultPress | WordPress backup and security scanner performing malware scanning and integrity |
| 70 | Verispider | Mozilla/5.0 (compatible; Verispider; +https://www.projecthoneypot.org/) | Verispider spam and security scanner |
| 71 | virustotal | Mozilla/5.0 (Windows; U; MSIE 9.0; Windows NT 9.0; en-US) AppEngine-Google; (+http://code.google.co… | VirusTotal web crawler for security |
| 72 | visionheight\.com\/scan | visionheight.com/scan Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) Chrome/126.0.0.0 Safari/537.36 | Vision Height security scanner |
| 73 | WanscannerBot | Mozilla/5.0 (X11; Linux x86_64; WanscannerBot/1.2; +https://abuse.pend.re) Gecko/20100101 Firefox/1… | Network security scanning and vulnerability detection crawler bot |
| 74 | watchTowr | Mozilla/5.0 (watchTowr; Windows NT 10.0; Win64; x64; rv:84.0) Gecko/20100101 Firefox/84.0 | watchTowr is an external attack surface management tool that scans assets and generates findings against thos… |
| 75 | WhatWeb\/ | WhatWeb/0.5.5 | Web technology scanner identifying frameworks servers and CMS configurations |
| 76 | WPScan | WPScan v3.8.22 (https://wpscan.com/wordpress-security-scanner) | WPScan WordPress security scanner bot |
| 77 | WPSec\/ | Mozilla/5.0 (compatible; WPSec/1.3; +https://wpsec.com) | WordPress security scanner identifying vulnerabilities outdated plugins and misconfigurations |
| 78 | WTotem | Mozilla/5.0 (compatible; WTotem; +https://www.webtotem.com/) | WTotem malware detection scanner |
| 79 | YahooMailProxy | YahooMailProxy; https://help.yahoo.com/kb/yahoo-mail-proxy-SLN28749.html | Email proxy crawler fetching URLs and resources for security scanning and rendering |
| 80 | zgrab | Mozilla/5.0 zgrab/0.x | Zgrab web crawler for security scanning |
| 81 | ZmEu | ZmEu | ZmEu vulnerability scanner web crawler |