Archive
Persistent archive
Visitors
30
Total bot blocks
171,135
Whitelist access
90,700
Known bots stored
108
Bots blocked
122,085
Limit blocked
49,050
Blocked IPs
12
Bots limited
58,246
Last 7 days
This year (2026)
Top bots
Summary of known bot activity in the archive.
✅ Allowed
⚪ Allowed with limit
🟨 Limit blocked
🟥 Hard blocked
| Bot ↕ | ✅ | ⚪ | 🟨 | 🟥 | Total ↕ | Last seen ↕ |
|---|---|---|---|---|---|---|
| bingbot | 8,654 | 54,923 | 49,050 | 11 | 112,638 | 2026-08-06 00:39 |
| Mozilla | 11,479 | 0 | 0 | 38,236 | 49,715 | 2026-08-05 23:04 |
| Meta External Agent | 0 | 0 | 0 | 49,686 | 49,686 | 2026-08-05 23:05 |
| DotBot | 0 | 0 | 0 | 10,956 | 10,956 | 2026-08-06 00:18 |
| Sogou | 10,559 | 0 | 0 | 11 | 10,570 | 2026-08-06 00:38 |
| Amazonbot | 0 | 0 | 0 | 10,033 | 10,033 | 2026-08-05 21:47 |
| SemrushBot | 0 | 0 | 0 | 5,573 | 5,573 | 2026-08-06 00:06 |
| Mediapartners-Google | 0 | 0 | 0 | 4,541 | 4,541 | 2026-07-30 18:07 |
| Googlebot | 250 | 3,323 | 0 | 70 | 3,643 | 2026-08-05 23:25 |
| Baiduspider | 1,110 | 0 | 0 | 13 | 1,123 | 2026-08-06 00:30 |
| DataForSeoBot | 0 | 0 | 0 | 663 | 663 | 2026-08-05 16:08 |
| Turnitin | 0 | 0 | 0 | 444 | 444 | 2026-08-02 07:43 |
| SERankingBacklinksBot | 0 | 0 | 0 | 260 | 260 | 2026-08-05 18:35 |
| Applebot | 247 | 0 | 0 | 11 | 258 | 2026-08-05 19:57 |
| ClaudeBot | 0 | 0 | 0 | 168 | 168 | 2026-08-05 22:33 |
| YandexBot | 155 | 0 | 0 | 11 | 166 | 2026-08-05 23:11 |
| MJ12bot | 0 | 0 | 0 | 128 | 128 | 2026-08-05 22:22 |
| Dalvik | 0 | 0 | 0 | 95 | 95 | 2026-08-06 00:12 |
| SiteLockSpider | 0 | 0 | 0 | 78 | 78 | 2026-08-04 07:49 |
| curl | 0 | 0 | 0 | 62 | 62 | 2026-08-03 23:52 |
| CCBot | 0 | 0 | 0 | 46 | 46 | 2026-07-27 14:30 |
| Pinterestbot | 0 | 0 | 0 | 36 | 36 | 2026-08-05 23:58 |
| Hello | 0 | 0 | 0 | 34 | 34 | 2026-08-04 18:42 |
| GPTBot | 0 | 0 | 0 | 30 | 30 | 2026-08-01 21:53 |
| Timpibot | 0 | 0 | 0 | 30 | 30 | 2026-07-23 18:19 |
| ZoominfoBot | 0 | 0 | 0 | 27 | 27 | 2026-08-03 10:13 |
| python-requests | 0 | 0 | 0 | 24 | 24 | 2026-08-04 03:55 |
| Go-http-client | 0 | 0 | 0 | 24 | 24 | 2026-07-27 14:29 |
| Wget | 0 | 0 | 0 | 22 | 22 | 2026-07-27 14:30 |
| BYB-Testtool-www.blockyoubots.com | 0 | 0 | 0 | 20 | 20 | 2026-07-27 14:30 |
| Scrapy | 0 | 0 | 0 | 19 | 19 | 2026-07-20 16:14 |
| Twitterbot | 0 | 0 | 0 | 16 | 16 | 2026-07-27 14:30 |
| okhttp | 0 | 0 | 0 | 14 | 14 | 2026-07-27 14:29 |
| AhrefsBot | 0 | 0 | 0 | 13 | 13 | 2026-07-27 14:30 |
| DnBCrawler-Analytics | 0 | 0 | 0 | 13 | 13 | 2026-08-05 11:03 |
| Other | 0 | 0 | 0 | 12 | 12 | 2026-07-29 01:11 |
| axios | 0 | 0 | 0 | 12 | 12 | 2026-07-27 14:29 |
| PerplexityBot | 0 | 0 | 0 | 12 | 12 | 2026-08-01 00:38 |
| meta-webindexer | 0 | 0 | 0 | 12 | 12 | 2026-08-06 00:00 |
| Java | 0 | 0 | 0 | 11 | 11 | 2026-07-27 14:29 |
| node-fetch | 0 | 0 | 0 | 11 | 11 | 2026-07-27 14:29 |
| GuzzleHttp | 0 | 0 | 0 | 11 | 11 | 2026-07-27 14:29 |
| libwww-perl | 0 | 0 | 0 | 11 | 11 | 2026-07-27 14:29 |
| Faraday | 0 | 0 | 0 | 11 | 11 | 2026-07-27 14:29 |
| Googlebot-Image | 0 | 0 | 0 | 11 | 11 | 2026-07-27 14:29 |
| AdsBot-Google | 0 | 0 | 0 | 11 | 11 | 2026-07-27 14:29 |
| DuckDuckBot | 0 | 0 | 0 | 11 | 11 | 2026-07-27 14:29 |
| SeznamBot | 0 | 0 | 0 | 11 | 11 | 2026-07-27 14:29 |
| awisbot | 0 | 0 | 0 | 11 | 11 | 2026-07-27 14:30 |
| CriteoBot | 0 | 0 | 0 | 11 | 11 | 2026-07-27 14:30 |
| 0 | 0 | 0 | 11 | 11 | 2026-07-27 14:30 | |
| scrapy | 0 | 0 | 0 | 11 | 11 | 2026-07-27 14:30 |
| Python-urllib | 0 | 0 | 0 | 11 | 11 | 2026-07-27 14:30 |
| masscan | 0 | 0 | 0 | 11 | 11 | 2026-07-27 14:30 |
| sqlmap | 0 | 0 | 0 | 11 | 11 | 2026-07-27 14:30 |
| Havij | 0 | 0 | 0 | 11 | 11 | 2026-07-27 14:30 |
| Acunetix | 0 | 0 | 0 | 11 | 11 | 2026-07-27 14:30 |
| Nikto | 0 | 0 | 0 | 11 | 11 | 2026-07-27 14:30 |
| Netsparker | 0 | 0 | 0 | 11 | 11 | 2026-07-27 14:30 |
| w3af.org | 0 | 0 | 0 | 11 | 11 | 2026-07-27 14:30 |
| Arachni | 0 | 0 | 0 | 11 | 11 | 2026-07-27 14:30 |
| commix | 0 | 0 | 0 | 11 | 11 | 2026-07-27 14:30 |
| HP | 0 | 0 | 0 | 11 | 11 | 2026-07-27 14:30 |
| jSQL | 0 | 0 | 0 | 11 | 11 | 2026-07-27 14:30 |
| UptimeRobot | 0 | 0 | 0 | 10 | 10 | 2026-07-27 14:30 |
| Pingdom.com_bot_version_1.4_(http: | 0 | 0 | 0 | 10 | 10 | 2026-07-27 14:30 |
| GTmetrix | 0 | 0 | 0 | 10 | 10 | 2026-07-27 14:30 |
| Uptrends | 0 | 0 | 0 | 10 | 10 | 2026-07-27 14:30 |
| bot | 0 | 0 | 0 | 10 | 10 | 2026-07-27 14:30 |
| AspiegelBot | 0 | 0 | 0 | 10 | 10 | 2026-07-27 14:30 |
| BUbiNG | 0 | 0 | 0 | 10 | 10 | 2026-07-27 14:30 |
| SEOkicks-Robot | 0 | 0 | 0 | 10 | 10 | 2026-07-27 14:30 |
| SerpstatBot | 0 | 0 | 0 | 10 | 10 | 2026-07-27 14:30 |
| Facebot | 0 | 0 | 0 | 10 | 10 | 2026-07-29 14:17 |
| LinkedInBot | 0 | 0 | 0 | 8 | 8 | 2026-07-27 14:30 |
| Discordbot | 0 | 0 | 0 | 8 | 8 | 2026-07-27 14:30 |
| Slackbot-LinkExpanding | 0 | 0 | 0 | 8 | 8 | 2026-07-27 14:30 |
| Opera | 0 | 0 | 0 | 7 | 7 | 2026-08-05 22:38 |
| req | 0 | 0 | 0 | 7 | 7 | 2026-07-27 15:56 |
| Python | 0 | 0 | 0 | 5 | 5 | 2026-07-15 08:06 |
| QwantifyBot | 0 | 0 | 0 | 5 | 5 | 2026-08-01 23:30 |
| OAI-SearchBot | 0 | 0 | 0 | 4 | 4 | 2026-08-01 18:02 |
| VelenPublicWebCrawler | 0 | 0 | 0 | 4 | 4 | 2026-08-01 10:44 |
| meta-externalagent | 0 | 0 | 0 | 3 | 3 | 2026-07-24 04:13 |
| ev-crawler | 0 | 0 | 0 | 3 | 3 | 2026-07-26 07:42 |
| domains-distillery | 0 | 0 | 0 | 3 | 3 | 2026-07-23 06:36 |
| firefox | 0 | 0 | 0 | 2 | 2 | 2026-06-29 06:13 |
| User-Agent:Mozilla | 0 | 0 | 0 | 2 | 2 | 2026-06-29 15:34 |
| wp2shell | 0 | 0 | 0 | 2 | 2 | 2026-07-27 13:13 |
| MetaCrawler | 0 | 0 | 0 | 2 | 2 | 2026-07-30 05:01 |
| Spider_Bot | 0 | 0 | 0 | 2 | 2 | 2026-07-31 01:06 |
| TikTokSpider | 0 | 0 | 0 | 1 | 1 | 2026-07-05 18:03 |
| SiteDown | 0 | 0 | 0 | 1 | 1 | 2026-07-08 04:26 |
| S33DBot | 0 | 0 | 0 | 1 | 1 | 2026-07-08 15:41 |
| YisouSpider | 0 | 0 | 0 | 1 | 1 | 2026-07-12 09:10 |
| WarmBadge-Trawler | 0 | 0 | 0 | 1 | 1 | 2026-07-13 08:15 |
| AkoniLeadHuntBot | 0 | 0 | 0 | 1 | 1 | 2026-07-21 07:37 |
| MetaJobBot | 0 | 0 | 0 | 1 | 1 | 2026-07-21 07:51 |
| rc-crawler | 0 | 0 | 0 | 1 | 1 | 2026-07-25 17:14 |
| Amuninni-WixFinder | 0 | 0 | 0 | 1 | 1 | 2026-07-25 19:02 |
| PipericBot | 0 | 0 | 0 | 1 | 1 | 2026-07-27 23:49 |
| tranco-crawler | 0 | 0 | 0 | 1 | 1 | 2026-07-28 18:24 |
| jscrawler | 0 | 0 | 0 | 1 | 1 | 2026-07-28 23:41 |
| CmsScaner | 0 | 0 | 0 | 1 | 1 | 2026-08-03 06:25 |
| IsonSearchBot | 0 | 0 | 0 | 1 | 1 | 2026-08-03 09:37 |
| BundlabsBot | 0 | 0 | 0 | 1 | 1 | 2026-08-03 14:44 |
| python-httpx | 0 | 0 | 0 | 1 | 1 | 2026-08-03 18:17 |
| MojeekBot | 0 | 0 | 0 | 1 | 1 | 2026-08-05 12:43 |
| bingbot | 0 | 8,798 | 6,472 | 0 | 15,270 | 2026-08-06 00:39 |
| Meta External Agent | 0 | 0 | 0 | 10,980 | 10,980 | 2026-08-05 23:05 |
| Sogou | 4,412 | 0 | 0 | 0 | 4,412 | 2026-08-06 00:38 |
| DotBot | 0 | 0 | 0 | 1,015 | 1,015 | 2026-08-06 00:18 |
| Googlebot | 0 | 709 | 0 | 52 | 761 | 2026-08-05 23:25 |
| Mozilla | 634 | 0 | 0 | 13 | 647 | 2026-08-05 23:04 |
| SemrushBot | 0 | 0 | 0 | 531 | 531 | 2026-08-06 00:06 |
| Turnitin | 0 | 0 | 0 | 444 | 444 | 2026-08-02 07:43 |
| DataForSeoBot | 0 | 0 | 0 | 190 | 190 | 2026-08-05 16:08 |
| Baiduspider | 129 | 0 | 0 | 0 | 129 | 2026-08-06 00:30 |
| Amazonbot | 0 | 0 | 0 | 72 | 72 | 2026-08-05 21:47 |
| SERankingBacklinksBot | 0 | 0 | 0 | 54 | 54 | 2026-08-05 18:35 |
| Dalvik | 0 | 0 | 0 | 39 | 39 | 2026-08-06 00:12 |
| Applebot | 33 | 0 | 0 | 0 | 33 | 2026-08-05 19:57 |
| ClaudeBot | 0 | 0 | 0 | 19 | 19 | 2026-08-05 22:33 |
| YandexBot | 17 | 0 | 0 | 0 | 17 | 2026-08-05 23:11 |
| SiteLockSpider | 0 | 0 | 0 | 12 | 12 | 2026-08-04 07:49 |
| meta-webindexer | 0 | 0 | 0 | 12 | 12 | 2026-08-06 00:00 |
| MJ12bot | 0 | 0 | 0 | 11 | 11 | 2026-08-05 22:22 |
| Hello | 0 | 0 | 0 | 6 | 6 | 2026-08-04 18:42 |
| Pinterestbot | 0 | 0 | 0 | 6 | 6 | 2026-08-05 23:58 |
| DnBCrawler-Analytics | 0 | 0 | 0 | 6 | 6 | 2026-08-05 11:03 |
| python-requests | 0 | 0 | 0 | 4 | 4 | 2026-08-04 03:55 |
| ZoominfoBot | 0 | 0 | 0 | 4 | 4 | 2026-08-03 10:13 |
| Opera | 0 | 0 | 0 | 4 | 4 | 2026-08-05 22:38 |
| VelenPublicWebCrawler | 0 | 0 | 0 | 4 | 4 | 2026-08-01 10:44 |
| curl | 0 | 0 | 0 | 3 | 3 | 2026-08-03 23:52 |
| QwantifyBot | 0 | 0 | 0 | 2 | 2 | 2026-08-01 23:30 |
| GPTBot | 0 | 0 | 0 | 1 | 1 | 2026-08-01 21:53 |
| PerplexityBot | 0 | 0 | 0 | 1 | 1 | 2026-08-01 00:38 |
| OAI-SearchBot | 0 | 0 | 0 | 1 | 1 | 2026-08-01 18:02 |
| CmsScaner | 0 | 0 | 0 | 1 | 1 | 2026-08-03 06:25 |
| IsonSearchBot | 0 | 0 | 0 | 1 | 1 | 2026-08-03 09:37 |
| BundlabsBot | 0 | 0 | 0 | 1 | 1 | 2026-08-03 14:44 |
| python-httpx | 0 | 0 | 0 | 1 | 1 | 2026-08-03 18:17 |
| MojeekBot | 0 | 0 | 0 | 1 | 1 | 2026-08-05 12:43 |
Unknown bots:
✅ 0 /
⚪ 0 /
🟨 0 /
🟥 152 (Summary (not shown in Top list))
ℹ️ Unknown bots =
These are requests we can’t clearly assign to any known crawler—often new, rare, or deliberately obfuscated bots.