| 44 different robots | Hits | Bandwidth | Last visit |
|---|
| Unknown robot (identified by 'bot*') | 480,140+7300 | 20.59 GB | 30 Jun 2021 - 23:59 |
| Unknown robot (identified by 'crawl') | 148,578+1395 | 3.58 GB | 30 Jun 2021 - 23:59 |
| Googlebot | 29,582+1891 | 2.37 GB | 30 Jun 2021 - 23:59 |
| Python-urllib | 49+1 | 4.01 MB | 30 Jun 2021 - 23:59 |
| Unknown robot (identified by 'robot') | 14,386+267 | 983.24 MB | 30 Jun 2021 - 23:59 |
| MJ12bot | 130,946+1294 | 1.64 GB | 30 Jun 2021 - 23:58 |
| Unknown robot (identified by empty user agent string) | 1,325+9 | 15.97 MB | 30 Jun 2021 - 23:56 |
| MagpieRSS | 2+8752 | 1.41 MB | 30 Jun 2021 - 23:56 |
| CFNetwork | 39,373 | 43.60 MB | 30 Jun 2021 - 23:51 |
| Unknown robot (identified by '*bot') | 3+3 | 68.58 KB | 30 Jun 2021 - 23:30 |
| Motor | 1,724 | 13.82 MB | 30 Jun 2021 - 23:17 |
| InfoBot | 530+162 | 8.00 MB | 30 Jun 2021 - 22:58 |
| Yandex bot | 250+131 | 30.89 MB | 30 Jun 2021 - 22:42 |
| SeznamBot | 95+397 | 113.33 MB | 30 Jun 2021 - 22:31 |
| FavIconizer | 511 | 8.89 MB | 30 Jun 2021 - 22:29 |
| Sogou Spider | 1,251 | 15.34 MB | 30 Jun 2021 - 22:17 |
| Unknown robot (identified by hit on 'robots.txt') | 0+681 | 106.99 KB | 30 Jun 2021 - 22:12 |
| Unknown robot (identified by 'spider') | 325+28 | 5.61 MB | 30 Jun 2021 - 20:55 |
| FaceBook bot | 525 | 19.75 MB | 30 Jun 2021 - 20:45 |
| Web Core / Roots | 1,174 | 101.08 MB | 30 Jun 2021 - 19:56 |
| Java (Often spam bot) | 690+5 | 11.31 MB | 30 Jun 2021 - 19:31 |
| Perl tool | 5 | 810.82 KB | 28 Jun 2021 - 19:39 |
| Feedfetcher-Google | 6 | 75.23 KB | 28 Jun 2021 - 18:33 |
| Unknown robot (identified by 'checker') | 5 | 0 | 28 Jun 2021 - 16:24 |
| Yahoo Slurp | 42 | 18.86 MB | 28 Jun 2021 - 05:00 |
| Mail.ru bot | 130+105 | 43.80 MB | 28 Jun 2021 - 04:32 |
| BaiDuSpider | 60 | 475.83 KB | 28 Jun 2021 - 03:41 |
| MojeekBot | 9+9 | 93.40 KB | 26 Jun 2021 - 20:52 |
| yacy | 2+2 | 34.50 KB | 26 Jun 2021 - 16:35 |
| Unknown robot (identified by 'discovery') | 4 | 50.06 KB | 26 Jun 2021 - 13:35 |
| BBot | 40+13 | 1.12 MB | 25 Jun 2021 - 18:51 |
| WebCopy | 2 | 12.52 KB | 23 Jun 2021 - 11:57 |
| InternetArchive | 12 | 0 | 22 Jun 2021 - 01:36 |
| LinkChecker | 58+1 | 14.76 MB | 17 Jun 2021 - 12:31 |
| Unknown robot (identified by 'scanner') | 1 | 6.79 KB | 14 Jun 2021 - 20:42 |
| Jakarta commons-httpclient | 3 | 31.67 KB | 13 Jun 2021 - 20:01 |
| MSIECrawler | 3 | 58.47 KB | 13 Jun 2021 - 20:01 |
| NewsGator Online | 1 | 9.76 KB | 13 Jun 2021 - 20:01 |
| WGet tools | 4 | 54.89 KB | 11 Jun 2021 - 10:27 |
| Exabot | 10 | 175.51 KB | 08 Jun 2021 - 08:09 |
| Heritrix | 29+1 | 408.24 KB | 07 Jun 2021 - 06:02 |
| Phantom | 12 | 349.78 KB | 06 Jun 2021 - 14:03 |
| archive.org bot | 0+1 | 166 Bytes | 05 Jun 2021 - 13:51 |
| Netcraft | 9 | 113.48 KB | 03 Jun 2021 - 20:51 |
|