55 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'bot*') | 497,557+14278 | 7.27 GB | 30 Sep 2019 - 23:59 |
Unknown robot (identified by 'robot') | 176,484+17264 | 2.43 GB | 30 Sep 2019 - 23:59 |
MJ12bot | 120,426+1834 | 1.85 GB | 30 Sep 2019 - 22:57 |
CFNetwork | 98,499 | 120.15 MB | 30 Sep 2019 - 23:56 |
HTTrack off-line browser | 61,946+4 | 481.83 MB | 22 Sep 2019 - 19:03 |
Unknown robot (identified by 'crawl') | 39,007+42 | 587.51 MB | 30 Sep 2019 - 23:02 |
Googlebot | 31,138+240 | 1018.76 MB | 30 Sep 2019 - 23:59 |
GigaBot | 25,274+305 | 130.66 MB | 30 Sep 2019 - 23:50 |
Unknown robot (identified by empty user agent string) | 3,169+78 | 10.21 MB | 30 Sep 2019 - 23:50 |
Unknown robot (identified by 'spider') | 2,023+15 | 13.93 MB | 30 Sep 2019 - 19:52 |
Java (Often spam bot) | 1,475+5 | 34.82 MB | 30 Sep 2019 - 23:29 |
Unknown robot (identified by hit on 'robots.txt') | 0+1402 | 225.66 KB | 30 Sep 2019 - 23:40 |
FaceBook bot | 1,296 | 5.86 MB | 30 Sep 2019 - 22:12 |
FavIconizer | 925 | 5.03 MB | 30 Sep 2019 - 23:55 |
Yandex bot | 717+202 | 9.05 MB | 30 Sep 2019 - 23:05 |
SeznamBot | 259+203 | 5.17 MB | 30 Sep 2019 - 19:11 |
Motor | 453 | 2.35 MB | 28 Sep 2019 - 22:48 |
Fish search | 424 | 1.24 MB | 23 Sep 2019 - 19:08 |
Exabot | 319 | 1.24 MB | 30 Sep 2019 - 14:25 |
Sogou Spider | 139+94 | 4.19 MB | 30 Sep 2019 - 21:10 |
Python-urllib | 165+8 | 1.40 MB | 30 Sep 2019 - 23:02 |
LinkChecker | 118+1 | 29.03 MB | 26 Sep 2019 - 07:54 |
BBot | 90+19 | 1.88 MB | 30 Sep 2019 - 14:11 |
Web Core / Roots | 92 | 13.44 MB | 30 Sep 2019 - 14:55 |
Nutch | 51+14 | 1.02 MB | 29 Sep 2019 - 23:03 |
Ultraseek | 47+4 | 1.21 MB | 27 Sep 2019 - 02:40 |
Heritrix | 29+1 | 408.17 KB | 09 Sep 2019 - 09:49 |
LinkBot | 11+18 | 743.47 KB | 19 Sep 2019 - 00:28 |
Mail.ru bot | 12+16 | 884.06 KB | 30 Sep 2019 - 05:44 |
Alexa (IA Archiver) | 20+7 | 743.34 KB | 30 Sep 2019 - 10:34 |
Unknown robot (identified by '*bot') | 13+6 | 176.19 KB | 23 Sep 2019 - 20:46 |
WordPress | 19 | 1.64 MB | 29 Sep 2019 - 20:04 |
InternetArchive | 15 | 0 | 30 Sep 2019 - 16:53 |
Netcraft | 14 | 308.56 KB | 30 Sep 2019 - 22:35 |
Perl tool | 14 | 167.76 KB | 29 Sep 2019 - 16:25 |
BaiDuSpider | 11+2 | 247.96 KB | 24 Sep 2019 - 23:46 |
Phantom | 12 | 298.59 KB | 04 Sep 2019 - 12:45 |
MagpieRSS | 10 | 38.70 KB | 11 Sep 2019 - 15:12 |
Feedfetcher-Google | 9 | 40.56 KB | 27 Sep 2019 - 18:54 |
WGet tools | 8+1 | 129.37 KB | 29 Sep 2019 - 17:16 |
MojeekBot | 5+4 | 33.10 KB | 22 Sep 2019 - 23:42 |
Sift | 6 | 27.15 KB | 24 Sep 2019 - 17:56 |
Unknown robot (identified by 'checker') | 5 | 0 | 30 Sep 2019 - 10:50 |
Unknown robot (identified by 'discovery') | 3 | 0 | 12 Sep 2019 - 11:36 |
Sunrise | 2 | 8.82 KB | 07 Sep 2019 - 08:09 |
yacy | 1+1 | 4.67 KB | 14 Sep 2019 - 03:20 |
BSpider | 2 | 5.37 KB | 07 Sep 2019 - 08:09 |
W3C Link Checker | 1+1 | 166 Bytes | 08 Sep 2019 - 10:41 |
Unknown robot (identified by 'scanner') | 1 | 4.51 KB | 04 Sep 2019 - 19:48 |
Girafabot | 1 | 4.13 KB | 07 Sep 2019 - 08:07 |
Yahoo Slurp | 1 | 4.12 KB | 29 Sep 2019 - 23:43 |
lwp-trivial | 1 | 4.46 KB | 07 Sep 2019 - 08:09 |
JoBo Java Web Robot | 1 | 4.30 KB | 07 Sep 2019 - 08:09 |
Jakarta commons-httpclient | 1 | 4.23 KB | 07 Sep 2019 - 08:09 |
MSIECrawler | 1 | 4.28 KB | 07 Sep 2019 - 08:07 |
|