171 different robots | Hits | Bandwidth | Last visit |
sift | 266,477+383 | 3.70 GB | 29 Mar 2024 - 06:14 |
bingbot | 616,533+145 | 5.33 GB | 29 Mar 2024 - 06:14 |
Unknown robot (identified by hit on robots.txt) | 0+44202 | 36.44 MB | 29 Mar 2024 - 06:14 |
Googlebot | 430,940+687 | 41.32 GB | 29 Mar 2024 - 06:14 |
feed | 92,773+42 | 4.69 GB | 29 Mar 2024 - 06:14 |
Googlebot-Image | 49,045 | 3.60 GB | 29 Mar 2024 - 06:13 |
CFNetwork | 66,839 | 789.88 MB | 29 Mar 2024 - 06:13 |
YandexBot | 122,542+6808 | 1.39 GB | 29 Mar 2024 - 06:13 |
nbot | 58,612+494 | 2.00 GB | 29 Mar 2024 - 06:13 |
Applebot | 16,683+28 | 214.40 MB | 29 Mar 2024 - 06:13 |
crawl | 43,620+1274 | 2.55 GB | 29 Mar 2024 - 06:12 |
CCBot | 5,273+4314 | 87.06 MB | 29 Mar 2024 - 06:12 |
mozilla/5.0 - ( Rogue Robot ) | 51,628+1 | 277.25 MB | 29 Mar 2024 - 06:12 |
Curl | 4,283 | 566.85 MB | 29 Mar 2024 - 06:12 |
emacs | 263 | 38.34 MB | 29 Mar 2024 - 06:12 |
fetcher | 1,024+4 | 26.63 MB | 29 Mar 2024 - 06:11 |
empty user agent string | 10,814+152 | 538.13 MB | 29 Mar 2024 - 06:11 |
robot | 6,783+3395 | 341.38 MB | 29 Mar 2024 - 06:11 |
Unknown robot identified by bot\* | 67,353+4909 | 2.06 GB | 29 Mar 2024 - 06:11 |
Baiduspider | 20,415 | 134.12 MB | 29 Mar 2024 - 06:11 |
DotBot | 5,344+1159 | 262.23 MB | 29 Mar 2024 - 06:07 |
linkbot | 2,074+1045 | 7.96 MB | 29 Mar 2024 - 06:05 |
regator | 5,668 | 763.13 MB | 29 Mar 2024 - 06:05 |
YandexImages | 5,039 | 219.99 MB | 29 Mar 2024 - 06:04 |
netnewswire | 7,841 | 1.10 GB | 29 Mar 2024 - 06:03 |
facebookexternalhit | 7,873+43 | 222.54 MB | 29 Mar 2024 - 06:03 |
protopage | 13,490 | 168.21 MB | 29 Mar 2024 - 06:01 |
core | 32,654+14 | 563.18 MB | 29 Mar 2024 - 05:56 |
Dalvik | 3,151 | 36.44 MB | 29 Mar 2024 - 05:56 |
favicon | 960 | 60.50 MB | 29 Mar 2024 - 05:55 |
YisouSpider | 4,441+16 | 28.75 MB | 29 Mar 2024 - 05:53 |
blog | 687 | 103.06 MB | 29 Mar 2024 - 05:52 |
netcraft | 243 | 3.50 MB | 29 Mar 2024 - 05:52 |
y!j | 8,811+32 | 167.54 MB | 29 Mar 2024 - 05:52 |
magpie | 0+3441 | 2.86 MB | 29 Mar 2024 - 05:46 |
Links ( | 669 | 2.40 MB | 29 Mar 2024 - 05:43 |
Baidu ( catchall ) | 76,277 | 2.04 GB | 29 Mar 2024 - 05:43 |
twitterbot | 1,543+475 | 42.90 MB | 29 Mar 2024 - 05:41 |
python | 5,491+2408 | 154.95 MB | 29 Mar 2024 - 05:40 |
MSIE 6 - ( Rogue Robot ) | 640 | 25.32 MB | 29 Mar 2024 - 05:40 |
facebook | 60 | 858.24 KB | 29 Mar 2024 - 05:39 |
simplepie | 569 | 86.94 MB | 29 Mar 2024 - 05:36 |
Firefox version 10 and lower - various robots | 1,934+12 | 97.94 MB | 29 Mar 2024 - 05:36 |
360Spider | 298 | 2.67 MB | 29 Mar 2024 - 05:28 |
Unknown robot identified by \*bot | 11,320+244 | 93.83 MB | 29 Mar 2024 - 05:19 |
Mail.RU Bot | 391+70 | 3.35 MB | 29 Mar 2024 - 05:11 |
MJ12bot | 607+208 | 4.25 MB | 29 Mar 2024 - 05:07 |
BingPreview | 296 | 66.24 MB | 29 Mar 2024 - 05:05 |
motor | 4,954 | 93.25 MB | 29 Mar 2024 - 05:03 |
spider | 1,628+109 | 14.88 MB | 29 Mar 2024 - 05:00 |
netvibes | 230 | 13.44 MB | 29 Mar 2024 - 04:58 |
oBot | 37,810+75 | 285.44 MB | 29 Mar 2024 - 04:54 |
Apache-HttpClient | 918+61 | 4.60 MB | 29 Mar 2024 - 04:34 |
Sogou web spider | 777+2 | 4.19 MB | 29 Mar 2024 - 04:23 |
Slackbot-LinkExpanding | 210 | 1.64 MB | 29 Mar 2024 - 04:20 |
Discordbot | 271 | 13.12 MB | 29 Mar 2024 - 04:19 |
Yandex ( catchall ) | 3,616 | 36.55 MB | 29 Mar 2024 - 04:15 |
TelegramBot | 922 | 9.40 MB | 29 Mar 2024 - 04:06 |
Mozilla ( Rogue Robot ) | 4 | 57.97 KB | 29 Mar 2024 - 03:41 |
SeznamBot | 428+61 | 181.31 MB | 29 Mar 2024 - 03:32 |
Python-urllib | 24+1 | 55.49 KB | 29 Mar 2024 - 03:18 |
wordpress | 350 | 2.35 MB | 29 Mar 2024 - 02:11 |
nutch ( catchall ) | 825+63 | 5.95 MB | 29 Mar 2024 - 02:10 |
coccoc | 4,414+268 | 53.36 MB | 29 Mar 2024 - 01:19 |
MojeekBot | 80+115 | 661.53 KB | 29 Mar 2024 - 00:48 |
RSSingBot | 34 | 3.04 MB | 29 Mar 2024 - 00:32 |
Feedfetcher-Google | 359 | 21.73 MB | 29 Mar 2024 - 00:28 |
yacybot | 359+46 | 4.22 MB | 29 Mar 2024 - 00:06 |
Yahoo! Slurp | 175+11 | 2.21 MB | 29 Mar 2024 - 00:06 |
heritrix | 80+1 | 2.89 MB | 28 Mar 2024 - 23:42 |
custo | 81 | 1.17 MB | 28 Mar 2024 - 23:24 |
link | 3,793+6 | 31.87 MB | 28 Mar 2024 - 23:19 |
Mediapartners-Google | 150 | 3.35 MB | 28 Mar 2024 - 23:10 |
archive.org_bot | 2,697+10 | 59.10 MB | 28 Mar 2024 - 22:51 |
msnbot | 3 | 16.32 KB | 28 Mar 2024 - 22:14 |
YandexMobileBot | 2,832 | 18.55 MB | 28 Mar 2024 - 21:12 |
Wget | 232+1 | 3.15 MB | 28 Mar 2024 - 20:28 |
ning | 167 | 10.59 MB | 28 Mar 2024 - 19:04 |
LinkedInBot | 48+3 | 1.08 MB | 28 Mar 2024 - 16:57 |
urllib | 21 | 2.59 MB | 28 Mar 2024 - 16:12 |
SemrushBot | 0+27 | 22.99 KB | 28 Mar 2024 - 12:23 |
MSIE 5 - ( Rogue Robot ) | 86 | 8.39 MB | 28 Mar 2024 - 10:44 |
PhantomJS | 237 | 4.79 MB | 28 Mar 2024 - 10:08 |
rome client | 44 | 2.24 MB | 28 Mar 2024 - 10:07 |
Konqueror | 186+1 | 1.34 MB | 28 Mar 2024 - 10:07 |
webcollage | 10 | 1.94 MB | 28 Mar 2024 - 09:49 |
ELinks | 90 | 3.02 MB | 28 Mar 2024 - 09:30 |
mozilla/4.0 (compatible;) - ( Rogue Robot ) | 16 | 0 | 28 Mar 2024 - 09:05 |
Java ( catchall ) | 440+1 | 25.77 MB | 28 Mar 2024 - 08:17 |
qwantify | 16+4 | 198.34 KB | 28 Mar 2024 - 04:11 |
MSIE 4 - ( Rogue Robot ) | 1 | 31.43 KB | 28 Mar 2024 - 04:08 |
Ruby script | 23 | 92.61 KB | 28 Mar 2024 - 03:24 |
FirePHP | 133 | 1.72 MB | 27 Mar 2024 - 20:10 |
YandexMetrika | 39 | 123.70 KB | 27 Mar 2024 - 19:09 |
AhrefsBot | 13+3 | 2.37 MB | 27 Mar 2024 - 07:52 |
Google Web Preview | 50 | 310.88 KB | 27 Mar 2024 - 07:41 |
Yahoo! Slurp China | 2 | 16.60 KB | 27 Mar 2024 - 04:45 |
jeeves | 25 | 129.61 KB | 27 Mar 2024 - 02:09 |
Exabot | 1 | 4.76 KB | 26 Mar 2024 - 22:38 |
DoCoMo | 1 | 17.14 KB | 26 Mar 2024 - 22:37 |
FAST-WebCrawler | 26 | 308.10 KB | 26 Mar 2024 - 22:35 |
yeti | 259+19 | 1.16 MB | 26 Mar 2024 - 22:30 |
SurdotlyBot | 10+1 | 32.10 KB | 26 Mar 2024 - 22:17 |
seo-audit-check-bot | 1 | 3.15 KB | 26 Mar 2024 - 19:16 |
Yahoo Link Preview | 5 | 266.88 KB | 26 Mar 2024 - 18:56 |
Curl/PHP | 11 | 628.48 KB | 26 Mar 2024 - 14:33 |
DuckDuckGo-Favicons-Bot | 28 | 58.07 KB | 26 Mar 2024 - 08:36 |
daumoa | 0+5 | 4.26 KB | 26 Mar 2024 - 02:13 |
ng/1. | 38 | 96.44 KB | 25 Mar 2024 - 16:24 |
coolbot | 5 | 158.33 KB | 25 Mar 2024 - 15:45 |
scanner | 4 | 44.77 KB | 25 Mar 2024 - 12:00 |
riddler | 28+5 | 978.11 KB | 25 Mar 2024 - 09:46 |
teoma | 4 | 204.21 KB | 25 Mar 2024 - 04:02 |
hometown | 78 | 1.91 MB | 25 Mar 2024 - 04:01 |
[^a]fish | 9 | 272.48 KB | 25 Mar 2024 - 04:01 |
A PHP script | 300 | 3.32 MB | 25 Mar 2024 - 02:53 |
pita | 8 | 270.79 KB | 25 Mar 2024 - 02:52 |
felix | 3 | 72.03 KB | 25 Mar 2024 - 02:52 |
discover | 71 | 1.98 MB | 25 Mar 2024 - 02:45 |
DomainStatsBot | 12+1 | 636.41 KB | 25 Mar 2024 - 00:17 |
AdsBot-Google | 19,106 | 122.49 MB | 24 Mar 2024 - 21:37 |
BLEXBot | 0+41 | 34.91 KB | 24 Mar 2024 - 16:59 |
Googlebot-Mobile | 26 | 142.61 KB | 24 Mar 2024 - 08:08 |
bobby | 2 | 29.88 KB | 23 Mar 2024 - 23:58 |
raven | 4 | 66.95 KB | 23 Mar 2024 - 23:58 |
internetarchive | 4 | 0 | 23 Mar 2024 - 20:03 |
ELinks ( | 1 | 87.37 KB | 23 Mar 2024 - 14:02 |
webcopy | 2 | 0 | 23 Mar 2024 - 13:30 |
jbot | 2 | 7.48 KB | 23 Mar 2024 - 12:44 |
Microsoft Office Protocol Discovery | 66 | 0 | 23 Mar 2024 - 09:43 |
nomad | 1 | 29.17 KB | 23 Mar 2024 - 02:46 |
linkchecker | 0+54 | 45.98 KB | 22 Mar 2024 - 23:15 |
harvest | 3 | 38.73 KB | 22 Mar 2024 - 21:12 |
Mediatoolkitbot | 2+2 | 17.62 KB | 22 Mar 2024 - 13:56 |
ia_archiver | 103 | 3.40 MB | 22 Mar 2024 - 10:34 |
proximic | 24 | 104.07 KB | 22 Mar 2024 - 10:18 |
cfetch | 8 | 29.20 KB | 21 Mar 2024 - 05:54 |
Windows 99 - ( Rogue Robot ) | 22 | 1.53 MB | 21 Mar 2024 - 03:42 |
seek | 122,800+1 | 5.13 GB | 20 Mar 2024 - 20:32 |
Nautic Expo using Firefox/1.5 | 47 | 2.20 MB | 20 Mar 2024 - 19:39 |
grub | 1 | 8.90 KB | 19 Mar 2024 - 18:37 |
Googlebot-Video | 8 | 5.81 MB | 19 Mar 2024 - 05:52 |
snappy | 11 | 31.37 KB | 19 Mar 2024 - 03:59 |
msnbot-media | 1 | 987.19 KB | 18 Mar 2024 - 13:29 |
bbot | 8+2 | 35.51 KB | 18 Mar 2024 - 05:24 |
pingdom | 32 | 933.50 KB | 17 Mar 2024 - 23:07 |
youdao | 70 | 1.34 MB | 17 Mar 2024 - 20:06 |
Jigsaw | 3 | 16.16 KB | 16 Mar 2024 - 13:26 |
yie8 | 1 | 650.80 KB | 16 Mar 2024 - 12:53 |
Screaming Frog SEO Spider | 0+10 | 8.52 KB | 15 Mar 2024 - 19:19 |
ResearchBot | 3+2 | 14.63 KB | 15 Mar 2024 - 09:21 |
Googlebot-News | 364+76 | 5.47 MB | 14 Mar 2024 - 13:44 |
voyager | 1 | 1.02 KB | 13 Mar 2024 - 15:23 |
slurp | 1 | 38.29 KB | 13 Mar 2024 - 03:26 |
ezoom | 1 | 28.39 KB | 12 Mar 2024 - 21:00 |
arks | 2 | 72.05 KB | 12 Mar 2024 - 15:29 |
feedburner | 1 | 0 | 11 Mar 2024 - 04:47 |
Xenu Link Sleuth | 3 | 90.92 KB | 09 Mar 2024 - 19:37 |
feedvalidator | 2 | 91.44 KB | 09 Mar 2024 - 16:06 |
2345Explorer | 5 | 228.00 KB | 09 Mar 2024 - 06:02 |
MixrankBot | 1 | 3.11 KB | 08 Mar 2024 - 16:43 |
libwww-perl | 1 | 16.86 KB | 08 Mar 2024 - 08:10 |
seokicks.de | 94+2 | 709.29 KB | 07 Mar 2024 - 23:53 |
Seobility | 1+1 | 28.55 KB | 07 Mar 2024 - 09:35 |
rambler | 1 | 1.02 KB | 06 Mar 2024 - 10:14 |
htmlparser | 1 | 943 Bytes | 04 Mar 2024 - 14:23 |
anthill | 1 | 59.99 KB | 04 Mar 2024 - 03:24 |
suke | 2 | 30.20 KB | 02 Mar 2024 - 04:53 |
ng/2. | 1 | 2.84 KB | 02 Mar 2024 - 03:21 |
dataprovider.com | 35+1 | 549.41 KB | 02 Mar 2024 - 00:27 |
turtle | 2 | 46.24 KB | 01 Mar 2024 - 04:49 |
|