Ironworks Gaming Forum

Ironworks Gaming Forum (http://www.ironworksforum.com/forum/index.php)
-   General Discussion (http://www.ironworksforum.com/forum/forumdisplay.php?f=36)
-   -   Yahoo webcrawling bot (http://www.ironworksforum.com/forum/showthread.php?t=97787)

dplax 09-05-2007 05:23 AM

Yahoo webcrawling bot
 
Currently the active users on the forum are:

Quote:

Currently Active Users: 91 (7 members & 1 guests & 83 bots)
View Who's Online
Most users ever online was 536, 08-29-2007 at 12:56 AM.
dplax, Armen, Dundee Slaytern, Hivetyrant, wellard, Wolvenrick, Yahoo! Slurp (82), Google (1)
More than 80% of all is made up by Yahoo. Now I know that Yahoo recently started using several different IP addresses and thus the difference between Yahoo and Google web crawling isn't as big as it seems, but still...

A forum where I'm admin has the following hits from bots, according to number of requests made in September so far:

Yahoo! Slurp: 509
MSN: 109
Google: 51
Ask Jeeves: 3
Archive.org: 1

Yahoo easily outnumbers the rest combined.

Interesting discussion about it at http://www.ipsbeyond.com/forums/inde...howtopic=24698 (also contains link to a thread at Yahoo about it)

In case that first link requires logging in here's a link to the Yahoo page about it: http://suggestions.yahoo.com/detail/...orer&fid=31431 and also a link to an article on digg http://www.digg.com/software/Yahoo_S...guest_tracking

So, is Yahoo just indexing webpages or are they adding unnecessary bandwidth to servers?

dplax 09-05-2007 05:53 AM

Re: Yahoo webcrawling bot
 
Update:

Quote:

Currently Active Users: 355 (12 members & 7 guests & 336 bots)
dplax, andrewas, Armen, bubbe, CerebroDragon, hillelr, Legolas, Marty4, Sever, Unglaublich Verwustung, William, Yahoo! Slurp (335), Google (1)


All times are GMT -4. The time now is 08:51 AM.

Powered by vBulletin® Version 3.8.3
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.
©2024 Ironworks Gaming & ©2024 The Great Escape Studios TM - All Rights Reserved