Spiders - They're everywhere!

[Bibbyman]

What's the deal with all the spiders going through the Forum?  I was just checking "Who's Online" and counted 10 spiders running - some where from the same outfit.

[Jeff]

We got lots of content and we are a popular site. The search engines are always busy with trying to keep up with us.  

I actually have many spiders blocked.  I would say that 20% of our bandwidth used can be attributed to indexing by search engines. All are limited to the parts of the forum that a guest can visit and no more.