There is a reason why spiders have to keep coming back here. Because the content changes so often, the website must be re-spidered all the time just to allow for content matches to be provided for new content in posts. This happens on all forums that are registered with search engines.
The more content that is spidered, the more people will generate matches to this site. Thus, spiders are good for generating traffic. They can be a bit of a problem with bandwidth though, but usually they suck up no more than a single guest.
|