Anything Forums

I unblocked some bots including slurp (which eats up TONS of bandwidth) so if you see more guests it's most likely bots. I'll give them a couple of weeks to crawl new data for search engines and if I notice any rediculously eating bandwidth I'll block them again.

Archived topic from Iceteks, old topic ID:3714, old post ID:30148

What do they do?

WHy do I feel afraid??


Archived topic from Iceteks, old topic ID:3714, old post ID:30150

Nah they just crawl the site and index the content for searching. But some bots like Yahoo's slurp eat up tons of bandwidth so I had them blocked.

Archived topic from Iceteks, old topic ID:3714, old post ID:30155