any one know how to

rovingcowboy · Post by **rovingcowboy** » Thu Oct 28, 2004 4:08 pm

stop the web spiders from crawling though my site and backing up pages i don't what anyone to see unless they click the link to them?

thanks.

Archived topic from Iceteks, old topic ID:2788, old post ID:22872

Red Squirrel · Post by **Red Squirrel** » Thu Oct 28, 2004 4:43 pm

Look into setting up a robots.txt file.

http://www.robotstxt.org/wc/exclusion.html This should help you

You place the robots.txt file in your root folder.

Archived topic from Iceteks, old topic ID:2788, old post ID:22873

rovingcowboy · Post by **rovingcowboy** » Thu Oct 28, 2004 10:16 pm

thanks red that is what i need. but i am not sure about the meta tag it says it might not work. looks like i will have to find room on the sites and make a folder to put the pages in. then block that folder.

all that work just to keep some one from cheating on my treasure hunt style of game

Archived topic from Iceteks, old topic ID:2788, old post ID:22885