Page 1 of 1
any one know how to
Posted: Thu Oct 28, 2004 4:08 pm
by rovingcowboy
stop the web spiders from crawling though my site and backing up pages i don't what anyone to see unless they click the link to them?
thanks.
Archived topic from Iceteks, old topic ID:2788, old post ID:22872
any one know how to
Posted: Thu Oct 28, 2004 4:43 pm
by Red Squirrel
Look into setting up a robots.txt file.
http://www.robotstxt.org/wc/exclusion.html This should help you
You place the robots.txt file in your root folder.
Archived topic from Iceteks, old topic ID:2788, old post ID:22873
any one know how to
Posted: Thu Oct 28, 2004 10:16 pm
by rovingcowboy
thanks red that is what i need. but i am not sure about the meta tag it says it might not work. looks like i will have to find room on the sites and make a folder to put the pages in. then block that folder.
all that work just to keep some one from cheating on my treasure hunt style of game
Archived topic from Iceteks, old topic ID:2788, old post ID:22885