Anything Forums

Hi all, would it be at all possible to make something that records all of the people who came to my site and it also shows there Ip address? Because I want to be able to block the google bots.

Archived topic from Iceteks, old topic ID:3512, old post ID:28455

No offence, but that is one of the dumbest things I've heard a webmaster say.

Google brings in so many hits to websites, it's like a theme park asking the city to close the road right infront of their entrance.

Archived topic from Iceteks, old topic ID:3512, old post ID:28456

Yeah true, I would not block the google bots, or any other search engine. If you don't have 200GB of monthly bandwidth, you may want to block Yahoo (slurp) though, but that's the only one I'd block. Even when blocked, I get a few thousand attempts from it per month.

Here it's a fully custom system, but simply put there's an admin part to it and a tracker part to it. The tracker is included via php include() function on top of every page. The tracker will check if there's any rules (same concept as a firewall rule) that matches with the IP, user agent, or referrer. If yes it applies it and does the action (such as block, but not continuing to load the page) if not it goes on.

Each time it also adds a log entry - aka page view to a text file which is then imported into my LAN server's stat database/log viewer.

But before you ask, this code is not available to public.

Archived topic from Iceteks, old topic ID:3512, old post ID:28458

gay... no i want to do this to one of the pages that is meant for my dad so like i want to block out everyone or maybe i could just make a password nvm lol.

Archived topic from Iceteks, old topic ID:3512, old post ID:28459

Yeah just make it password protected. Or if the data is not too sensible just put it in a folder but don't link to it from anywhere. googlebot will only get to pages that are linked from other pages that google is aware of. (other sites, home page, etc)

Archived topic from Iceteks, old topic ID:3512, old post ID:28461

Ok cool now how the heck do i make a password protected page? It sounds like a challenge.

Archived topic from Iceteks, old topic ID:3512, old post ID:28463

If you only want to track visitors so you can block the respected search engine bots I really wouldn't bother. They all respect a robots.txt file entry or meta tags so i would just use those.



Archived topic from Iceteks, old topic ID:3512, old post ID:28476