Interesting Robot Crawl Logged
Posted: Sun May 25, 2003 9:38 pm
Seems like someone is working on making their own search engine and has a bot and everything. IceTeks got crawled by it! Not sure how it found us, but it's pretty sophisticated!
http://www.otthon.net/search/
The actual search engine does not seem to have been released though. He's just working on the bot. It's pretty cool we got crawled.
I've always wanted to make my own search engine myself, just for fun, but I can't seem to figure out tcp/ip winsock. Once I have a linux box I might do some Linux programming and go from there instead. Linux sockets are much more reliable anyway. Winsock sucks for programing (not enough error handling causes unwanted behavior)
Archived topic from Iceteks, old topic ID:753, old post ID:6308
http://www.otthon.net/search/
The actual search engine does not seem to have been released though. He's just working on the bot. It's pretty cool we got crawled.
I've always wanted to make my own search engine myself, just for fun, but I can't seem to figure out tcp/ip winsock. Once I have a linux box I might do some Linux programming and go from there instead. Linux sockets are much more reliable anyway. Winsock sucks for programing (not enough error handling causes unwanted behavior)
Archived topic from Iceteks, old topic ID:753, old post ID:6308