Google (or any other robot/search engine) might as well ignore robots.txt. I think not to trust these. Octavio. At 12:58 p.m. 06/07/2002 -0700, Muhammad Faisal Rauf Danka wrote: >GOOGLE is an administration tool? hmm... anyway, you're right about the fact that yes it's not google's responsibility, admins could have a better robots.txt in their webfolders too. >Anyway, not only google have been a tool for such searches, but i remember some folks using altavista and google both for order.log and infosearch.pl too.
This archive was generated by hypermail 2b30 : Sat Jul 06 2002 - 22:01:22 PDT