On Sat, 6 Jul 2002, Muhammad Faisal Rauf Danka wrote: > GOOGLE is an administration tool? hmm... anyway, you're right about the fact that yes it's not google's responsibility, admins could have a better robots.txt in their webfolders too. Not all web-robots are well trained enough to pay attention to robots.txt files though... Thanks, Ron DuFresne ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ "Cutting the space budget really restores my faith in humanity. It eliminates dreams, goals, and ideals and lets us get straight to the business of hate, debauchery, and self-annihilation." -- Johnny Hart ***testing, only testing, and damn good at it too!*** OK, so you're a Ph.D. Just don't touch anything.
This archive was generated by hypermail 2b30 : Sun Jul 07 2002 - 09:17:32 PDT