Subject: infinite recursion in cecil web
From: Scott Rose (rose@cs.washington.edu)
Date: Sun Sep 24 2000 - 03:57:03 PDT
There is a "www" symlink in the Cecil web. That would be okay, but
there are references in the web that follow that link. That leads to
arbitrarily long URLs. So, there is a rule in robots.txt that forbids
decending that. That would be okay, except we are being pounded by a
robot that ignores that file. And, those recursive hits are very
expensive, very hard on the server. Could you fix this problem? And
let me know that you have?
This archive was generated by hypermail 2b25 : Tue Oct 03 2000 - 15:21:52 PDT