Implemented robots.txt rules.
authorAdam Dickmeiss <adam@indexdata.dk>
Sun, 10 Dec 2000 22:27:48 +0000 (22:27 +0000)
committerAdam Dickmeiss <adam@indexdata.dk>
Sun, 10 Dec 2000 22:27:48 +0000 (22:27 +0000)
commit563c2ed58045d7cd4c977af162f13d1fa308b4a5
tree4a69c037012e4099bfca1d778fa14fb1338a69cf
parent04f32b20fae8795aab0c1f8b703394056f3efea3
Implemented robots.txt rules.
robot.tcl