projects / tclrobot.git / commit
? search:
summary | shortlog | log | commit | commitdiff | tree
(parent: ea1f20b) | patch
MIME check when reading HTTP header (not when reading content).
authorAdam Dickmeiss <adam@indexdata.dk>
Tue, 13 Nov 2001 11:17:26 +0000 (11:17 +0000)
committerAdam Dickmeiss <adam@indexdata.dk>
Tue, 13 Nov 2001 11:17:26 +0000 (11:17 +0000)
commit7476a63e6732f7f51eea10bf38daaea4a31be57f
tree9f2e7894295eac090b592279ad8ab3a06ce787a4tree | snapshot
parentea1f20b132694037f8a3a8c3ed03e972d64f1a68commit | diff
MIME check when reading HTTP header (not when reading content).
File robots.txt always read - even when text/plain is denied.
robot.tcl diff | blob | history
Simple Web harvester