projects
/
irspy-moved-to-github.git
/ blobdiff
commit
grep
author
committer
pickaxe
?
search:
re
summary
|
shortlog
|
log
|
commit
|
commitdiff
|
tree
raw
|
inline
| side by side
improve table design for main table
[irspy-moved-to-github.git]
/
web
/
htdocs
/
robots.txt
diff --git
a/web/htdocs/robots.txt
b/web/htdocs/robots.txt
index
d19bcff
..
a0fdc6c
100644
(file)
--- a/
web/htdocs/robots.txt
+++ b/
web/htdocs/robots.txt
@@
-1,6
+1,7
@@
User-agent: *
Disallow: /admin/
Disallow: /add.html
User-agent: *
Disallow: /admin/
Disallow: /add.html
+Disallow: /add_target.html
Disallow: /all.html
Disallow: /doc.html
Disallow: /find.html
Disallow: /all.html
Disallow: /doc.html
Disallow: /find.html
@@
-9,3
+10,6
@@
Disallow: /raw.html
Disallow: /stats.html
Disallow: /upload.html
Disallow: /stats.html
Disallow: /upload.html
+User-agent: rogerbot
+Disallow: /
+