Mercurial > hg > hstweb

annotate robots.txt @ 104:05bcaa6d2aa0

Find changesets by keywords (author, files, the commit message), revision number or hash, or revset expression.
by script
author Henry S. Thompson <ht@markup.co.uk>
date Sat, 28 Dec 2024 11:48:58 +0000
parents a26469c9553e
children
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
rev   line source
28
Henry S. Thompson <ht@inf.ed.ac.uk>
parents: 0
diff changeset
1 User-agent: *
Henry S. Thompson <ht@inf.ed.ac.uk>
parents: 0
diff changeset
2 Disallow: /cc/
102
a26469c9553e get years right
Henry S. Thompson <ht@markup.co.uk>
parents: 81
diff changeset
3 Disallow: /cc_2024/
a26469c9553e get years right
Henry S. Thompson <ht@markup.co.uk>
parents: 81
diff changeset
4 Disallow: /cc_2023/
a26469c9553e get years right
Henry S. Thompson <ht@markup.co.uk>
parents: 81
diff changeset
5 Disallow: /cc_2022/
a26469c9553e get years right
Henry S. Thompson <ht@markup.co.uk>
parents: 81
diff changeset
6 Disallow: /cc_2021/
a26469c9553e get years right
Henry S. Thompson <ht@markup.co.uk>
parents: 81
diff changeset
7 Disallow: /cc_2020/
a26469c9553e get years right
Henry S. Thompson <ht@markup.co.uk>
parents: 81
diff changeset
8 Disallow: /cc_2019/
81
cf7a7955e547 getting started, LATE
Henry S. Thompson <hst@hst.name>
parents: 28
diff changeset
9 Disallow: /SNCO/