Mercurial > hg > ywww

view robots.txt @ 7:1dfe64e365a0

Find changesets by keywords (author, files, the commit message), revision number or hash, or revset expression.
a bit more debugging/bomb-proofing
author Robert Boland <robert@markup.co.uk>
date Fri, 17 Feb 2017 13:40:20 +0000
parents 077b0a0a3e6d
children 970a4834afff
line wrap: on
line source

User-agent: *
Disallow: /images/
Disallow: /facebook/
Disallow: /php/
Disallow: /tt/
Disallow: /twitter/
Disallow: /user/
Disallow: /xml/
Disallow: /books_test/
Disallow: /books_24th/