Mercurial > hg > ywww

view robots.txt @ 59:e4c78b3eace7

Find changesets by keywords (author, files, the commit message), revision number or hash, or revset expression.
stop bothering Amazon.co.uk at all
author Charlie Root
date Sun, 09 Jun 2019 06:49:35 -0400
parents 970a4834afff
children
line wrap: on
line source

User-agent: *
Disallow: /images/
Disallow: /facebook/
Disallow: /php/
Disallow: /tt/
Disallow: /twitter/
Disallow: /user/
Disallow: /xml/
Disallow: /books_test/
Disallow: /books_24th/
Disallow: /goodreads/