Mercurial > hg > ywww

view robots.txt @ 38:c24ae74bf6d5

Find changesets by keywords (author, files, the commit message), revision number or hash, or revset expression.
pass char for log lines in to doAmazonRequest
author Charlie Root
date Fri, 04 Jan 2019 18:02:20 -0500
parents 970a4834afff
children
line wrap: on
line source

User-agent: *
Disallow: /images/
Disallow: /facebook/
Disallow: /php/
Disallow: /tt/
Disallow: /twitter/
Disallow: /user/
Disallow: /xml/
Disallow: /books_test/
Disallow: /books_24th/
Disallow: /goodreads/