Mercurial > hg > ywww

view robots.txt @ 56:5f772caee9a7

Find changesets by keywords (author, files, the commit message), revision number or hash, or revset expression.
try getting review from DB if throttled
author Charlie Root
date Fri, 07 Jun 2019 16:36:06 -0400
parents 970a4834afff
children
line wrap: on
line source

User-agent: *
Disallow: /images/
Disallow: /facebook/
Disallow: /php/
Disallow: /tt/
Disallow: /twitter/
Disallow: /user/
Disallow: /xml/
Disallow: /books_test/
Disallow: /books_24th/
Disallow: /goodreads/