Mercurial > hg > ywww

view robots.txt @ 32:8130865e9e82

Find changesets by keywords (author, files, the commit message), revision number or hash, or revset expression.
refactor to try to improve error handling
author Charlie Root
date Fri, 04 Jan 2019 09:50:55 -0500
parents 970a4834afff
children
line wrap: on
line source

User-agent: *
Disallow: /images/
Disallow: /facebook/
Disallow: /php/
Disallow: /tt/
Disallow: /twitter/
Disallow: /user/
Disallow: /xml/
Disallow: /books_test/
Disallow: /books_24th/
Disallow: /goodreads/