Mercurial > hg > ywww

diff robots.txt @ 6:077b0a0a3e6d

Find changesets by keywords (author, files, the commit message), revision number or hash, or revset expression.
remaining originals according to dependency walk
author Robert Boland <robert@markup.co.uk>
date Thu, 16 Feb 2017 22:29:02 +0000
parents
children 970a4834afff
line wrap: on
line diff
--- /dev/null	Thu Jan 01 00:00:00 1970 +0000
+++ b/robots.txt	Thu Feb 16 22:29:02 2017 +0000
@@ -0,0 +1,10 @@
+User-agent: *
+Disallow: /images/
+Disallow: /facebook/
+Disallow: /php/
+Disallow: /tt/
+Disallow: /twitter/
+Disallow: /user/
+Disallow: /xml/
+Disallow: /books_test/
+Disallow: /books_24th/