comparison robots.txt @ 12:970a4834afff

Testing hg - add folder to robots.txt
author Rob Boland <robert@metail.co.uk>
date Fri, 17 Feb 2017 15:24:17 +0000
parents 077b0a0a3e6d
children
comparison
equal deleted inserted replaced
7:1dfe64e365a0 12:970a4834afff
6 Disallow: /twitter/ 6 Disallow: /twitter/
7 Disallow: /user/ 7 Disallow: /user/
8 Disallow: /xml/ 8 Disallow: /xml/
9 Disallow: /books_test/ 9 Disallow: /books_test/
10 Disallow: /books_24th/ 10 Disallow: /books_24th/
11 Disallow: /goodreads/