comparison robots.txt @ 6:077b0a0a3e6d

remaining originals according to dependency walk
author Robert Boland <robert@markup.co.uk>
date Thu, 16 Feb 2017 22:29:02 +0000
parents
children 970a4834afff
comparison
equal deleted inserted replaced
5:55445b456ad0 6:077b0a0a3e6d
1 User-agent: *
2 Disallow: /images/
3 Disallow: /facebook/
4 Disallow: /php/
5 Disallow: /tt/
6 Disallow: /twitter/
7 Disallow: /user/
8 Disallow: /xml/
9 Disallow: /books_test/
10 Disallow: /books_24th/