Mercurial > hg > ywww
view robots.txt @ 41:0578c6e438d3
merge
author | Henry S. Thompson <ht@inf.ed.ac.uk> |
---|---|
date | Sun, 30 Jul 2017 05:36:48 -0400 |
parents | 970a4834afff |
children |
line wrap: on
line source
User-agent: * Disallow: /images/ Disallow: /facebook/ Disallow: /php/ Disallow: /tt/ Disallow: /twitter/ Disallow: /user/ Disallow: /xml/ Disallow: /books_test/ Disallow: /books_24th/ Disallow: /goodreads/