Mercurial > hg > ywww
view robots.txt @ 50:99a730ffeaf6
more parameterisation
author | Charlie Root |
---|---|
date | Sun, 27 Jan 2019 14:24:02 -0500 |
parents | 970a4834afff |
children |
line wrap: on
line source
User-agent: * Disallow: /images/ Disallow: /facebook/ Disallow: /php/ Disallow: /tt/ Disallow: /twitter/ Disallow: /user/ Disallow: /xml/ Disallow: /books_test/ Disallow: /books_24th/ Disallow: /goodreads/