Mercurial > hg > ywww
view robots.txt @ 46:b7376319d25a
centralise db query even more
author | Charlie Root |
---|---|
date | Sun, 06 Jan 2019 12:15:42 -0500 |
parents | 970a4834afff |
children |
line wrap: on
line source
User-agent: * Disallow: /images/ Disallow: /facebook/ Disallow: /php/ Disallow: /tt/ Disallow: /twitter/ Disallow: /user/ Disallow: /xml/ Disallow: /books_test/ Disallow: /books_24th/ Disallow: /goodreads/