[CentOS-docs] robots.txt
Ralph Angenendt
ra+centos at br-online.de
Thu Aug 6 13:14:01 UTC 2009
Marcus Moeller wrote:
> I have again noticed that the wiki does not really show up in search
> results and wonder if it has any impact that robots.txt on
> wiki.centos.org is empty.
>
> Perhaps it should at least contain User-agent: * ?
I wonder why they ship a robots.txt at all ...
Done.
Cheers,
Ralph
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 189 bytes
Desc: not available
Url : http://lists.centos.org/pipermail/centos-docs/attachments/20090806/e4598784/attachment.bin
More information about the CentOS-docs
mailing list