Robots.txt is a file that allows or denies robots from indexing or crawling the site if they behave as they should. Favicon.ico is an icon image that shows up in the address bar of a browser generally to the left of the uri. Neither are completely necessary and both are items you would create and store in the public html directory as you had noted.
Cheers, Chad
Dave wrote:
Hello, I'm running an apache 2.2 webserver on centos 5.3. I'm seeing frequent requests for robots.txt and favicon.ico from the logs those files should be in the document root area. What are these files, is this something the rpm installs, or do i have to retrieve or generate them? Thanks. Dave.
CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos