Remove any robots.txt files that may exist with any web content.
Other methods must be employed if there is information on the web site that
needs protection from search engines and public view. Inspect all instances of
DocumentRoot and Alias and remove any robots.txt file.
$ sudo rm -f path/to/robots.txt