# this was created because we don't care about robots and don't want messages in our error logs regarding this file # to avoid this we simply create an empty robots.txt file and place on the root level of the server # robots.txt is used to prevent robots from crawling and/or indexing files/directories on your site # to prevent robots from visiting this site simply uncomment the two lines below # User-agent: * # Disallow: /