# Robots Configuration File ---------------------------------------------------- # This file is used to configure what automatic web page 'robots' may not # read. User-agent: * Disallow: /cgi-bin/ Disallow: /images/ Disallow: /scripts.js Disallow: /styles.css