# Ignore non-html directories User-agent: * Disallow: /images/ Disallow: /photos/ Disallow: /icons/ Disallow: /cgi-bin/