User-Agent: *# Disallow all crawlers access to certain pages. Allow: /