User-agent: * Disallow: Disallow: /cgi-bin Disallow: /backup Disallow: /conf Disallow: /test Disallow: /www_logs Disallow: /hotels/ Disallow: /images/ Disallow: /prive/ Disallow: /stat/ Disallow: /stat2000/ Disallow: /stat2001/ Disallow: /style/ Disallow: /tmp/ Disallow: /upload/ Request-rate: 1/5 # maximum rate is one page every 5 seconds Visit-time: 0000-0600 # only visit between 00:00 AM and 06:00 AM UT (GMT)