User-agent: * Disallow: admin.php Disallow: /images/ Disallow: /siteweb/ Disallow: /glftpd/guests/Aria/ Disallow: /glftpd/guests/Aria2/ # Wait (number) seconds between crawl Crawl-delay: 1 # maximum rate is 1 page every 1 seconds Request-rate: 1/1 # UTC time Visit-time: 2100-1300