User-agent: * Disallow: /page/ Disallow: /*.asp Disallow: /ad*/ Disallow: /up_files/ Disallow: /temp*/