User-Agent: * Disallow: /admin/ Disallow: /etc/ Disallow: /cgi/ Disallow: /csv/ Disallow: /pdf/_*.pdf$ Disallow: /_*/ Disallow: /topnews.html Disallow: /holiday.html Disallow: /*.aspx