User-agent: * Disallow: /*.html$ Disallow: /*.asp$