User-agent: * Disallow: /crm/ Disallow: /keywords.doc/ Disallow: /aspnet_client/ Disallow: /common_includes/ Disallow: /old_site/