User-agent: * Disallow: /bin/ Disallow: /classes/ Disallow: /htdocs/ Disallow: /include/ Disallow: /AssemblyInfo.vb Disallow: /Global* Disallow: /navleft.aspx Disallow: /Web.config