# Comments appear after the "#" symbol at the start of a line, or after a directive User-agent: * # match all bots Disallow: /App_Code/ Disallow: /App_Data/ Disallow: /css/ Disallow: /js/ Disallow: /scripts/