User-agent: * sitemap: sitemapxml.php # directory Disallow: /admin/ Disallow: /ajax/ Disallow: /classes/ Disallow: /include/ Disallow: /js/ Disallow: /sitemap/ # file