#Googlebot User-agent: Googlebot Allow: *.css Allow: *.js Disallow: /searcho/ User-agent: dotbot Disallow: / User-agent: crawl Disallow: / User-agent: MegaIndex.ru Disallow: / # Other bot spider User-agent: * Disallow: /wp-admin/ Disallow: /wp-includes/ Disallow: /searcho/ Sitemap: https://jav.guru/sitemap_index.xml