User-agent: * Allow: / # A8.net affiliate links point at /info/ category pagination with an ?a8= token # attached. Every token is a distinct URL to a crawler, which generated roughly # 4,900 dead pages in Search Console (1,738 x 404, 2,782 x redirect, 342 x # duplicate-canonical) and consumed the crawl budget that the real pages need. # Google applies the most specific rule, so these override the Allow above. Disallow: /*?a8= Disallow: /*&a8= Disallow: /info/wp-admin/ Allow: /info/wp-admin/admin-ajax.php Sitemap: https://www.mytutor-jpn.com/sitemap.xml Sitemap: https://www.mytutor-jpn.com/info/sitemap_index.xml