Mini Shell
Mini Shell
| Direktori : /home/kfvehpdt/maigrir-sans-regime.org/ |
| Current File : //home/kfvehpdt/maigrir-sans-regime.org/robots.txt |
User-agent: MauiBot (crawler.feedback+wc@gmail.com) Disallow: / User-agent: MegaIndex.ru Disallow: / User-agent: Semrushbot-SA Disallow: / User-agent: HTTrack Disallow: / User-agent: BLEXBot Crawl-delay: 10 User-agent: MJ12bot Crawl-delay: 10 User-agent: Seekport Crawler Crawl-delay: 10 User-agent: * Allow: / Disallow: /storage/do_xml/id/ Sitemap: http://www.maigrir-sans-regime.org/sitemap.xml