wiki:htaccessbotblocking
This is an old revision of the document!
htaccess bot blocking
1/18/24 Found excessive bot crawls in Awstats. Blocked Robots/Spiders visitors, Blocked (Majestic is MJ12bot – count 19,351+277), (AhrefsBot - count 16,360+107), (MegaIndex.ru – count 7,941+1), ( YandexBot – count 3,664+1445), (YandexImages – count 439)
wiki/htaccessbotblocking.1705600337.txt.gz · Last modified: 2024/01/18 17:52 by guidebeacon