问题描述
我如何使用htaccess阻止所有Bot.所有漫游器都意味着所有漫游器,甚至Google或任何漫游器都不应访问我的网站.我正在网站中使用自定义index.html页面,并且还安装了后端Wordpress.
How can i block all Bots with htaccess. All bots means all Bots, Not even Google or any Bot Should Access My Site.I am Using custom index.html Page in my site, and in back-end Wordpress is also installed.
推荐答案
无法禁止全部,但您可以禁止一些知名的.要阻止Google,Yandex和其他知名搜索引擎,请检查其文档,或添加HTML机械手NOINDEX,nofollow元标记.
There is no way to ban all, but you could ban some well known ones. To block Google, Yandex, and other well known search engines, check their documentation, or add HTML robots NOINDEX, nofollow meta tag.
对于Google,请检查 Googlebots机器人文档.或直接添加Google机器人:
For Google check Googlebots bot doc they have. Or simply add Google bots:
RewriteCond %{HTTP_USER_AGENT} ^Googlebot [OR]
RewriteCond %{HTTP_USER_AGENT} ^Mediapartners [OR]
RewriteCond %{HTTP_USER_AGENT} ^AdsBot [OR]
对于.htaccess,您将有一个很长的列表,例如:
For .htaccess you will have a long list like:
RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} ^BlackWidow [OR]
RewriteCond %{HTTP_USER_AGENT} ^Bot\ mailto:[email protected] [OR]
RewriteCond %{HTTP_USER_AGENT} ^ChinaClaw [OR]
RewriteCond %{HTTP_USER_AGENT} ^Custo [OR]
RewriteCond %{HTTP_USER_AGENT} ^DISCo [OR]
RewriteCond %{HTTP_USER_AGENT} ^Download\ Demon [OR]
RewriteCond %{HTTP_USER_AGENT} ^eCatch [OR]
RewriteCond %{HTTP_USER_AGENT} ^EirGrabber [OR]
RewriteCond %{HTTP_USER_AGENT} ^EmailSiphon [OR]
RewriteCond %{HTTP_USER_AGENT} ^EmailWolf [OR]
RewriteCond %{HTTP_USER_AGENT} ^Express\ WebPictures [OR]
RewriteCond %{HTTP_USER_AGENT} ^ExtractorPro [OR]
#... more entries, not showing you the whole list
# as it may contain false positives, find them yourself.
RewriteCond %{HTTP_USER_AGENT} ^Web\ Sucker [OR]
RewriteCond %{HTTP_USER_AGENT} ^WebAuto [OR]
RewriteCond %{HTTP_USER_AGENT} ^WebCopier [OR]
RewriteCond %{HTTP_USER_AGENT} ^WebFetch [OR]
RewriteCond %{HTTP_USER_AGENT} ^WebGo\ IS [OR]
RewriteCond %{HTTP_USER_AGENT} ^WebLeacher [OR]
RewriteCond %{HTTP_USER_AGENT} ^WebReaper [OR]
RewriteCond %{HTTP_USER_AGENT} ^WebSauger [OR]
RewriteCond %{HTTP_USER_AGENT} ^Website\ eXtractor [OR]
RewriteCond %{HTTP_USER_AGENT} ^Website\ Quester [OR]
RewriteCond %{HTTP_USER_AGENT} ^WebStripper [OR]
RewriteCond %{HTTP_USER_AGENT} ^WebWhacker [OR]
RewriteCond %{HTTP_USER_AGENT} ^WebZIP [OR]
RewriteCond %{HTTP_USER_AGENT} ^Wget [OR]
RewriteCond %{HTTP_USER_AGENT} ^Widow [OR]
RewriteCond %{HTTP_USER_AGENT} ^WWWOFFLE [OR]
RewriteCond %{HTTP_USER_AGENT} ^Xaldon\ WebSpider [OR]
RewriteCond %{HTTP_USER_AGENT} ^Zeus
RewriteRule .* - [F]
找到所需的列表,或查看机器人页面以查看其设置的参数.我从正在运行的应用程序之一中找到了此设置.
Find the list you want, or check bots pages to see what params they are setting. I found this setting from one of the applications I am running.
这篇关于如何使用Htaccess阻止包括Google Bot和所有其他Bot在内的所有Bot的文章就介绍到这了,希望我们推荐的答案对大家有所帮助,也希望大家多多支持!