久99久人碰人视频在线,色午夜日本高清,国产各种真实精品高潮,中文字幕丰满伦子无码,午夜福利中文字幕有码,无码少妇精品 在线视频,日韩无码精品一区二区电影,日韩精品日日噜噜无码视频 http://www.vanhostingweb.com 分享技術(shù),共同進步 Sat, 30 Mar 2019 04:10:09 +0000 zh-Hans hourly 1 nginx禁止垃圾蜘蛛訪問 http://www.vanhostingweb.com/2579.html http://www.vanhostingweb.com/2579.html#respond Sat, 30 Mar 2019 04:10:09 +0000 http://www.vanhostingweb.com/?p=2579 nginx禁止垃圾蜘蛛訪問,把下列代碼放到你的nginx配置文件里面。

#禁止Scrapy等工具的抓取
if ($http_user_agent ~* (Scrapy|Curl|HttpClient)) {
     return 403;
}
#禁止指定UA及UA為空的訪問
if ($http_user_agent ~ "opensiteexplorer|MauiBot|FeedDemon|SemrushBot|Indy Library|Alexa Toolbar|AskTbFXTV|AhrefsBot|CrawlDaddy|CoolpadWebkit|Java|semrushbot|alphaseobot|semrush|Feedly|UniversalFeedParser|webmeup-crawler|ApacheBench|Microsoft URL Control|Swiftbot|ZmEu|oBot|jaunty|Python-urllib|lightDeckReports Bot|YYSpider|DigExt|HttpClient|MJ12bot|heritrix|EasouSpider|Ezooms|^$" ) {
     return 403;             
}
#禁止非GET|HEAD|POST方式的抓取
if ($request_method !~ ^(GET|HEAD|POST)$) {
    return 403;
}

 

]]>
http://www.vanhostingweb.com/2579.html/feed 0
亚洲中文色欧另类欧美,久久久久久久激情,亚洲 日韩 欧美 另类 国产,中文字幕高清无码男人的天堂 www.sucaiwu.net