{"id":2603,"date":"2019-04-03T11:34:06","date_gmt":"2019-04-03T03:34:06","guid":{"rendered":"https:\/\/www.baishitou.cn\/?p=2603"},"modified":"2020-12-15T14:53:24","modified_gmt":"2020-12-15T06:53:24","slug":"robots-txt%e5%ae%89%e5%85%a8%e8%ae%be%e7%bd%ae","status":"publish","type":"post","link":"https:\/\/www.baishitou.cn\/2603.html","title":{"rendered":"\u7f51\u7ad9robots.txt\u6587\u4ef6\u7684\u5b89\u5168\u8bbe\u7f6e"},"content":{"rendered":"<p>\u5927\u5bb6\u90fd\u77e5\u9053robots.txt\u6587\u4ef6\uff0c\u80fd\u9650\u5236\u641c\u7d22\u5f15\u64ce\u53ef\u4ee5\u6293\u53d6\u54ea\u4e9b\u5185\u5bb9\uff0c\u4e0d\u51c6\u6293\u53d6\u54ea\u4e9b\u5185\u5bb9\u3002\u6bd4\u5982\u6211\u4eec\u7f51\u7ad9\u7684\u540e\u53f0\u5c31\u4e0d\u5e0c\u671b\u88ab\u641c\u7d22\u6293\u53d6\uff0c\u90a3\u4e48robots\u6587\u4ef6\u9700\u8981\u8fd9\u6837\u5199\uff1a<\/p>\n<pre class=\"pure-highlightjs\"><code class=\"\">User-agent: *\r\nDisallow: \/dede\/<\/code><\/pre>\n<p>\u4f46\u662f\uff0c\u5982\u679c\u6709\u4eba\u8981\u7834\u89e3\u7f51\u7ad9\u7684\u8bdd\uff0c\u901a\u8fc7robots\u6587\u4ef6\u5f88\u5bb9\u6613\u5c31\u77e5\u9053\u4e86\u540e\u53f0\u5730\u5740\uff0c\u6e05\u695a\u4e86\u7f51\u7ad9\u7684\u7ed3\u6784\u3002\u8fd9\u5bf9\u7f51\u7ad9\u5b89\u5168\u9020\u6210\u4e86\u5a01\u80c1\uff0c\u6211\u4eec\u5e76\u4e0d\u5e0c\u671b\u8fd9\u6837\uff01\u4e0b\u9762\u6709\u4e24\u79cd\u65b9\u6cd5\u89e3\u51b3\u8fd9\u4e2a\u95ee\u9898<\/p>\n<h2>\u4e00\u3001\u4f7f\u7528\u901a\u7b26\uff08*\uff09<\/h2>\n<pre class=\"pure-highlightjs\"><code class=\"\">User-agent: *\r\nDisallow: \/d*\/<\/code><\/pre>\n<p>\u8fd9\u79cd\u7684\u5199\u6cd5\u662f\u7981\u6b62\u6240\u6709\u7684\u641c\u7d22\u5f15\u64ce\u6293\u53d6\u6839\u76ee\u5f55\u4e0bd\u5f00\u5934\u7684\u76ee\u5f55\u3002\u90a3\u4e48\uff0c\u5f53\u4f60\u7684\u540e\u53f0\u662fdede5\u7684\u65f6\u5019\uff0c\u8fd8\u6709\u8c01\u4f1a\u731c\u5f97\u5230\u5462\uff1f<\/p>\n<h2>\u4e8c\u3001\u53ea\u5199\u524d\u51e0\u4e2a\u5b57\u6bcd<\/h2>\n<pre class=\"pure-highlightjs\"><code class=\"\">User-agent: *\r\nDisallow: \/de\/<\/code><\/pre>\n<p>\u8fd9\u6837\u5199\u662f\u7981\u6b62\u6240\u6709\u7684\u641c\u7d22\u5f15\u64ce\u6293\u53d6\u6839\u76ee\u5f55\u4e0bde\u5f00\u5934\u7684\u76ee\u5f55\u3002\u5982\u679c\u4f60\u7684\u5176\u4ed6\u680f\u76ee\u6709de\u5f00\u5934\u7684\uff0c\u4f60\u5c31\u8981\u5728robots.txt\u6587\u4ef6\u91cc\u9762\u591a\u5199\u4e00\u4e2a\u5b57\u6bcd\u3002<\/p>\n","protected":false},"excerpt":{"rendered":"<p>\u5927\u5bb6\u90fd\u77e5\u9053robots.txt\u6587\u4ef6\uff0c\u80fd\u9650\u5236\u641c\u7d22\u5f15\u64ce\u53ef\u4ee5\u6293\u53d6\u54ea\u4e9b\u5185\u5bb9\uff0c\u4e0d\u51c6\u6293\u53d6\u54ea\u4e9b\u5185\u5bb9\u3002\u6bd4\u5982\u6211\u4eec\u7f51\u7ad9\u7684\u540e\u53f0\u5c31\u4e0d\u5e0c [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[2],"tags":[422,861],"class_list":["post-2603","post","type-post","status-publish","format-standard","hentry","category-wljs","tag-robots-txt","tag-861"],"_links":{"self":[{"href":"https:\/\/www.baishitou.cn\/wp-json\/wp\/v2\/posts\/2603","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.baishitou.cn\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.baishitou.cn\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.baishitou.cn\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.baishitou.cn\/wp-json\/wp\/v2\/comments?post=2603"}],"version-history":[{"count":0,"href":"https:\/\/www.baishitou.cn\/wp-json\/wp\/v2\/posts\/2603\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.baishitou.cn\/wp-json\/wp\/v2\/media?parent=2603"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.baishitou.cn\/wp-json\/wp\/v2\/categories?post=2603"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.baishitou.cn\/wp-json\/wp\/v2\/tags?post=2603"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}