Skip to content

Commit bbe2a98

Browse files
committed
test
1 parent 831ae03 commit bbe2a98

File tree

1 file changed

+2
-1
lines changed

1 file changed

+2
-1
lines changed

ReadMe.md

+2-1
Original file line numberDiff line numberDiff line change
@@ -268,7 +268,8 @@ Scrapy是一个基于Twisted的开源的Python爬虫框架,在工业中应用
268268
User-agent: 指定对哪些爬虫生效
269269
Disallow: 指定不允许访问的网址
270270
Allow: 指定允许访问的网址
271-
注意: 一个英文要大写,冒号是英文状态下,冒号后面有一个空格,"/"代表整个网站
271+
272+
注意: 一个英文要大写,冒号是英文状态下,冒号后面有一个空格,"/"代表整个网站
272273

273274
### Robots协议举例
274275

0 commit comments

Comments
 (0)