规范规则库的公共维护准则

bfcaicai · Jan 17, 2017 · 957d189 · 957d189
1 parent a087792
commit 957d189
Show file tree

Hide file tree

Showing 25 changed files with 39 additions and 5 deletions.
diff --git a/IJGUC.go → IJGUC/IJGUC.go b/IJGUC.go → IJGUC/IJGUC.go
diff --git a/README.md b/README.md
@@ -2,6 +2,18 @@
 
 [Pholcus](https://github.com/henrylee2cn/pholcus) 用户公共维护的spider爬虫规则库。
 
+## 维护规范
+
+- 欢迎每个用户分享自己的爬虫规则
+- 每个规则放在单一个独的子目录
+- 新增规则最好提供README.md
+- 新增规则时，须在根目录 `pholcus_lib.go` 文件的import组中添加类似`_ "github.com/henrylee2cn/pholcus_lib/jingdong"`的包引用声明
+- 新增规则时，须在根目录README.md（本文档）的 `爬虫规则列表` 中按子目录名`a-z`的顺序插入一条相应的规则记录
+- 维护旧规则时，应在规则文件或相应README.md中增加修改说明：如修改原因、修改时间、署名等
+
+
+## 爬虫规则列表
+
 |文件(夹)名称|爬虫规则描述|
 |---|---|
 |alibaba|阿里巴巴产品搜索|

diff --git a/alibaba.go → alibaba/alibaba.go b/alibaba.go → alibaba/alibaba.go
diff --git a/baidunews.go → baidunews/baidunews.go b/baidunews.go → baidunews/baidunews.go
diff --git a/baidusearch.go → baidusearch/baidusearch.go b/baidusearch.go → baidusearch/baidusearch.go
diff --git a/car_home.go → car_home/car_home.go b/car_home.go → car_home/car_home.go
diff --git a/filetest.go → filetest/filetest.go b/filetest.go → filetest/filetest.go
diff --git a/ganji_gongsi.go → ganji_gongsi/ganji_gongsi.go b/ganji_gongsi.go → ganji_gongsi/ganji_gongsi.go
diff --git a/googlesearch.go → googlesearch/googlesearch.go b/googlesearch.go → googlesearch/googlesearch.go
diff --git a/hollandandbarrett.go → hollandandbarrett/hollandandbarrett.go b/hollandandbarrett.go → hollandandbarrett/hollandandbarrett.go
diff --git a/jdsearch.go → jdsearch/jdsearch.go b/jdsearch.go → jdsearch/jdsearch.go
diff --git a/kaola.go → kaola/kaola.go b/kaola.go → kaola/kaola.go
diff --git a/lewa.go → lewa/lewa.go b/lewa.go → lewa/lewa.go
diff --git a/lib.go b/lib.go
diff --git a/miyabaobei.go → miyabaobei/miyabaobei.go b/miyabaobei.go → miyabaobei/miyabaobei.go
diff --git a/people.go → people/people.go b/people.go → people/people.go
diff --git a/pholcus_lib.go b/pholcus_lib.go
@@ -0,0 +1,27 @@
+package pholcus_lib
+
+import (
+	_ "github.com/henrylee2cn/pholcus_lib/IJGUC"
+	_ "github.com/henrylee2cn/pholcus_lib/alibaba"
+	_ "github.com/henrylee2cn/pholcus_lib/baidunews"
+	_ "github.com/henrylee2cn/pholcus_lib/baidusearch"
+	_ "github.com/henrylee2cn/pholcus_lib/car_home"
+	_ "github.com/henrylee2cn/pholcus_lib/filetest"
+	_ "github.com/henrylee2cn/pholcus_lib/ganji_gongsi"
+	_ "github.com/henrylee2cn/pholcus_lib/googlesearch"
+	_ "github.com/henrylee2cn/pholcus_lib/hollandandbarrett"
+	_ "github.com/henrylee2cn/pholcus_lib/jdsearch"
+	_ "github.com/henrylee2cn/pholcus_lib/jingdong"
+	_ "github.com/henrylee2cn/pholcus_lib/kaola"
+	_ "github.com/henrylee2cn/pholcus_lib/lewa"
+	_ "github.com/henrylee2cn/pholcus_lib/miyabaobei"
+	_ "github.com/henrylee2cn/pholcus_lib/people"
+	_ "github.com/henrylee2cn/pholcus_lib/shunfenghaitao"
+	_ "github.com/henrylee2cn/pholcus_lib/taobao"
+	_ "github.com/henrylee2cn/pholcus_lib/taobaosearch"
+	_ "github.com/henrylee2cn/pholcus_lib/wangyi"
+	_ "github.com/henrylee2cn/pholcus_lib/weibo_fans"
+	_ "github.com/henrylee2cn/pholcus_lib/zolpc"
+	_ "github.com/henrylee2cn/pholcus_lib/zolphone"
+	_ "github.com/henrylee2cn/pholcus_lib/zolslab"
+)
diff --git a/shunfenghaitao.go → shunfenghaitao/shunfenghaitao.go b/shunfenghaitao.go → shunfenghaitao/shunfenghaitao.go
diff --git a/taobao.go → taobao/taobao.go b/taobao.go → taobao/taobao.go
diff --git a/taobaosearch.go → taobaosearch/taobaosearch.go b/taobaosearch.go → taobaosearch/taobaosearch.go
diff --git a/wangyi.go → wangyi/wangyi.go b/wangyi.go → wangyi/wangyi.go
diff --git a/weibo_fans.go → weibo_fans/weibo_fans.go b/weibo_fans.go → weibo_fans/weibo_fans.go
diff --git a/zolpc.go → zolpc/zolpc.go b/zolpc.go → zolpc/zolpc.go
diff --git a/zolphone.go → zolphone/zolphone.go b/zolphone.go → zolphone/zolphone.go
diff --git a/zolslab.go → zolslab/zolslab.go b/zolslab.go → zolslab/zolslab.go