Skip to content

Commit

Permalink
reupload virtual machine
Browse files Browse the repository at this point in the history
  • Loading branch information
hanc00l committed Jul 29, 2016
1 parent 4d8d268 commit 5299ee2
Show file tree
Hide file tree
Showing 9 changed files with 26 additions and 16 deletions.
2 changes: 2 additions & 0 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -4,3 +4,5 @@ flask/static/drops/运维安全-2547.html
*.html

*.jpg

*.pyc
29 changes: 19 additions & 10 deletions README.md
100755 → 100644
Original file line number Diff line number Diff line change
Expand Up @@ -14,7 +14,6 @@
+ pymongo (pip install pymongo)

### 2.爬虫
+ **在爬取内容时,请先启动mongodb数据库:mongod &**

+ 乌云公开漏洞和知识库的爬虫分别位于目录scrapy/wooyun和scrapy/wooyun_drops

Expand All @@ -35,36 +34,46 @@
### 3.搜索
+ 漏洞搜索使用了Flask作为web server,bootstrap作为前端

+ **在搜索时,请确定已启动了mongodb数据库:mongod &**

+ 启动web server :在flask目录下运行python app.py,默认端口是5000

+ 搜索:在浏览器通过http://localhost:5000进行搜索漏洞,多个关键字可以用空格分开。

### 4.为mongodb数据库创建索引(可选,以下为命令行操作
### 4.为mongodb数据库创建索引(如果不创建索引,可能导致返回结果报错,以下为命令行状态
mongo
use wooyun
db.wooyun_list.ensureIndex({"datetime":1})
db.wooyun_drops.ensureIndex({"datetime":1})

### 5.虚拟机

+ 虚拟机1:在2016年6月底爬的wooyun全部漏洞库和知识库内容,总共30G,网盘地址为: [http://pan.baidu.com/s/1o7IEaAQ](http://pan.baidu.com/s/1o7IEaAQ) 提取密码:d4cq
+ 虚拟机1:在2016年6月底爬的wooyun全部漏洞库和知识库内容,总共30G(压缩后约11G),网盘地址为: [http://pan.baidu.com/s/1o7IEaAQ](http://pan.baidu.com/s/1o7IEaAQ) 提取密码:d4cq

使用方法:
1、压缩包解压后是一个vmware虚拟机的镜像,可以由vmware直接打开运行;
2、由于在制作压缩包时虚拟机为“挂起”状态,当前虚拟机的IP地址可能和宿主机的IP地址段不一致,请将虚拟机重启后重新获取IP地址,虚拟机用户密码为hancool/qwe123;
3、进入wooyun_public目录,先用git更新一下到最新的代码git pull;
4、进入wooyun_public/flask目录,运行./app.py;
5、打开浏览器,输入http://ip:5000,ip为虚拟机的网卡地址(使用ifconfig eth0查看)

+ 虚拟机2:已打包了一个安装了所有组件和程序的虚拟机(不包含具体内容),网盘地址为:[http://pan.baidu.com/s/1sj67KDZ](http://pan.baidu.com/s/1sj67KDZ) 密码:bafi
+ 虚拟机2:已打包了一个安装了所有组件和程序的虚拟机(不包含具体内容,约980M),网盘地址为:[http://pan.baidu.com/s/1sj67KDZ](http://pan.baidu.com/s/1sj67KDZ) 密码:bafi

+ 虚拟机使用方法
使用方法
1、使用vmware或virtualbox导入虚拟机
2、登录用户名hancool,密码qwe123
3、进入wooyun_public目录,先用git更新一下到最新的代码git pull
4、分别进入wooyun_public目录下的wooyun和wooyun_drops,运行爬虫爬取数据(爬取全部数据并且本地离线缓存):scrapy crawl wooyun -a page_max=0 -a local_store=true -a update=true
5、进入wooyun_publich目录下的flask,运行./app.py,启动web服务
6、打开浏览器,输入http://ip:5000,ip为虚拟机的网卡地址(如果是vmware,则使用ifconfig eth0查看,如果是virtualbox为192.168.56.130
6、打开浏览器,输入http://ip:5000,ip为虚拟机的网卡地址(使用ifconfig eth0查看)


### 6.其它

+ 本程序只用于技术研究和个人使用,程序组件均为开源程序,漏洞和知识库来源于乌云公开漏洞,版权归wooyun.org
+ 本程序只用于技术研究和个人使用,程序组件均为开源程序,漏洞和知识库来源于乌云公开漏洞,版权归wooyun.org。

+ 期待雨过天晴、重开wooyun!

+ [email protected]

+ [email protected] 2015.9
Empty file modified flask/app.py
100755 → 100644
Empty file.
Empty file modified flask/static/bugs/js/jquery.twbsPagination.js
100755 → 100644
Empty file.
5 changes: 2 additions & 3 deletions flask/templates/search_bugs.html
Original file line number Diff line number Diff line change
Expand Up @@ -15,10 +15,9 @@ <h2>关键字【{{keywords}}】的搜索结果<small>共{{page_info['total_rows'
{% for row in page_info['rows'] %}
<tr>
<td>{{row['datetime']}}</td>
<td><a href="http://www.wooyun.org/bugs/{{row['wooyun_id']}}" target="_blank">
<td><a href="static/bugs/{{row['wooyun_id']}}.html" target="_blank">
{{row['title']}}</a></td>
<td><a href="static/bugs/{{row['wooyun_id']}}.html" target="_blank">{{row['bug_type']}}</a></td>

<td><a href="http://www.wooyun.org/bugs/{{row['wooyun_id']}}" target="_blank">{{row['bug_type']}}</a></td>
<td>{{row['author']}}</td>
</tr>
{% endfor %}
Expand Down
4 changes: 2 additions & 2 deletions flask/templates/search_drops.html
Original file line number Diff line number Diff line change
Expand Up @@ -15,9 +15,9 @@ <h2>关键字【{{keywords}}】的搜索结果<small>共{{page_info['total_rows'
{% for row in page_info['rows'] %}
<tr>
<td>{{row['datetime']}}</td>
<td><a href="{{row['url']}}" target="_blank">
<td><a href="static/drops/{{row['url_local']}}" target="_blank">
{{row['title']}}</a></td>
<td><a href="static/drops/{{row['url_local']}}" target="_blank">{{row['category']}}</a></td>
<td><a href="{{row['url']}}" target="_blank">{{row['category']}}</a></td>

<td>{{row['author']}}</td>
</tr>
Expand Down
Binary file modified index.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified search.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
2 changes: 1 addition & 1 deletion update.sh
100755 → 100644
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@ cd scrapy/wooyun
scrapy crawl wooyun -a page_max=100

cd ../wooyun_drops
scrapy crawl wooyun -a page_max=5
scrapy crawl wooyun -a page_max=10

cd ../../flask
./app.py

0 comments on commit 5299ee2

Please sign in to comment.