Skip to content

Commit

Permalink
update crawl author error
Browse files Browse the repository at this point in the history
  • Loading branch information
hanc00l committed Sep 22, 2015
1 parent 1083530 commit d57b316
Show file tree
Hide file tree
Showing 2 changed files with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion scrapy/wooyun/wooyun/spiders/WooyunSpider.py
Original file line number Diff line number Diff line change
Expand Up @@ -57,7 +57,7 @@ def parse_detail(self,response):
#there will be error while parse author,so do this
try:
#item['author'] = response.xpath("//h3[@class='wybug_author']/a/text()").extract()[0]
item['author'] = response.xpath('//*[@id="bugDetail"]/div[5]/h3[4]/text()').extract()[0]
item['author'] = response.xpath('//*[@id="bugDetail"]/div[5]/h3[4]/a/text()').extract()[0]
except:
item['author'] ='<Parse Error>'
#the response.body type is str,so we need to convert to utf-8
Expand Down
Binary file modified scrapy/wooyun/wooyun/spiders/WooyunSpider.pyc
Binary file not shown.

0 comments on commit d57b316

Please sign in to comment.