This folder is mainly about http://www.jobbole.com/ website crawler. The program is designed to collect all articles from the website.
In order to collect data more efficiently, the Scrapy framework is designed to collect data from the website.
- Pycharm
- Python3
- Scrapy