Skip to content

A spider to get all the articles and images from 22/7 members' blogs and convert them into markdown files that can be used in hexo.

License

Notifications You must be signed in to change notification settings

yagami-toa/blog_spider

 
 

Repository files navigation

22/7 Spider


About

A spider to get all the articles and images from 22/7 members' blogs and convert them into markdown files that can be used in hexo.

Preview of markdown files in 22/7 WiKi blog

All the markdown files can be found in this repo, check them by searching in the folders, most of the file names are renamed by md5, please check the file name at the link suffix on the 22/7 WiKi blog

Updated from 227-blog-generator

Updates

  • 天城サリー
  • 河瀬詩
  • 宮瀬玲奈
  • 西條和
  • 白沢かなえ
  • 涼花萌
  • 相川奈央
  • 麻丘真央
  • 雨夜音
  • 清井美那
  • 椎名桜月
  • 四条月
  • 月城咲舞
  • 望月りの

Require

  • Python >= 3.8
  • requests
  • BeautifulSoup

Usage

create the folder named by members' names and a folder called images inside it.

python -m spider_[replace with member's name].py

You may need to change the number of pages the program crawls at a time, which may cause the program to crash.

License

GPL V3.0

About

A spider to get all the articles and images from 22/7 members' blogs and convert them into markdown files that can be used in hexo.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 100.0%