BeiCrawler is a crawler framework by Java.
- BeiCrawler 是一款小巧，灵活，扩展性高的爬虫框架。
- BeiCrawler 只需要使用者提供网址集合，即可自动爬取，并对一些异常进行处理。
- JSON库 : fastjson 1.2.58
- DOM提取 : jsoup 1.11.3
- 网络请求 : okhttp 4.2.2
- 日志 : log4j 1.2.17
- 网络GET请求
- 日志
- 链接生成器
- 网络POST请求
- 数据保存
-
Notifications
You must be signed in to change notification settings - Fork 0
panda421/BeiCrawler
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
BeiCrawler is a crawler framework By Java.
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published