GitHub - hengbinxu/mops-crawler: Financial Crawler for Mops

Financial Crawler

For now, the crawler can crawl the following reports from MOPS.

You can check the detail schema of this project on db_schema.dbml
The following plot is generated by dbdiagram.io, and how to write DBML can refer from DBML.

Name		Name	Last commit message	Last commit date
Latest commit History 58 Commits
company_info		company_info
images		images
mops_crawler		mops_crawler
.gitignore		.gitignore
Dockerfile		Dockerfile
README.md		README.md
db_schema.dbml		db_schema.dbml
docker-compose.yml		docker-compose.yml
entrypoint.sh		entrypoint.sh
note.txt		note.txt
requirements.txt		requirements.txt
run_server.sh		run_server.sh
scrapy.cfg		scrapy.cfg
scrapyd.conf		scrapyd.conf
test.py		test.py