Skip to content

Node.js Crawler built for open FTP sites for movie link collection.

License

Notifications You must be signed in to change notification settings

haxzie-xx/crode.js-Node-web-Crawler

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

6 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

crode.js

Visit haxzie.me for demo.

Node.js web crawler scrapping file downloadable link from open ftp servers. crode.js is an express app.crawling is made possible using npm - Crawler. app scrapes the html file using npm modules:

-request

-cheerio

Storage

crode.js uses Mongo db by default currenty uses only two db schemas for storing download links found and visited.

About

Node.js Crawler built for open FTP sites for movie link collection.

Topics

Resources

License

Code of conduct

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published