Skip to content

Arshia-Izadyar/Web-Scraping-News-API

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

21 Commits
 
 
 
 
 
 
 
 

Repository files navigation

Web-Scraping-News-API

this is a News APi with django REST framework

for news data it screpe Hacker news RSS feed

or it can scrape any news site with a RSS feed

async with handeld with Celery

How does it work ?

with this command you can scrape th Hacker news

python manage.py scrape

and with scrapebylink you can scrape any news site with a RSS feed

python manage.py scrapebylink

data after being scraped will be saved in psql database

news is accessible via /api/news/

Users can search in news list in fields [title or source]

more doc available in /swagger/

Accounts

users can be registerd in /api/accounts/register/

every time a user registers a token will be created for the new user using signals

and JWT token is supported as well

users can change password too

About

Web Scraping using celery

Resources

Stars

Watchers

Forks

Languages