A simple web scraper that grabs the latest news in the past 24 hours from The University of Montenegro and sends them via plaintext email. For now it only scrapes The Faculty of Electrical Engineering.
The scraper itself is a JS scraper using cheerio and axios.
The cron job that manages the scraper is actually controlled by upstash. Using upstash's Qstash, there's an HTTP request made to the web apps Next API at /api/cron. This endpoint handles the scraping via internal functions, and the creation and sending of a new Mailchimp campaing via Mailchimp's Node package.
The frontend holds a tiny newsletter subscription form.
- Clone this repository
- Install dependencies via
npm install - Run
npm run devto start the development server - Run
npm run buildto build the project - Run
npm run startto start the local server
The content of this project itself is licensed under the Creative Commons Attribution 3.0 Unported license, and the underlying source code used to format and display that content is licensed under the MIT license.