Skip to content

Using Scrapy and Splash, I scrape NBA scores for 2018 season from ESPN.com and store it into MongoDB database.

Notifications You must be signed in to change notification settings

danielhanbitlee/scrape_nba_scores

Repository files navigation

Scraping 2018-2019 NBA Scores

By Daniel Lee

January 4, 2019

Description

This is a web scraper that extracts 2018-2019 NBA scores from espn.com.

Data Scraping Implementation

  • The data is obtained through scraping the espn.com website using the following:
    • Python (v. 3.6.7)
    • Scrapy (v. 1.5.1)
    • Splash (v. 0.7.2)
  • The data is stored in a MongoDB database.
  • The web scraping app is deployed on Heroku.

REST API Implementation

  • You can access the scraped data using 2018-2019 NBA Scores API.
  • You can access the code for the API here.
  • The REST API is implemented using the following:
    • Python (v. 3.6.7)
    • Flask (v. 1.0.2)
  • This API is connected to a MongoDB database to access the data.
  • The API is deployed on Heroku.
  • There's also an /auth route and a /register route for authentication and logging in. This requires Postman to use. For simplicity's sake, I removed the authentication requirements for the routes /team, /city, /date, /team_list, and /city_list.

About

Using Scrapy and Splash, I scrape NBA scores for 2018 season from ESPN.com and store it into MongoDB database.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages