Skip to content

andrewdavis23/boomer-eggs

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

8 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

boomer-eggs

Yahoo Finance scrapper for mutual funds and etfs

Mutual Fund Algorithim:

  1. Create list of mutual funds. Each URL will be created from the mutual funds. Each mutual funds has several webpages. On each webpage are several data tables.
  2. Define one function per webpage
  • Define each data table per webpage
  • Define the for loop that works with each data table
  • Return data row and col names collected
  1. Loop each mutual fund through each function, extend all data rows to dictionary of the form { mf_ticker : [data, data , ...]}
  2. If data row is not the expected length, then add to error log and do not add row to dataframe
  3. If crawl stops, print dataframe and error log, otherwise print the same at the end.

About

Yahoo Finance scrapper for mutual funds and etfs

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages