Skip to content

Latest commit

 

History

History
23 lines (17 loc) · 1.12 KB

README.md

File metadata and controls

23 lines (17 loc) · 1.12 KB

Linker Extraction

  • the chars_to_remove folder contains all the txt files used to list all the strings to remove
  • the scripts folder contains python scripts which can be used to aid the implementation of the algorithm in excel
  • the utils.py file contains all the functions which are used for the algorithm
  • the main.py file contains the main script to run
  • the 3ddigimofs_raw.tab.xlsx file contains the raw sample of roughly 10 thousand rows

Naming Convention

each step step_n variable contains a list of things that will be removed @ the step n the last item in te list is the string which will be replacing all the other strings,

step_n_m means that the list contain both the items which need to be removed at step m and n and that both the items at steps n and m can be replaced with the item step_n_m[-1]

TODOs

  • merge and seperate columns by using pandas (fill the unequal rows and columns with NaNs)
  • seperate step_n_m lists into different steps to be applied individually ?
  • complete all the steps and test a correct sample (current output yields missing rows)