A tool to download info about an author's works on SoFurry.
Have you ever wanted to find a specific story from an author on SoFurry, but had trouble locating it? SoFurry search doesn't allow you to search by author - your only option is to page through all of their work (in all of their folders) to try to find it.
That's what this tool solves - just run the tool on your favorite author and it will dump all the metadata for their stories (such as titles, descriptions, tags, and links to the actual work)!
You'll need Python (>3.7) to run this tool, along with some additional
dependencies. You can install all the required libraries by running
pip install -r requirements.txt from this directory.
You'll also likely want to provide the tool with your SoFurry cookies so it can
see adult works. There are extensions like
Ganbo for Firefox and
Get Cookies.txt for Chrome
that will export your SoFurry cookies to a cookies.txt file.
Once you're ready, you can run the tool like this:
python sf-userstories-dl.py -c cookies.txt -o stories.json USERNAMEJust replace USERNAME with your preferred author and you're good to go!
The output will be a JSON file you can easily read and search with a text editor (or jq).
The output of this can be used to build a searchable story index with my other project, Storything. To convert the json file emitted by this tool to the csv file needed by storything, you can use jq:
cat stories.json | jq -r '["Title", "Link", "Summary", "Tags"],
(.[] | [.title, .link, .description, .tags])
| @csv > stories.csv'
The linebreaks are optional - jq ignores linebreaks in a command.
Once you have your stories.csv file, simply place it in the same
directory as storything's index.html file. Storything will read
the csv and tags and generate a searchable list.