The sort_jav Python script originally written by /u/Ohura sorts and renames a folder of unsorted JAV videos, downloads covers, and writes the raw JavLibrary page to html. The Set-JAVNfo PowerShell script will work in conjunction with sort_jav to create a functional .nfo metadata file from the html file for easy import into Emby, Jellyfin, Kodi, and/or Plex.
There are settings you can configure, such as how the file is renamed, putting them in folders, or downloading covers. Take a look in the settings_sort_jav.ini file for the full set of options.
My goal in updating the sort_jav repository is for it to function as an alternative to the popular JAVMovieScraper which to my knowledge is currently unable to scrape JavLibrary data. If you have any questions, criticisms, or feature requests, feel free to hop into my throwaway discord channel and send me a message.
Clone the repository to get the latest changes
- Add option to keep original thumbnail (800x533) aspect ratio cover as
$name-thumb.jpg - Add script edit_covers.py to crop covers of already-scraped files recursively. Check documentation under how to run for more information.
- New settings to manage covers
- scraped-covers-path
- keep-original-cover
- New settings to manage covers
- Add option to crop cover image to poster (378x533) aspect ratio
- Fix html txt file not moving into folder if file already exists
- Add -Prompt parameter to Set-JAVNfo.ps1 to show changes before confirming. To remove, remove the parameter in the Set-JAVNfo.ps1 script on the last line
- Add option to add video genre as a 'tag' metadata option to allow for multi-genre/tag sorting in Jellyfin
- Fix video title erroring out and not writing to the proper file for some files
- Fix Set-JAVNfo.ps1 not finding metadata files txt metadata files for "t28" and titles with only 1 letter
- Fix paths containing square brackets error read/write through Set-JAVNfo.ps1
- Added option to include video genres in metadata nfo file
- Moved additional metadata options to bottom of settings.ini
- Added option in settings "include-html-txt" to create a html text file to parse and create Emby/Jellyfin/Kodi metadata
- Added Set-JAVNfo.ps1 script to create .nfo metadata from html text file
- Added option in settings "include-cover-all" to create a cover .jpg for each video file
- Changed renaming of cover to match video renaming for multiple part videos
- Fixed an issue where the program wouldn’t stop early during a problematic file
- Fixed an issue due to Cloudflare being added to javlibrary. This requires significantly more setup from you, sorry about that but it was necessary.
- Fixed some issues where certain filenames didn’t sort properly because the name had other portions that looked like IDs
- Fixed an issue where the program failed to work after javlibrary changed their HTML structure for pages.
- Videos no longer have to be named correctly. The sorter can now determine what the ID of the video is even if it has nonsense in the name. This may not work for every single name, so please message me if you find ones that fail.
You must have Python 3.5 or higher installed in order for this to work. If you do not have it or are unsure, you can download it here: https://www.python.org/downloads/ . This will likely not work on Python 2.x, and has not been tested on it.
Due to javlibrary adding Cloudflare, you are now required to have cfscrape installed. You can view how to install it here: https://github.com/Anorov/cloudflare-scrape#installation . You will need node.js installed to run it. Please refer to their respective documentation on installation.
# Required to crop cover images
$ pip install Pillow
# Required to scrape JavLibrary
$ pip install cfscrape
You will need PowerShell v5.0 or higher installed to run Set-JAVNfo.ps1 (installed on Windows 10 by default). If you get a Remote-ExecutionPolicy error when running, open an administrator PowerShell prompt, and run the following to unrestrict the script:
> Set-ExecutionPolicy Unrestricted
Please first edit the settings to match your desired preferences. It will not work if you do not do this, particularly with the folder you need to specify.
To run sort_jav.py, you need to set it up so all the videos you want to sort are all in a single folder, and that folder is the path you specify in the settings. Any files in folders within that folder will be ignored, so you can move them out of folders they may already be in.
Videos no longer need to be renamed, the sorter can now handle this. Videos with multiple files that are not tagged correctly may fail to sort. The sorter will not remove any of these files, just fail to sort them correctly. There are two formats that the sorter will understand for multiple videos:
- A letter appears directly after the end of the video ID, for example MIRD150A and MIRD150B. It will detect them as two files for the same video and rename them accordingly.
- The old system method, where the video title has the multiple video suffix attached. For example, if multiple videos are denoted by a ! symbol and the video is MIRD-150!A and MIRD-150!B, the sorter will understand.
Once the settings are good, you can double click sort_jav.py to run it. A box should pop up and stay open while running the script, giving you details about what’s happening. It will give you another message when it finishes, and hitting enter will close the program at that point. Alternatively you can invoke it from the command line. A note that this requires .py files to be associated with the Python executable file (Python.exe for most of us).
Set-JAVNfo.ps1 will search for all .txt files created by sort_jav.py and write a .nfo metadata file. To run Set-JAVNfo.ps1, the files need to be in the path specified in the settings. The script will search the folder recursively, finding all .txt files containing the html metadata. To run Set-JAVNfo.ps1, right click and select "Run with PowerShell" (double clicking will NOT work). By default, the script will run on the path in your settings file. If you want to run the Set-JAVNfo.ps1 script on a different directory, add the FilePath parameter to Set-JAVNfo.ps1 on the last line.
edit_covers.py will search for all uncropped covers created by sort_jav.py and crop them if specified in your settings. To run edit_covers.py, the files need to be in the scraped-covers-path specified in the settings. The script will search the folder recurisvely, finding all .jpg files matching both critieria:
- between width 790 and 810
- between heights 530 and 600.
Make sure no irrelevant .jpg files matching these criteria are within this directory or child directory, as it will be permanently modified by the script.To run edit_covers.py, you can double click to run it. You will be prompted to confirm the path of your already scraped covers that you want to crop.
You can also invoke any of the scripts from a non-administrator PowerShell prompt as demonstrated in the demo.
The settings_sort_jav.ini file provided lists the options the user has available to them as well as descriptions on those options. The default settings are my recommendations specifically if you are using Emby. Play around with the settings on a test directory to find your preference.
For settings that say true/false, please use the values true or false to indicate. For other values, it will use whatever appears directly after the = sign on the same line.
Please note that where it gives you options to include delimiters, certain characters are disallowed by the OS. If you include them, they will be forcibly removed from your delimiter. For windows, that would be: / \ : * ? < > |
Any video files that can’t be found on javlibrary will be ignored. The program will notify you of any problems it has trying to sort them.
Occasionally the results will be incorrect, this is because javlibrary incorrectly states the id of the video on their website. You should double check all the results appear to be correct.
When fixing movies that have been scraped improperly, you can manually download the proper JAVLibrary page as an html, and then add
<ActressSorted>Actress1|Actress2|Actress3</ActressSorted> to the last line of the html, and then rename it to the .txt extension. You can then run Set-JAVNfo.ps1 to write the .nfo metadata file.
Videos with the id code r18 or t28 cannot be detected with the new special method, so the program defaults to the old method. For videos with those names, please rename them before running the program.
If a video is renamed to something that is too long, the program will ignore moving it. This may result in a folder being created but files not being placed in there. For reference, maximum file lengths are around 255, so for videos with several actresses in them, it’s best not to include the actress name in both the file and folder.
JAVMovieScraper - Scrape multiple JAV databases (or western) and rename/categorize and write metadata
Rename-JAV-files-javlibrary - Use regex checks to rename JAV files to their ID format. No web scraping involved.
This script is provided “as is” and the creator is not liable for anything that happens as a result of the use of it.
This being said, if you experience any issues with it, feel free to ask for help.
- Add option to input tags/genres in metadata file
- Add functionality to crop cover to poster size
- Add video title option to renamed file
- Scrape video plot/description
- Scrape actress images
