RecursiveGPT

Process large text files and documents with ChatGPT (more APIs coming soon*). Requires Python 3 and an OpenAI API key.

Use:

Currently command-line only.

git clone https://github.com/jckpn/RecursiveGPT.git
cd RecursiveGPT
pip install -r requirements.txt
python RecursiveGPT.py

Then just follow the prompts as given in the termimal.

How it works

This script works by splitting the file into chunks within the context window of ChatGPT (currently limited to 4096 tokens). You simply specify a prompt, and it'll get prepended to the start of each chunk. The ChatGPT outputs are recursively added to an output text file.

Examples

Your prompts could be anything like:

• "Summarise the following lecture notes."
• "Proofread the following, providing your response in the form [original text -> revised text]."
• "Rewrite the following in the style of a pirate."
• "Convert the following scientific paper into a child-friendly overview."
• "Task: For each mention of a dog breed, state the breed and describe where in the text it occurs."

The prompt below was "Convert these lecture captions to concise revision notes."

I made this to help me with tasks like proofreading and lecture summaries, but it works well for a range of tasks.

*I have very little free time at the moment due to my MSc and other jobs – pull requests would be appreciated!

(Privacy note: No data is sent anywhere except for interacting with the ChatGPT API.)