Name		Name	Last commit message	Last commit date
parent directory ..
data/folio		data/folio
results/folio		results/folio
.gitignore		.gitignore
README.md		README.md
folio-cot-llm.py		folio-cot-llm.py
folio-cot-openai.py		folio-cot-openai.py
folio-cr-llm.py		folio-cr-llm.py
folio-cr-openai.py		folio-cr-openai.py
folio-direct-llm.py		folio-direct-llm.py
folio-direct-openai.py		folio-direct-openai.py
requirements.txt		requirements.txt

README.md

Cumulative Reasoning on FOLIO dataset

Installation

pip install -r requirements.txt

You must use 0.0.61 version of guidance while testing LlaMa models.

Setup OpenAI API

Please set os.environ["OPENAI_API_KEY"]="YOUR_API_KEY" in *-openai.py

Make sure that your device is able to connect to OpenAI API

Example usage

python folio-direct-openai.py

python folio-cot-openai.py

python folio-cr-openai.py