Skip to content

Commit

Permalink
udpate evaluation readme
Browse files Browse the repository at this point in the history
  • Loading branch information
junchen14 committed Oct 31, 2023
1 parent 89e2993 commit 25f73bb
Showing 1 changed file with 13 additions and 1 deletion.
14 changes: 13 additions & 1 deletion eval_scripts/EVAL_README.md
Original file line number Diff line number Diff line change
Expand Up @@ -59,10 +59,15 @@ export PYTHONPATH=$PYTHONPATH:/path/to/directory/of/MiniGPT-4

### start evalauting RefCOCO, RefCOCO+, RefCOCOg
port=port_number

cfg_path=/path/to/eval_configs/minigptv2_eval.yaml

save_path=/path/to/save/path

ckpt=/path/to/evaluation/checkpoint

split=/evaluation/data/split/type

dataset=/data/type

dataset | split
Expand All @@ -82,16 +87,23 @@ torchrun --master-port ${port} --nproc_per_node 1 eval_ref.py \
### start evaluating visual question answering

port=port_number

cfg_path=/path/to/eval_configs/minigptv2_eval.yaml

eval_file_path=/path/to/eval/annotation/path

image_path=/path/to/eval/image/path

save_path=/path/to/save/path

ckpt=/path/to/evaluation/checkpoint

split=/evaluation/data/split/type

dataset=/data/type

dataset | image_path | eval_file_path
--- | :---:
--- | :---:| :---:
okvqa | coco_2017 | /path/to/okvqa/folder
vizwiz | vizwiz_images | /path/to/vizwiz/folder
iconvqa | iconvqa_images | /path/to/iconvqa/folder
Expand Down

0 comments on commit 25f73bb

Please sign in to comment.