To follow our experiments which use GPT-3, you must have access to the OpenAI API (at cost). Please retrieve your organization and API keys and set them in your environment variables.
export OPENAI_ORG=....
export OPENAI_API_KEY=...For producing predictions for both DA and MC settings, run:
python gpt3/query_gpt3.py --aokvqa-dir ${AOKVQA_DIR} --split val --out ${PREDS_DIR}/gpt3_val-da.json
python remap_predictions.py --aokvqa-dir ${AOKVQA_DIR} --split val --pred ${PREDS_DIR}/gpt3_val-da.json --out ${PREDS_DIR}/gpt3_val-mc.json