Invalid Image URL

[wuhang03]

Thanks for your excellent work and detailed documentations！

However, when I tried to run the codes, I met the errors as below, which seem to be some data type issues of image url. I'd appreciate it a lot if you can give me some tips about how to solve this issue.

Thank you in advance for your assistance!

请求失败，重试中！ {'error': {'message': "Invalid image URL: 'messages[0].content[1].image_url.url'. Expected a base64-encoded data URL with an image MIME type (e.g. 'data:image/png;base64,aW1nIGJ5dGVzIGhlcmU='), but got a value without the 'data:' prefix.", 'type': 'invalid_request_error', 'param': 'messages[0].content[1].image_url.url', 'code': 'invalid_value'}} Traceback (most recent call last): File "/root/OmniSearch/src/main.py", line 120, in <module> main(args.test_dataset,args.dataset_name, args.meta_save_path) File "/root/OmniSearch/src/main.py", line 77, in main process_item(item, conversation_manager, meta_save_path, dataset_name) File "/root/OmniSearch/src/main.py", line 39, in process_item answer, current_message = conversation_manager.manage_conversation( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/root/OmniSearch/src/conversation_manager.py", line 51, in manage_conversation success, idx, message, answer = self.qa_agent.ask_gpt(current_message, idx) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/root/OmniSearch/src/agent.py", line 13, in ask_gpt success, idx, message, answer = call_gpt( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ TypeError: cannot unpack non-iterable NoneType object

[wangxinyu0922]

Hi, can you provide an example case for this issue?

[wuhang03]

I run the main.py file exactly as the GPT-4V-based OmniSearch part in 'Running OmniSearch', and I only modify the GPT_API_KEY and API_KEY.

Here is my running command:
python src/main.py --test_dataset '/root/OmniSearch/dataset/DynVQA_zh/DynVQA_zh.202406.jsonl' --dataset_name NAME --meta_save_path './results',
and the output is as below:
请求失败，重试中！ {'error': {'message': "Invalid image URL: 'messages[0].content[1].image_url.url'. Expected a base64-encoded data URL with an image MIME type (e.g. 'data:image/png;base64,aW1nIGJ5dGVzIGhlcmU='), but got a value without the 'data:' prefix.", 'type': 'invalid_request_error', 'param': 'messages[0].content[1].image_url.url', 'code': 'invalid_value'}} 请求失败，重试中！ {'error': {'message': "Invalid image URL: 'messages[0].content[1].image_url.url'. Expected a base64-encoded data URL with an image MIME type (e.g. 'data:image/png;base64,aW1nIGJ5dGVzIGhlcmU='), but got a value without the 'data:' prefix.", 'type': 'invalid_request_error', 'param': 'messages[0].content[1].image_url.url', 'code': 'invalid_value'}}

Please let me know if you need any other information.