[Bug] Batch chunking does not retry previously failed embeddings

[wolph]

📦 Environment

Docker

📌 Version

v1.55.0

💻 Operating System

Ubuntu

🌐 Browser

Chrome

🐛 Bug Description

If the chunking/embedding fails due to rate limits, it's impossible to retry the chunking/embedding in batch. When retrying them in batch they immediately fail without doing anything so you need to manually retry every item.

📷 Recurrence Steps

1. Embed more items than your API rate limits allow.
2. Retry the failed items.

🚦 Expected Behavior

The retried items are tried again for embedding/chunking instead of only returning errors.

📝 Additional Information

As a workaround, this javascript in the Chrome Developer Console does the trick: document.querySelectorAll('span[title=Retry]').forEach(o => o.click());

[lobehubbot]

👀 @wolph

Thank you for raising an issue. We will investigate into the matter and get back to you as soon as possible.
Please make sure you have given us as much context as possible.
非常感谢您提交 issue。我们会尽快调查此事，并尽快回复您。 请确保您已经提供了尽可能多的背景信息。

[dosubot]

The current implementation allows users to manually retry failed embeddings through the user interface by clicking a retry icon. However, it seems that batch retrying of failed embeddings is not functioning as expected, leading to the need for manual retries for each item ^[1].

To address this issue, you might consider implementing a more robust retry mechanism that can handle batch retries programmatically. This could involve modifying the retry logic to ensure that when a batch retry is initiated, it properly queues and processes each failed item again, rather than immediately failing.

Additionally, you could explore enhancing the error handling logic to better differentiate between types of errors, such as rate limits, and implement a more automated retry strategy for these specific cases. This could potentially involve adjusting the onerror callback in the fetchEventSource function to handle retries more effectively ^[2].

For now, using the provided JavaScript workaround in the Chrome Developer Console is a practical solution to automate the manual retry process.

To continue talking to Dosu, mention @dosu.

---

^{Help Dosu learn! Give it feedback: Great Response | Irrelevant Answer | Incorrect Sources | Too Verbose | Hallucination | Bug Report | Other}