Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add manual recovery mode to dxf/import #59640

Open
D3Hunter opened this issue Feb 19, 2025 · 0 comments
Open

add manual recovery mode to dxf/import #59640

D3Hunter opened this issue Feb 19, 2025 · 0 comments
Labels
component/ddl This issue is related to DDL of TiDB. component/disttask distributed execute framework of tidb type/enhancement The issue or PR belongs to an enhancement.

Comments

@D3Hunter
Copy link
Contributor

Enhancement

when importing large mount of data using global-sort where one round of import takes a lot of time, we might meet some error that is harder to investigate without the intermediate data in hand, and sometimes the bug might be easy to fixed by a hotfix PR and we can continue the import, it might be more flexible and efficient than retrying the whole task.

so we want to add a ManualRecovery mode to DXF, when some subtask failed, the task will move to awaiting-resolution state, and manual operation is needed for the task to continue.

@D3Hunter D3Hunter added component/disttask distributed execute framework of tidb type/enhancement The issue or PR belongs to an enhancement. labels Feb 19, 2025
@D3Hunter D3Hunter changed the title add manual recovery mode to dxf add manual recovery mode to dxf/import Feb 19, 2025
@D3Hunter D3Hunter added the component/ddl This issue is related to DDL of TiDB. label Feb 21, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
component/ddl This issue is related to DDL of TiDB. component/disttask distributed execute framework of tidb type/enhancement The issue or PR belongs to an enhancement.
Projects
None yet
Development

No branches or pull requests

1 participant