Skip to content
This repository has been archived by the owner on Nov 1, 2024. It is now read-only.

Validate args to prevent RuntimeError: attn_batches % batches_per_block == 0 #13

Open
GabrielPereyra opened this issue Mar 29, 2022 · 1 comment
Open

Validate args to prevent RuntimeError: attn_batches % batches_per_block == 0 #13

GabrielPereyra opened this issue Mar 29, 2022 · 1 comment

Comments

@GabrielPereyra
Copy link

Error when running metaseq_internal/fb_sweep/sweep_openlm_baselines.py with model: Size(1, 4, 2, 2, int(0.1 * M), 6.0e-4, 2) in Megatron-LM: stack trace.

Possibly related: Batch size of 128 throws "batch_size should be a positive integer".
@tbmihailov
Copy link

I also get this error in some cases. I filed bug in metaseq https://github.com/fairinternal/metaseq/issues/36

@suchenzang suchenzang transferred this issue from another repository Apr 9, 2022
@bigfootjon bigfootjon transferred this issue from another repository May 2, 2022
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@tbmihailov @GabrielPereyra