[deepspeed] fix resume from checkpoint (huggingface#11352)

This PR fixes a bug that most likely somehow got exposed (not caused) by huggingface#11318 - surprisingly the same test worked just fine before that other PR.
davewang · Apr 21, 2021 · ca7ff64 · ca7ff64
1 parent 74712e2
commit ca7ff64
Showing 1 changed file with 1 addition and 1 deletion.
diff --git a/src/transformers/trainer.py b/src/transformers/trainer.py
@@ -1017,7 +1017,7 @@ def train(
                         "yield to errors or unwanted behaviors."
                     )
 
-            if self.deepspeed:
+            if args.deepspeed:
                 # will be resumed in deepspeed_init
                 pass
             else: