Skip to content

Commit

Permalink
API: Change --batch-size description to match behaviour
Browse files Browse the repository at this point in the history
The batch size argument is the total across all GPUs on all nodes,
not all GPUs on one node.
  • Loading branch information
scottclowe committed Nov 25, 2021
1 parent 878544a commit 7074f47
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion main_moco.py
Original file line number Diff line number Diff line change
Expand Up @@ -60,7 +60,7 @@
parser.add_argument('-b', '--batch-size', default=4096, type=int,
metavar='N',
help='mini-batch size (default: 4096), this is the total '
'batch size of all GPUs on the current node when '
'batch size of all GPUs on all nodes when '
'using Data Parallel or Distributed Data Parallel')
parser.add_argument('--lr', '--learning-rate', default=0.6, type=float,
metavar='LR', help='initial (base) learning rate', dest='lr')
Expand Down

0 comments on commit 7074f47

Please sign in to comment.