What is the meaning of base_lrs?

[rosefun]

I don't find the initialization of base_lrs? Does it initialize with 0?

[gauenk]

This is defined in the base class _LRScheduler (c.f. see here). The base_lrs by default takes the "lr" parameter set by the optimizer (c.f. see here). I believe the "lr" is usually contained in the "defaults" field of the optimizer, so it is not explicitly set.

So you can initialize it to whatever when you create your optimizer.