StochasticWeightAveraging.ConfigΒΆ
Component: StochasticWeightAveraging
-
class
StochasticWeightAveraging.
Config
[source] Bases:
Optimizer.Config
All Attributes (including base classes)
- optimizer: Union[SGD.Config, Adam.Config, AdamW.Config, Adagrad.Config, RAdam.Config, Lamb.Config, MADGRAD.Config] = SGD.Config()
- start: int =
10
- frequency: int =
5
- swa_learning_rate: Optional[float] =
0.05
Default JSON
{
"optimizer": {
"SGD": {
"lr": 0.001,
"momentum": 0.0
}
},
"start": 10,
"frequency": 5,
"swa_learning_rate": 0.05
}