StochasticWeightAveraging.ConfigΒΆ

Component: StochasticWeightAveraging

class StochasticWeightAveraging.Config[source]

Bases: Optimizer.Config

All Attributes (including base classes)

optimizer: Union[SGD.Config, Adam.Config, AdamW.Config, Adagrad.Config, RAdam.Config, Lamb.Config, MADGRAD.Config] = SGD.Config()
start: int = 10
frequency: int = 5
swa_learning_rate: Optional[float] = 0.05

Default JSON

{
    "optimizer": {
        "SGD": {
            "lr": 0.001,
            "momentum": 0.0
        }
    },
    "start": 10,
    "frequency": 5,
    "swa_learning_rate": 0.05
}