Getting Started
Training More Advanced Models
Extending PyText
References
Component: MADGRAD
MADGRAD
MADGRAD.
Config
Bases: Optimizer.Config
Optimizer.Config
All Attributes (including base classes)
lr: float = 0.001 eps: float = 1e-06 momentum: float = 0.9 weight_decay: float = 0.0
0.001
1e-06
0.9
0.0
Default JSON
{ "lr": 0.001, "eps": 1e-06, "momentum": 0.9, "weight_decay": 0.0 }