Getting Started
Training More Advanced Models
Extending PyText
References
Component: AdamW
AdamW
AdamW.
Config
Bases: Optimizer.Config
Optimizer.Config
All Attributes (including base classes)
lr: float = 0.001 weight_decay: float = 0.01 eps: float = 1e-08
0.001
0.01
1e-08
Default JSON
{ "lr": 0.001, "weight_decay": 0.01, "eps": 1e-08 }