AdamW.ConfigΒΆ

Component: AdamW

class AdamW.Config[source]

Bases: Optimizer.Config

All Attributes (including base classes)

lr: float = 0.001
weight_decay: float = 0.01
eps: float = 1e-08

Default JSON

{
    "lr": 0.001,
    "weight_decay": 0.01,
    "eps": 1e-08
}