MADGRAD.ConfigΒΆ

Component: MADGRAD

class MADGRAD.Config[source]

Bases: Optimizer.Config

All Attributes (including base classes)

lr: float = 0.001
eps: float = 1e-06
momentum: float = 0.9
weight_decay: float = 0.0

Default JSON

{
    "lr": 0.001,
    "eps": 1e-06,
    "momentum": 0.9,
    "weight_decay": 0.0
}