AdaBelief.Config¶

Component: AdaBelief

class AdaBelief.Config[source]: Bases: Optimizer.Config

All Attributes (including base classes)

lr: float = 0.001

beta_1: float = 0.9

beta_2: float = 0.999

eps: float = 1e-08

weight_decay: float = 0

amsgrad: bool = False

weight_decouple: bool = True

fixed_decay: bool = True

rectify: bool = False

Default JSON

{
    "lr": 0.001,
    "beta_1": 0.9,
    "beta_2": 0.999,
    "eps": 1e-08,
    "weight_decay": 0,
    "amsgrad": false,
    "weight_decouple": true,
    "fixed_decay": true,
    "rectify": false
}