PolynomialDecayScheduler.Config

Component: PolynomialDecayScheduler

class PolynomialDecayScheduler.Config

Bases: BatchScheduler.Config

All Attributes (including base classes)

warmup_steps: int = 0

number of training steps over which to increase learning rate

total_steps: int

number of training steps for learning rate decay

end_learning_rate: float

end learning rate after total_steps of training

power: float = 1.0

power used for polynomial decay calculation

Warning

This config has parameters with no default values. We aren’t yet able to generate functional JSON for it.