LrSchedule

Discriminated union describing learning-rate schedule shapes.

Union cases

Name	Description
`CosineAnnealing(tMax, etaMin)`
`CosineAnnealingWarmRestarts(t0, tMult, etaMin)`
`CyclicLR(baseLr, maxLr, stepSizeUp, stepSizeDown)`
`Exponential gamma`
`LinearWarmup warmupSteps`
`OneCycle(totalSteps, maxLr, divFactor, finalDivFactor, pctStart)`
`Polynomial(totalSteps, power, endLr)`
`StepDecay(stepSize, gamma)`

Instance members

Name	Description
`this.IsCosineAnnealing`
`this.IsCosineAnnealingWarmRestarts`
`this.IsCyclicLR`
`this.IsExponential`
`this.IsLinearWarmup`
`this.IsOneCycle`
`this.IsPolynomial`
`this.IsStepDecay`

Scheduler

Scheduler that pairs a schedule with mutable step counter and LR setter.

Record fields

Name	Description
`BaseLr`
`CurrentStep`
`Schedule`
`SetLr`