espnet.scheduler.scheduler.NoamScheduler

source

class espnet.scheduler.scheduler.NoamScheduler(key, args)

Bases: SchedulerInterface

Warmup + InverseSqrt decay scheduler.

• Parameters:noam_warmup (int) – number of warmup iterations.

Initialize class.

alias = 'noam'

scale(step)

Scale of lr.