Learning Rate Dropout

https://arxiv.org/abs/1912.00144

examples

{
  "class": "function:hypergan.train_hooks.learning_rate_dropout_train_hook.LearningRateDropoutTrainHook",
  "dropout": 0.01,
  "ones": 1e12,
  "zeros": 0.0,
  "skip_d": true
}

options

attribute

description

type

dropout

0-1 dropout ratio. Defaults to 0.5

float

ones

The gradient multiplier when not dropped out. Defaults to 0.1

float

zeros

The gradient multiplier when dropped out. Defaults to 0.0

float

skip_d

skip d gradients Defaults to false

boolean

skip_g

skip g gradients Defaults to false

boolean

Floats are configurable parameters