Learning Rate Dropout

https://arxiv.org/abs/1912.00144

examples

{
"class": "function:hypergan.train_hooks.learning_rate_dropout_train_hook.LearningRateDropoutTrainHook",
"dropout": 0.01,
"ones": 1e12,
"zeros": 0.0,
"skip_d": true
}

options

attribute

description

type

dropout

0-1 dropout ratio. Defaults to 0.5

float

ones

The gradient multiplier when not dropped out. Defaults to 0.1

float

zeros

The gradient multiplier when dropped out. Defaults to 0.0

float

skip_d

skip d gradients

Defaults to false

boolean

skip_g

skip g gradients

Defaults to false

boolean

Floats are configurable parameters‚Äč