Gradient Penalty

https://arxiv.org/pdf/1704.00028.pdf

$$lambda * relu(||gradients(target, components)||_2 - flex) ^2$$

examples

{                                                                                       
  "class": "function:hypergan.train_hooks.gradient_penalty_train_hook.GradientPenaltyTra
  "lambda": 1.00,                                                                       
  "flex": 1.0,                                                                          
  "components": ["discriminator"],                                                       
  "target": "discriminator"
}

options

attribute	description	type

target	Used in gradients(target, components) defaults to discriminator	string (optional)

lambda	Loss multiple defaults to 1.0	float

components	Used in gradients(target, components) defaults to all components	array of strings

flex	Can also be a list for separate X/G flex. example: [0.0, 10.0]	array of float

loss	Side loss is added to: g_loss or d_loss defaults to g_loss	string

Floats are configurable parameters