SoftShrink
Content copied to clipboard
Softshrink activation function.
Transforms input 'x' according formula:
if x lambda: return x − lambda
if x < -lambda: return x + lambda
otherwise return 0
A faster approximation of the sigmoid activation.
Calls SoftShrinkActivation under the hood.