HardSigmoid
Content copied to clipboard
Hard sigmoid activation function.
Transforms input 'x' according formula:
if x < -2.5: return 0
if x 2.5: return 1
if -2.5 <= x <= 2.5: return 0.2 * x + 0.5
A faster approximation of the sigmoid activation.
Calls HardSigmoidActivation under the hood.