SGD

class SGD(clipGradient: ClipGradientAction) : Optimizer

Stochastic gradient descent optimizer.

NOTE: It's not an equivalent for keras.sgd, it is a pure SGD with simple 'variable' update by subtracting 'alpha' * 'delta' from it.

Constructors

SGD
Link copied to clipboard
fun SGD(learningRate: Float = 0.2f, clipGradient: ClipGradientAction = NoClipGradient())
SGD
Link copied to clipboard
fun SGD(clipGradient: ClipGradientAction = NoClipGradient())

Properties

clipGradient
Link copied to clipboard
val clipGradient: ClipGradientAction

Strategy of gradient clipping as sub-class of ClipGradientAction.

optimizerName
Link copied to clipboard
open override val optimizerName: String

Returns optimizer name.