New returns a new AdaGrad optimizer, initialized according to the given configuration.

NewConfig returns a new AdaGrad Config.

NewDefaultConfig returns a new Config with generically reasonable default values.

AdaGrad assigns a different learning rate to each parameter using the sum of squares of its all historical gradients.

Config provides configuration settings for an AdaGrad optimizer.