Like ReluX; but passes all values in the range [-X,X].

Rectified linear activation: f(x) = x < 0 ? 0 : x.

Rectified linear activation; where upper maximum is 6.0.

Rectified linear activation; where upper maximum specified by BatchDescriptor::value_max().

The GPU may operate 4x4 matrix FMA.

Naming convention: Y <-> row or height X <-> column or width Batch <-> batch, or N Depth <-> feature, or channel TODO(timshen): turn them into cuDNN names, e.g.

Naming convention: Y <-> row or height X <-> column or width Output <-> output feature, or N Input <-> input feature, or N TODO(timshen): turn them into cuDNN names, e.g.

Generic algorithm representation.

Convolution-specific parameters.

Generic tensor representation.

Describes a kind of non-linearity (threshold-like mathematical function).

Describe the math definition for the conv op.

Describes how a convolution input or output layer's data is formatted.

Specifies the data type used by an operation.

Describes how a convolution filter is laid out in the memory.