# Functions
NewAbs returns a new UnaryElementwise absolute value function.
NewAdd returns a new Add Function.
NewAddScalar returns a new AddScalar Function.
NewAffine returns a new Affine Function.
NewAppendRows returns a new AppendRows Function.
NewAt returns a new At Function.
NewCELU returns a new CELU Function.
NewColView extracts the i-th column from the input matrix.
NewConcat returns a new Concat Function.
NewCopy returns a new Copy Function.
NewCos returns a new UnaryElementwise cos function.
NewDiv returns a new Div Function.
NewDivScalar returns a new DivScalar Function.
NewDot returns a new Dot Function.
NewDropout returns a new Dropout Function.
NewELU returns a new ELU Function.
NewExp returns a new Exp Function.
NewFlatten returns a new Flatten Function.
NewGELU returns a new UnaryElementwise Gaussian Error Linear Unit (GELU) function.
NewHardSigmoid returns a new UnaryElementwise hard sigmoid function.
NewHardTanh returns a new UnaryElementwise hard hyperbolic tangent function.
NewLeakyReLU returns a new LeakyReLU Function.
NewLog returns a new Log Function.
NewMax returns a new Max Function.
NewMaxPooling returns a new MaxPooling Function.
NewMin returns a new Min Function.
NewMish returns a new UnaryElementwise Mish function.
NewMul returns a new Mul Function.
NewMulT returns a new MulT Function.
NewNeg returns a new UnaryElementwise f(x) = -x function.
NewPow returns a new Pow Function.
NewProd returns a new Prod Function.
NewProdScalar returns a new ProdScalar Function.
NewReciprocal returns a new UnaryElementwise reciprocal function.
NewReduceMax returns a new ReduceMax Function.
NewReduceMean returns a new ReduceMean Function.
NewReduceSum returns a new ReduceSum Function.
NewReLU returns a new UnaryElementwise Rectified Linear Unit (ReLU) function.
NewReshape returns a new Reshape Function.
NewReverseSubScalar returns a new ReverseSubScalar Function.
NewRotateR returns a new RotateR Function.
NewRowView returns a new RowView Function.
NewScalarMax returns a new ScalarMax Function.
NewSELU returns a new SELU Function.
NewSigmoid returns a new Log Function.
NewSiLU (Sigmoid Linear Unit) returns a new function of the form f(x) = x * sigmoid(x).
NewSin returns a new UnaryElementwise sine function.
NewSlice returns a new Slice Function.
NewSoftmax returns a new Softmax Function.
NewSoftPlus returns a new SoftPlus Function.
NewSoftShrink returns a new SoftShrink Function.
NewSoftsign returns a new UnaryElementwise softsign function.
NewSparseMax returns a new SparseMax Function.
NewSparseMaxLoss returns a new SparseMaxLoss Function.
NewSqrt returns a new Sqrt Function.
NewSquare returns a new Square Function.
NewStack returns a new Stack Function.
NewSub returns a new Sub Function.
NewSubScalar returns a new SubScalar Function.
NewSwish returns a new Swish Function.
NewSwishB returns a new SwishB Function.
NewTan returns a new UnaryElementwise tangent function.
NewTanh returns a new UnaryElementwise hyperbolic tangent function.
NewThreshold returns a new Threshold Function.
NewTranspose returns a new Transpose Function.
# Structs
Abs is an operator to perform element-wise absolute value function.
Add is an operator to perform element-wise sum over two values.
AddScalar is an operator to perform element-wise addition over two values.
Affine is an operator to apply the affine function y = b + W1x1 + W2x2 + ..
AppendRows is a Function which appends new tail rows to a matrix.
At is an operator to obtain the i,j-th value of a matrix.
CELU is an operator to perform the CELU activation.
ColView is an operator to extract the i-th column from a matrix.
Concat is an operator to perform vector concatenation.
Copy is an operator to perform copy function.
Cos is an operator to perform element-wise cos.
Div is an operator to perform element-wise division over two values.
DivScalar is an operator to perform element-wise division with a scalar value.
Dot is an operator to perform the dot product over two matrices.
Dropout is an operator to perform elements dropout with a probability.
ELU is an operator to perform the ELU activation function.
Exp is an operator to perform element-wise base-e exponential function.
Flatten is a Function to reshape a matrix-operand into a "flattened" row vector.
GELU is an operator to perform element-wise GELU.
HardSigmoid is an operator to perform element-wise hard sigmoid.
HardTanh is an operator to perform element-wise hard hyperbolic tangent.
LeakyReLU is an operator to perform the LeakyReLU activation function.
Log is an operator to perform element-wise natural logarithm function.
Max is an operator to perform element-wise max.
MaxPooling is an operator to perform max pooling.
Min is an operator to perform element-wise min.
Mish is an operator to perform element-wise mish.
Mul is an operator to perform matrix-vector multiplication.
MulT is an operator to perform matrix-vector multiplication.
Neg is an operator to perform element-wise f(x) = -x.
Pow is an operator to perform element-wise pow function.
Prod is an operator to perform element-wise product over two values.
ProdScalar is an operator to perform element-wise product with a scalar value.
Reciprocal is an operator to perform element-wise reciprocal.
ReduceMax is an operator to perform reduce-max function.
ReduceMean is an operator to perform reduce-mean function.
ReduceSum is an operator to perform reduce-sum function.
ReLU is an operator to perform element-wise Rectified Linear Unit (ReLU).
Reshape is a Function which reshapes an operand into a new matrix of given rows × columns size.
ReverseSubScalar is the element-wise subtraction function over two values.
RotateR is a function to perform a right circular shift of a vector.
RowView is a function to extract the i-th row from the input matrix.
ScalarMax is an operator to perform reduce-max function on a list of scalars.
SELU function: f(x) = scale ∗ (max(0,x) + min(0, α ∗ (exp(x) − 1))).
Sigmoid is an operator to perform element-wise sigmoid function.
Sin is an operator to perform element-wise sin.
Slice is a function to extract a portion of a matrix.
Softmax is a single-input softmax function.
SoftPlus function: f(x) = 1 / β ∗ log(1 + exp(β ∗ x)).
SoftShrink function: f(x) = x − λ if x > λ; x + λ if x < −λ; 0 otherwise.
Softsign is an operator to perform element-wise softsign.
SparseMax function implementation, based on https://github.com/gokceneraslan/SparseMax.torch.
SparseMaxLoss function implementation, based on https://github.com/gokceneraslan/SparseMax.torch.
Sqrt is an operator to perform element-wise square root function.
Square is an operator to perform element-wise square.
Stack is a Function which stacks together all given operand matrices, producing a single bigger matrix as result.
Sub is an element-wise subtraction function over two values.
SubScalar is an element-wise subtraction function with a scalar value.
Swish is an operator to perform element-wise swish function: y = x * sigmoid(x).
SwishB function: f(x) = x * sigmoid.
Tan is an operator to perform element-wise tangent.
Tanh is an operator to perform element-wise hyperbolic tangent.
Threshold function: f(x) = x if x > threshold; k otherwise.
Transpose is a Function to calculate the transpose of the matrix-operand.
UnaryElementwise is a single-input element-wise function.