the mathematical transformation to a neural network's node in a given layer, meant to reduce the loss
the transformation is calculated during backpropagation for each node
the transformation is applied during gradient descent
the mathematical transformation to a neural network's node in a given layer, meant to reduce the loss
the transformation is calculated during backpropagation for each node
the transformation is applied during gradient descent