Backpropagation
Backpropagation is a generalization of the Delta rule to be able to take into account non-linear functions. Suppose a differentiable function of the input vector $$y_{k}^{p}=f(s_{k}^{p})$$ where \(k\) represents the \(k\)-th unit of the network and \(p\) the \(p\)-th pattern. \(f (s_ {k} ^ {p})\) is called activation function, and depends on a linear combination Read More …