Backpropagation

Backpropagation is a generalization of the Delta rule to be able to take into account non-linear functions. Suppose a differentiable function of the input vector $$y_{k}^{p}=f(s_{k}^{p})$$ where $$k$$ represents the $$k$$-th unit of the network and $$p$$ the $$p$$-th pattern. $$f (s_ {k} ^ {p})$$ is called activation function, and depends on a linear combination Read More …