The backpropagation of error learning rule, that can be used to train multistage perceptrons with semi-linear activation. Binary threshold functions as well as other non-differentiable functions will no longer be supported, but which does not matter. The Fermi function or the hyperbolic tangent can arbitrarily approximate the binary threshold function by the use of a temperature parameter T.