The most interesting feature of neural networks is their functionality to familiarize with challenges by means of training and, after acceptable training, to be ready to solve unknown problems of the equivalent class. This approach is named a generalization.

Learning is a comprehensive term. A learning system changes itself as a way to adapt to e.g. environmental changes. A neural network could learn from many things but, naturally, there will always be the query of how to implement it.