A general principle adopted by most of these techniques is the decomposition of the problem into smaller problems that are easier to handle.
For each smaller problem, a single node is employed. Its parameters are determined either iteratively using appropriate learning algorithms.
From the way these algorithms build the network, they are sometimes referred to as constructive techniques. (查看原文)
The other direction we will follow to design a multilayer perceptron is to fix the architecture and compute its synaptic parameters so as to minimize an appropriate cost function of its output.
This method not only overcomes the drawback of the resulting large networks of the previous section but also makes these networks powerful tools for a number of other applications, beyond pattern recognition.
However, this method is confronted with a serious difficulty. This is discontinuity of the step(activation) function, prohibiting differentiation with respect to the unknown parameters(synaptic weights). (查看原文)
木子三水
电子工业出版社2010版
0 有用 zYx.Tom 2010-08-18 20:20:22
这本书作为入门比较好，讲得比较全，特别是在学校那个很棒的老师讲解下。估计翻译不太好，没有老师讲解看起来还是有点痛苦的。