Dynamic tunneling based regularization in feedforward neural networks

This paper presents a new regularization method based on dynamic tunneling for enhancing generalization capability of multilayered neural networks. The proposed method enables escape through undesired sub-optimal solutions on the composite error surface by means of dynamic tunneling. Undesired sub-o...

Full description

Bibliographic Details
Main Authors: Singh, Y.P., RoyChowdhury, Pinaki
Format: Article
Language:English
Published: 2001
Subjects:
Online Access:http://shdl.mmu.edu.my/2685/
http://shdl.mmu.edu.my/2685/1/1926.pdf
Description
Summary:This paper presents a new regularization method based on dynamic tunneling for enhancing generalization capability of multilayered neural networks. The proposed method enables escape through undesired sub-optimal solutions on the composite error surface by means of dynamic tunneling. Undesired sub-optimal solutions may be increased or introduced from regularized objective function. Hence, the proposed method is capable of enhancing the regularization property without getting stuck at sub-optimal values in search space. The regularization property and escape from the sub-optimal values have been demonstrated through computer simulations on two examples. (C) 2001 Elsevier Science B.V. All rights reserved.