Investigation of activation functions in deep belief network

© 2017 IEEE. Deep Belief Network (DBN) is made up of stacked Restricted Boltzmann Machine layers associated with global weight fine-tuning for pattern recognition. However, DBN suffers from vanishing gradient problem due to the saturation characteristic of activation function. Therefore, the selecti...

Full description

Bibliographic Details
Main Authors: Lau, M., Lim, Hann
Format: Conference Paper
Published: 2017
Online Access:http://hdl.handle.net/20.500.11937/54534