Reconstruction of handwritten digit images using autoencoder neural networks

This paper compares the performances of three types of autoencoder neural networks, namely, the traditional autoencoder with Restricted Boltzmann Machine (RBM), the stacked autoencoder without RBM and the stacked autoencoder with RBM based on the efficiency for reconstruction of handwritten digit im...

Full description

Bibliographic Details
Main Authors: C. C., Tan, C., Eswaran
Format: Conference or Workshop Item
Published: 2008
Subjects:
Online Access:http://shdl.mmu.edu.my/2853/
Description
Summary:This paper compares the performances of three types of autoencoder neural networks, namely, the traditional autoencoder with Restricted Boltzmann Machine (RBM), the stacked autoencoder without RBM and the stacked autoencoder with RBM based on the efficiency for reconstruction of handwritten digit images. Experiments are performed to determine the reconstruction error in all the three cases using the same architecture configuration and training algorithm. The results show that the RBM stacked autoencoder gives better performance in terms of the reconstruction error compared to the other two architectures. We also show that all the architectures outperform PCA in terms of the reconstruction error.