Deep reconstruction models for image set classification

Image set classification finds its applications in a number of real-life scenarios such as classification from surveillance videos, multi-view camera networks and personal albums. Compared with single image based classification, it offers more promises and has therefore attracted significant researc...

Full description

Bibliographic Details
Main Authors: Hayat, M., Bennamoun, M., An, Senjian
Format: Journal Article
Published: IEEE Computer Society 2015
Online Access:http://hdl.handle.net/20.500.11937/70275
_version_ 1848762262222798848
author Hayat, M.
Bennamoun, M.
An, Senjian
author_facet Hayat, M.
Bennamoun, M.
An, Senjian
author_sort Hayat, M.
building Curtin Institutional Repository
collection Online Access
description Image set classification finds its applications in a number of real-life scenarios such as classification from surveillance videos, multi-view camera networks and personal albums. Compared with single image based classification, it offers more promises and has therefore attracted significant research attention in recent years. Unlike many existing methods which assume images of a set to lie on a certain geometric surface, this paper introduces a deep learning framework which makes no such prior assumptions and can automatically discover the underlying geometric structure. Specifically, a Template Deep Reconstruction Model (TDRM) is defined whose parameters are initialized by performing unsupervised pre-training in a layer-wise fashion using Gaussian Restricted Boltzmann Machines (GRBMs). The initialized TDRM is then separately trained for images of each class and class-specific DRMs are learnt. Based on the minimum reconstruction errors from the learnt class-specific models, three different voting strategies are devised for classification. Extensive experiments are performed to demonstrate the efficacy of the proposed framework for the tasks of face and object recognition from image sets. Experimental results show that the proposed method consistently outperforms the existing state of the art methods.
first_indexed 2025-11-14T10:44:46Z
format Journal Article
id curtin-20.500.11937-70275
institution Curtin University Malaysia
institution_category Local University
last_indexed 2025-11-14T10:44:46Z
publishDate 2015
publisher IEEE Computer Society
recordtype eprints
repository_type Digital Repository
spelling curtin-20.500.11937-702752019-01-24T02:46:31Z Deep reconstruction models for image set classification Hayat, M. Bennamoun, M. An, Senjian Image set classification finds its applications in a number of real-life scenarios such as classification from surveillance videos, multi-view camera networks and personal albums. Compared with single image based classification, it offers more promises and has therefore attracted significant research attention in recent years. Unlike many existing methods which assume images of a set to lie on a certain geometric surface, this paper introduces a deep learning framework which makes no such prior assumptions and can automatically discover the underlying geometric structure. Specifically, a Template Deep Reconstruction Model (TDRM) is defined whose parameters are initialized by performing unsupervised pre-training in a layer-wise fashion using Gaussian Restricted Boltzmann Machines (GRBMs). The initialized TDRM is then separately trained for images of each class and class-specific DRMs are learnt. Based on the minimum reconstruction errors from the learnt class-specific models, three different voting strategies are devised for classification. Extensive experiments are performed to demonstrate the efficacy of the proposed framework for the tasks of face and object recognition from image sets. Experimental results show that the proposed method consistently outperforms the existing state of the art methods. 2015 Journal Article http://hdl.handle.net/20.500.11937/70275 10.1109/TPAMI.2014.2353635 IEEE Computer Society restricted
spellingShingle Hayat, M.
Bennamoun, M.
An, Senjian
Deep reconstruction models for image set classification
title Deep reconstruction models for image set classification
title_full Deep reconstruction models for image set classification
title_fullStr Deep reconstruction models for image set classification
title_full_unstemmed Deep reconstruction models for image set classification
title_short Deep reconstruction models for image set classification
title_sort deep reconstruction models for image set classification
url http://hdl.handle.net/20.500.11937/70275