Multiple hypotheses image segmentation and classification with application to dietary assessment

We propose a method for dietary assessment to automatically identify and locate food in a variety of images captured during controlled and natural eating events. Two concepts are combined to achieve this: a set of segmented objects can be partitioned into perceptually similar object classes based on...

Full description

Bibliographic Details
Main Authors: Zhu, F., Bosch, M., Khanna, N., Boushey, Carol, Delp, E.
Format: Journal Article
Published: Institute of Electrical and Electronics Engineers 2015
Online Access:http://hdl.handle.net/20.500.11937/50889
_version_ 1848758560538755072
author Zhu, F.
Bosch, M.
Khanna, N.
Boushey, Carol
Delp, E.
author_facet Zhu, F.
Bosch, M.
Khanna, N.
Boushey, Carol
Delp, E.
author_sort Zhu, F.
building Curtin Institutional Repository
collection Online Access
description We propose a method for dietary assessment to automatically identify and locate food in a variety of images captured during controlled and natural eating events. Two concepts are combined to achieve this: a set of segmented objects can be partitioned into perceptually similar object classes based on global and local features; and perceptually similar object classes can be used to assess the accuracy of image segmentation. These ideas are implemented by generating multiple segmentations of an image to select stable segmentations based on the classifier's confidence score assigned to each segmented image region. Automatic segmented regions are classified using a multichannel feature classification system. For each segmented region, multiple feature spaces are formed. Feature vectors in each of the feature spaces are individually classified. The final decision is obtained by combining class decisions from individual feature spaces using decision rules. We show improved accuracy of segmenting food images with classifier feedback.
first_indexed 2025-11-14T09:45:56Z
format Journal Article
id curtin-20.500.11937-50889
institution Curtin University Malaysia
institution_category Local University
last_indexed 2025-11-14T09:45:56Z
publishDate 2015
publisher Institute of Electrical and Electronics Engineers
recordtype eprints
repository_type Digital Repository
spelling curtin-20.500.11937-508892018-03-29T09:09:27Z Multiple hypotheses image segmentation and classification with application to dietary assessment Zhu, F. Bosch, M. Khanna, N. Boushey, Carol Delp, E. We propose a method for dietary assessment to automatically identify and locate food in a variety of images captured during controlled and natural eating events. Two concepts are combined to achieve this: a set of segmented objects can be partitioned into perceptually similar object classes based on global and local features; and perceptually similar object classes can be used to assess the accuracy of image segmentation. These ideas are implemented by generating multiple segmentations of an image to select stable segmentations based on the classifier's confidence score assigned to each segmented image region. Automatic segmented regions are classified using a multichannel feature classification system. For each segmented region, multiple feature spaces are formed. Feature vectors in each of the feature spaces are individually classified. The final decision is obtained by combining class decisions from individual feature spaces using decision rules. We show improved accuracy of segmenting food images with classifier feedback. 2015 Journal Article http://hdl.handle.net/20.500.11937/50889 10.1109/JBHI.2014.2304925 Institute of Electrical and Electronics Engineers restricted
spellingShingle Zhu, F.
Bosch, M.
Khanna, N.
Boushey, Carol
Delp, E.
Multiple hypotheses image segmentation and classification with application to dietary assessment
title Multiple hypotheses image segmentation and classification with application to dietary assessment
title_full Multiple hypotheses image segmentation and classification with application to dietary assessment
title_fullStr Multiple hypotheses image segmentation and classification with application to dietary assessment
title_full_unstemmed Multiple hypotheses image segmentation and classification with application to dietary assessment
title_short Multiple hypotheses image segmentation and classification with application to dietary assessment
title_sort multiple hypotheses image segmentation and classification with application to dietary assessment
url http://hdl.handle.net/20.500.11937/50889