Model-based food volume estimation using 3D pose

We are developing a dietary assessment system to automatically identify and quantify foods and beverages consumed by analyzing meal images captured with a mobile device. After food items are segmented and identified, accurately estimating the volume of the food in the image is important for determin...

Full description

Bibliographic Details
Main Authors: Xu, C., He, Y., Khanna, N., Boushey, Carol, Delp, E.
Format: Conference Paper
Published: 2013
Online Access:http://hdl.handle.net/20.500.11937/50843
_version_ 1848758549102985216
author Xu, C.
He, Y.
Khanna, N.
Boushey, Carol
Delp, E.
author_facet Xu, C.
He, Y.
Khanna, N.
Boushey, Carol
Delp, E.
author_sort Xu, C.
building Curtin Institutional Repository
collection Online Access
description We are developing a dietary assessment system to automatically identify and quantify foods and beverages consumed by analyzing meal images captured with a mobile device. After food items are segmented and identified, accurately estimating the volume of the food in the image is important for determining the nutrient content of the food. In this paper, we proposed a novel food portion size estimation method for rigid food items using a single image. First, we create a 3D graphical model during the training step using 3D reconstruction from multiple views. Then, for each food image, we determine the translation and elevation parameters of each of the food items, which are relative to the camera coordinate through camera calibration. Using these geometric parameters we project the pre-built 3D model of each food item back to the image plane. Subsequently, the remaining degrees-of-freedom (DOF) for the final pose is estimated by image similarity measure. The experimental results of our volume estimation method for four food categories validate the accuracy and reliability of our model-based approach.
first_indexed 2025-11-14T09:45:45Z
format Conference Paper
id curtin-20.500.11937-50843
institution Curtin University Malaysia
institution_category Local University
last_indexed 2025-11-14T09:45:45Z
publishDate 2013
recordtype eprints
repository_type Digital Repository
spelling curtin-20.500.11937-508432018-03-29T09:09:27Z Model-based food volume estimation using 3D pose Xu, C. He, Y. Khanna, N. Boushey, Carol Delp, E. We are developing a dietary assessment system to automatically identify and quantify foods and beverages consumed by analyzing meal images captured with a mobile device. After food items are segmented and identified, accurately estimating the volume of the food in the image is important for determining the nutrient content of the food. In this paper, we proposed a novel food portion size estimation method for rigid food items using a single image. First, we create a 3D graphical model during the training step using 3D reconstruction from multiple views. Then, for each food image, we determine the translation and elevation parameters of each of the food items, which are relative to the camera coordinate through camera calibration. Using these geometric parameters we project the pre-built 3D model of each food item back to the image plane. Subsequently, the remaining degrees-of-freedom (DOF) for the final pose is estimated by image similarity measure. The experimental results of our volume estimation method for four food categories validate the accuracy and reliability of our model-based approach. 2013 Conference Paper http://hdl.handle.net/20.500.11937/50843 10.1109/ICIP.2013.6738522 restricted
spellingShingle Xu, C.
He, Y.
Khanna, N.
Boushey, Carol
Delp, E.
Model-based food volume estimation using 3D pose
title Model-based food volume estimation using 3D pose
title_full Model-based food volume estimation using 3D pose
title_fullStr Model-based food volume estimation using 3D pose
title_full_unstemmed Model-based food volume estimation using 3D pose
title_short Model-based food volume estimation using 3D pose
title_sort model-based food volume estimation using 3d pose
url http://hdl.handle.net/20.500.11937/50843