Single-View Food Portion Estimation: Learning Image-to-Energy Mappings Using Generative Adversarial Networks
Due to the growing concern of chronic diseases and other health problems related to diet, there is a need to develop accurate methods to estimate an individual's food and energy intake. Measuring accurate dietary intake is an open research problem. In particular, accurate food portion estimatio...
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Conference Paper |
| Published: |
IEEE
2018
|
| Online Access: | http://hdl.handle.net/20.500.11937/73807 |
| _version_ | 1848763103458623488 |
|---|---|
| author | Fang, S. Shao, Z. Mao, R. Fu, C. Kerr, Deborah Boushey, C. Delp, E. Zhu, F. |
| author_facet | Fang, S. Shao, Z. Mao, R. Fu, C. Kerr, Deborah Boushey, C. Delp, E. Zhu, F. |
| author_sort | Fang, S. |
| building | Curtin Institutional Repository |
| collection | Online Access |
| description | Due to the growing concern of chronic diseases and other health problems related to diet, there is a need to develop accurate methods to estimate an individual's food and energy intake. Measuring accurate dietary intake is an open research problem. In particular, accurate food portion estimation is challenging since the process of food preparation and consumption impose large variations on food shapes and appearances. In this paper, we present a food portion estimation method to estimate food energy (kilocalories) from food images using Generative Adversarial Networks (GAN). We introduce the concept of an "energy distribution" for each food image. To train the GAN, we design a food image dataset based on ground truth food labels and segmentation masks for each food image as well as energy information associated with the food image. Our goal is to learn the mapping of the food image to the food energy. We can then estimate food energy based on the energy distribution. We show that an average energy estimation error rate of 10.89% can be obtained by learning the image-to-energy mapping. |
| first_indexed | 2025-11-14T10:58:08Z |
| format | Conference Paper |
| id | curtin-20.500.11937-73807 |
| institution | Curtin University Malaysia |
| institution_category | Local University |
| last_indexed | 2025-11-14T10:58:08Z |
| publishDate | 2018 |
| publisher | IEEE |
| recordtype | eprints |
| repository_type | Digital Repository |
| spelling | curtin-20.500.11937-738072019-07-31T23:29:03Z Single-View Food Portion Estimation: Learning Image-to-Energy Mappings Using Generative Adversarial Networks Fang, S. Shao, Z. Mao, R. Fu, C. Kerr, Deborah Boushey, C. Delp, E. Zhu, F. Due to the growing concern of chronic diseases and other health problems related to diet, there is a need to develop accurate methods to estimate an individual's food and energy intake. Measuring accurate dietary intake is an open research problem. In particular, accurate food portion estimation is challenging since the process of food preparation and consumption impose large variations on food shapes and appearances. In this paper, we present a food portion estimation method to estimate food energy (kilocalories) from food images using Generative Adversarial Networks (GAN). We introduce the concept of an "energy distribution" for each food image. To train the GAN, we design a food image dataset based on ground truth food labels and segmentation masks for each food image as well as energy information associated with the food image. Our goal is to learn the mapping of the food image to the food energy. We can then estimate food energy based on the energy distribution. We show that an average energy estimation error rate of 10.89% can be obtained by learning the image-to-energy mapping. 2018 Conference Paper http://hdl.handle.net/20.500.11937/73807 10.1109/ICIP.2018.8451461 IEEE restricted |
| spellingShingle | Fang, S. Shao, Z. Mao, R. Fu, C. Kerr, Deborah Boushey, C. Delp, E. Zhu, F. Single-View Food Portion Estimation: Learning Image-to-Energy Mappings Using Generative Adversarial Networks |
| title | Single-View Food Portion Estimation: Learning Image-to-Energy Mappings Using Generative Adversarial Networks |
| title_full | Single-View Food Portion Estimation: Learning Image-to-Energy Mappings Using Generative Adversarial Networks |
| title_fullStr | Single-View Food Portion Estimation: Learning Image-to-Energy Mappings Using Generative Adversarial Networks |
| title_full_unstemmed | Single-View Food Portion Estimation: Learning Image-to-Energy Mappings Using Generative Adversarial Networks |
| title_short | Single-View Food Portion Estimation: Learning Image-to-Energy Mappings Using Generative Adversarial Networks |
| title_sort | single-view food portion estimation: learning image-to-energy mappings using generative adversarial networks |
| url | http://hdl.handle.net/20.500.11937/73807 |