3D face and body reconstruction via volumetric regression networks
3D Face reconstruction is the process of estimating the full 3D geometry of a human's face from one or more images. Applications of 3D face reconstruction span many areas, from personalisation of video games and trying on accessories online, to measuring emotional arousal for psychological stud...
| Main Author: | |
|---|---|
| Format: | Thesis (University of Nottingham only) |
| Language: | English |
| Published: |
2019
|
| Subjects: | |
| Online Access: | https://eprints.nottingham.ac.uk/59121/ |
| _version_ | 1848799588501159936 |
|---|---|
| author | Jackson, Aaron S. |
| author_facet | Jackson, Aaron S. |
| author_sort | Jackson, Aaron S. |
| building | Nottingham Research Data Repository |
| collection | Online Access |
| description | 3D Face reconstruction is the process of estimating the full 3D geometry of a human's face from one or more images. Applications of 3D face reconstruction span many areas, from personalisation of video games and trying on accessories online, to measuring emotional arousal for psychological studies and in medicine, such as simulating the result of reconstructive surgery. Approaches to 3D face reconstruction generally depend on a 3D Morphable Model (3DMM) - a parametric model, where the shape, pose and expression can be adjusted using a small number of parameters. While methods based on such techniques can work well on frontal images, they often begin to fail on cases of large pose, difficult expression, occlusion, and bad lighting. Additionally, encoding detail in so few parameters is not possible.
In this thesis, we propose a novel approach to the problem of 3D face reconstruction: Volumetric Regression Networks. Our non-parametric approach constrains the problem to the spatial domain using an end-to-end network which directly regresses the 3D geometry using a volumetric representation. This avoids the need for 3DMM generation, which involves finding correspondence between all vertices of all training samples, but also the fitting stage, which requires solving a difficult optimisation problem. We demonstrate that doing so can not only provide state-of-the-art results, but also be adapted to other deformable objects, such as the full human body. |
| first_indexed | 2025-11-14T20:38:03Z |
| format | Thesis (University of Nottingham only) |
| id | nottingham-59121 |
| institution | University of Nottingham Malaysia Campus |
| institution_category | Local University |
| language | English |
| last_indexed | 2025-11-14T20:38:03Z |
| publishDate | 2019 |
| recordtype | eprints |
| repository_type | Digital Repository |
| spelling | nottingham-591212025-02-28T14:39:40Z https://eprints.nottingham.ac.uk/59121/ 3D face and body reconstruction via volumetric regression networks Jackson, Aaron S. 3D Face reconstruction is the process of estimating the full 3D geometry of a human's face from one or more images. Applications of 3D face reconstruction span many areas, from personalisation of video games and trying on accessories online, to measuring emotional arousal for psychological studies and in medicine, such as simulating the result of reconstructive surgery. Approaches to 3D face reconstruction generally depend on a 3D Morphable Model (3DMM) - a parametric model, where the shape, pose and expression can be adjusted using a small number of parameters. While methods based on such techniques can work well on frontal images, they often begin to fail on cases of large pose, difficult expression, occlusion, and bad lighting. Additionally, encoding detail in so few parameters is not possible. In this thesis, we propose a novel approach to the problem of 3D face reconstruction: Volumetric Regression Networks. Our non-parametric approach constrains the problem to the spatial domain using an end-to-end network which directly regresses the 3D geometry using a volumetric representation. This avoids the need for 3DMM generation, which involves finding correspondence between all vertices of all training samples, but also the fitting stage, which requires solving a difficult optimisation problem. We demonstrate that doing so can not only provide state-of-the-art results, but also be adapted to other deformable objects, such as the full human body. 2019-12-13 Thesis (University of Nottingham only) NonPeerReviewed application/pdf en arr https://eprints.nottingham.ac.uk/59121/1/thesis.pdf Jackson, Aaron S. (2019) 3D face and body reconstruction via volumetric regression networks. PhD thesis, University of Nottingham. volumetric regression deep learning convolutional neural network 3d reconstruction |
| spellingShingle | volumetric regression deep learning convolutional neural network 3d reconstruction Jackson, Aaron S. 3D face and body reconstruction via volumetric regression networks |
| title | 3D face and body reconstruction via volumetric regression networks |
| title_full | 3D face and body reconstruction via volumetric regression networks |
| title_fullStr | 3D face and body reconstruction via volumetric regression networks |
| title_full_unstemmed | 3D face and body reconstruction via volumetric regression networks |
| title_short | 3D face and body reconstruction via volumetric regression networks |
| title_sort | 3d face and body reconstruction via volumetric regression networks |
| topic | volumetric regression deep learning convolutional neural network 3d reconstruction |
| url | https://eprints.nottingham.ac.uk/59121/ |