A GPU parallel approach improving the density of patch based multi-view stereo reconstruction
Multi-view stereo is the process of recreating three-dimensional data from a set of two or more images of a scene. The ability to acquire 3D data from 2D images is a core concept in computer vision with wide-ranging applications throughout areas such as 3D printing, robotics, recognition, navigation...
| Main Author: | |
|---|---|
| Format: | Thesis (University of Nottingham only) |
| Language: | English |
| Published: |
2016
|
| Online Access: | https://eprints.nottingham.ac.uk/32746/ |
| _version_ | 1848794481334157312 |
|---|---|
| author | Haines, Benjamin A. |
| author_facet | Haines, Benjamin A. |
| author_sort | Haines, Benjamin A. |
| building | Nottingham Research Data Repository |
| collection | Online Access |
| description | Multi-view stereo is the process of recreating three-dimensional data from a set of two or more images of a scene. The ability to acquire 3D data from 2D images is a core concept in computer vision with wide-ranging applications throughout areas such as 3D printing, robotics, recognition, navigation and a vast number of other fields. While 3D reconstruction has been increasingly well studied over the past decades, it is only with the recent evolution of CPU and GPU technologies that practical implementations, able to accurately, robustly and efficiently capture 3D data of photographed objects have begun to emerge. Whilst current research has been shown to perform well under specific circumstances and for a subset of objects, there are still many practical and implementary issues that remain an open problem for these techniques. Most notably, the ability to robustly reconstruct objects from sparse image sets or objects with low texture.
Alongside a review of algorithms within the multi-view field, the work proposed in this thesis outlines a massively parallel patch based multi-view stereo pipeline for static scene recovery. By utilising advances in GPU technology, a particle swarm algorithm implemented on the GPU forms the basis for improving the density of patch-based methods. The novelty of such an approach removes the reliance on feature matching and gradient descent to better account for the optimisation of patches within textureless regions, for which current methods struggle. An enhancement to the photo-consistency matching metric, which is used to evaluate the optimisation of each patch, is then defined. Specifically targeting the shortcomings of the photo-consistency metric when used inside a particle swarm optimisation, increasing its effectiveness over textureless areas. Finally, a multi-resolution reconstruction system based on a wavelet framework is presented to further improve upon the robustness of reconstruction over low textured regions. |
| first_indexed | 2025-11-14T19:16:53Z |
| format | Thesis (University of Nottingham only) |
| id | nottingham-32746 |
| institution | University of Nottingham Malaysia Campus |
| institution_category | Local University |
| language | English |
| last_indexed | 2025-11-14T19:16:53Z |
| publishDate | 2016 |
| recordtype | eprints |
| repository_type | Digital Repository |
| spelling | nottingham-327462025-02-28T13:25:06Z https://eprints.nottingham.ac.uk/32746/ A GPU parallel approach improving the density of patch based multi-view stereo reconstruction Haines, Benjamin A. Multi-view stereo is the process of recreating three-dimensional data from a set of two or more images of a scene. The ability to acquire 3D data from 2D images is a core concept in computer vision with wide-ranging applications throughout areas such as 3D printing, robotics, recognition, navigation and a vast number of other fields. While 3D reconstruction has been increasingly well studied over the past decades, it is only with the recent evolution of CPU and GPU technologies that practical implementations, able to accurately, robustly and efficiently capture 3D data of photographed objects have begun to emerge. Whilst current research has been shown to perform well under specific circumstances and for a subset of objects, there are still many practical and implementary issues that remain an open problem for these techniques. Most notably, the ability to robustly reconstruct objects from sparse image sets or objects with low texture. Alongside a review of algorithms within the multi-view field, the work proposed in this thesis outlines a massively parallel patch based multi-view stereo pipeline for static scene recovery. By utilising advances in GPU technology, a particle swarm algorithm implemented on the GPU forms the basis for improving the density of patch-based methods. The novelty of such an approach removes the reliance on feature matching and gradient descent to better account for the optimisation of patches within textureless regions, for which current methods struggle. An enhancement to the photo-consistency matching metric, which is used to evaluate the optimisation of each patch, is then defined. Specifically targeting the shortcomings of the photo-consistency metric when used inside a particle swarm optimisation, increasing its effectiveness over textureless areas. Finally, a multi-resolution reconstruction system based on a wavelet framework is presented to further improve upon the robustness of reconstruction over low textured regions. 2016-07-15 Thesis (University of Nottingham only) NonPeerReviewed application/pdf en arr https://eprints.nottingham.ac.uk/32746/1/Thesis.pdf Haines, Benjamin A. (2016) A GPU parallel approach improving the density of patch based multi-view stereo reconstruction. PhD thesis, University of Nottingham. |
| spellingShingle | Haines, Benjamin A. A GPU parallel approach improving the density of patch based multi-view stereo reconstruction |
| title | A GPU parallel approach improving the density of patch based multi-view stereo reconstruction |
| title_full | A GPU parallel approach improving the density of patch based multi-view stereo reconstruction |
| title_fullStr | A GPU parallel approach improving the density of patch based multi-view stereo reconstruction |
| title_full_unstemmed | A GPU parallel approach improving the density of patch based multi-view stereo reconstruction |
| title_short | A GPU parallel approach improving the density of patch based multi-view stereo reconstruction |
| title_sort | gpu parallel approach improving the density of patch based multi-view stereo reconstruction |
| url | https://eprints.nottingham.ac.uk/32746/ |