Balancing performance and effort in deep learning via the fusion of real and synthetic cultural heritage photogrammetry training sets
Cultural heritage presents both challenges and opportunities for the adoption and use of deep learning in 3D digitisation and digitalisation endeavours. While unique features in terms of the identity of artefacts are important factors that can contribute to training performance in deep learning algo...
| Main Authors: | , , , , , |
|---|---|
| Format: | Book Section |
| Language: | English |
| Published: |
SCITEPRESS
2021
|
| Subjects: | |
| Online Access: | https://eprints.nottingham.ac.uk/65359/ |
| _version_ | 1848800216994545664 |
|---|---|
| author | Ch’ng, Eugene Feng, Pinyuan Yao, Hongtao Zeng, Zihao Cheng, Danzhao Cai3, Shengdan |
| author_facet | Ch’ng, Eugene Feng, Pinyuan Yao, Hongtao Zeng, Zihao Cheng, Danzhao Cai3, Shengdan |
| author_sort | Ch’ng, Eugene |
| building | Nottingham Research Data Repository |
| collection | Online Access |
| description | Cultural heritage presents both challenges and opportunities for the adoption and use of deep learning in 3D digitisation and digitalisation endeavours. While unique features in terms of the identity of artefacts are important factors that can contribute to training performance in deep learning algorithms, challenges remain with regards to the laborious efforts in our ability to obtain adequate datasets that would both provide for the diversity of imageries, and across the range of multi-facet images for each object in use. One solution, and perhaps an important step towards the broader applicability of deep learning in the field of digital heritage is the fusion of both real and virtual datasets via the automated creation of diverse datasets that covers multiple views of individual objects over a range of diversified objects in the training pipeline, all facilitated by closerange photogrammetry generated 3D objects. The question is the ratio of the combination of real and synthetic imageries in which an inflection point occurs whereby performance is reduced. In this research, we attempt to reduce the need for manual labour by leveraging the flexibility provided for in automated data generation via close-range photogrammetry models with a view for future deep learning facilitated cultural heritage activities, such as digital identification, sorting, asset management and categorisation. |
| first_indexed | 2025-11-14T20:48:03Z |
| format | Book Section |
| id | nottingham-65359 |
| institution | University of Nottingham Malaysia Campus |
| institution_category | Local University |
| language | English |
| last_indexed | 2025-11-14T20:48:03Z |
| publishDate | 2021 |
| publisher | SCITEPRESS |
| recordtype | eprints |
| repository_type | Digital Repository |
| spelling | nottingham-653592021-06-04T07:04:47Z https://eprints.nottingham.ac.uk/65359/ Balancing performance and effort in deep learning via the fusion of real and synthetic cultural heritage photogrammetry training sets Ch’ng, Eugene Feng, Pinyuan Yao, Hongtao Zeng, Zihao Cheng, Danzhao Cai3, Shengdan Cultural heritage presents both challenges and opportunities for the adoption and use of deep learning in 3D digitisation and digitalisation endeavours. While unique features in terms of the identity of artefacts are important factors that can contribute to training performance in deep learning algorithms, challenges remain with regards to the laborious efforts in our ability to obtain adequate datasets that would both provide for the diversity of imageries, and across the range of multi-facet images for each object in use. One solution, and perhaps an important step towards the broader applicability of deep learning in the field of digital heritage is the fusion of both real and virtual datasets via the automated creation of diverse datasets that covers multiple views of individual objects over a range of diversified objects in the training pipeline, all facilitated by closerange photogrammetry generated 3D objects. The question is the ratio of the combination of real and synthetic imageries in which an inflection point occurs whereby performance is reduced. In this research, we attempt to reduce the need for manual labour by leveraging the flexibility provided for in automated data generation via close-range photogrammetry models with a view for future deep learning facilitated cultural heritage activities, such as digital identification, sorting, asset management and categorisation. SCITEPRESS 2021-02-04 Book Section PeerReviewed application/pdf en cc_by https://eprints.nottingham.ac.uk/65359/1/1-merged.pdf Ch’ng, Eugene, Feng, Pinyuan, Yao, Hongtao, Zeng, Zihao, Cheng, Danzhao and Cai3, Shengdan (2021) Balancing performance and effort in deep learning via the fusion of real and synthetic cultural heritage photogrammetry training sets. In: Proceedings of the 13th International Conference on Agents and Artificial Intelligence. SCITEPRESS, Portugal, pp. 611-621. ISBN 9789897584848 digital heritage；deep learning；object detection； data augmentation； photogrammetry； fusion dataset https://www.scitepress.org/Link.aspx?doi=10.5220/0010381206110621 10.5220/0010381206110621 10.5220/0010381206110621 10.5220/0010381206110621 |
| spellingShingle | digital heritage；deep learning；object detection； data augmentation； photogrammetry； fusion dataset Ch’ng, Eugene Feng, Pinyuan Yao, Hongtao Zeng, Zihao Cheng, Danzhao Cai3, Shengdan Balancing performance and effort in deep learning via the fusion of real and synthetic cultural heritage photogrammetry training sets |
| title | Balancing performance and effort in deep learning via the fusion of real and synthetic cultural heritage photogrammetry training sets |
| title_full | Balancing performance and effort in deep learning via the fusion of real and synthetic cultural heritage photogrammetry training sets |
| title_fullStr | Balancing performance and effort in deep learning via the fusion of real and synthetic cultural heritage photogrammetry training sets |
| title_full_unstemmed | Balancing performance and effort in deep learning via the fusion of real and synthetic cultural heritage photogrammetry training sets |
| title_short | Balancing performance and effort in deep learning via the fusion of real and synthetic cultural heritage photogrammetry training sets |
| title_sort | balancing performance and effort in deep learning via the fusion of real and synthetic cultural heritage photogrammetry training sets |
| topic | digital heritage；deep learning；object detection； data augmentation； photogrammetry； fusion dataset |
| url | https://eprints.nottingham.ac.uk/65359/ https://eprints.nottingham.ac.uk/65359/ https://eprints.nottingham.ac.uk/65359/ |