Synthetic data driven deep learning for plant phenotyping

The need for large quantities of high quality training data is one of the overarching problems facing the Computer Vision and Deep Learning research community. The need to seek versatile, scalable solutions to this problem is imperative as neural networks become involved with almost every aspect of...

Full description

Bibliographic Details
Main Author: Hartley, Zane K.J.
Format: Thesis (University of Nottingham only)
Language:English
Published: 2024
Subjects:
Online Access:https://eprints.nottingham.ac.uk/77848/
_version_ 1848801027011117056
author Hartley, Zane K.J.
author_facet Hartley, Zane K.J.
author_sort Hartley, Zane K.J.
building Nottingham Research Data Repository
collection Online Access
description The need for large quantities of high quality training data is one of the overarching problems facing the Computer Vision and Deep Learning research community. The need to seek versatile, scalable solutions to this problem is imperative as neural networks become involved with almost every aspect of the modern world. The topic of this thesis is training neural networks with Synthetic Data, one of the most promising solutions to the problem of data scarcity. In this thesis I focus these attempts on plant phenotyping tasks, an important field of interest within Computer Vision concerned with the automatic measurement of the physical features of different plants. This thesis presents a number of Synthetic Datasets created with deep learning in mind, and then details a number of novel techniques for leveraging these datasets when working on phenotyping problems, focusing on domain adaptation, style transfer and network fine-tuning. I present a heatmap guidance extension for style transfer, and a clustering approach to deep learning training to improve generalisation on diverse target datasets. Then my work on 3D reconstruction is presented, where domain adaptation is performed simultaneously with training a volumetric regression network, allowing for an unsupervised domain adaptation approach using an unlabeled train set. I present a series of experiments comparing Synthetic Data and fine-tuning approach between CNN and Transformer based architectures. Finally I look at Diffusion Models, a new form of generative neural network that promises to be the future of synthetic data generation.
first_indexed 2025-11-14T21:00:55Z
format Thesis (University of Nottingham only)
id nottingham-77848
institution University of Nottingham Malaysia Campus
institution_category Local University
language English
last_indexed 2025-11-14T21:00:55Z
publishDate 2024
recordtype eprints
repository_type Digital Repository
spelling nottingham-778482024-07-23T04:40:23Z https://eprints.nottingham.ac.uk/77848/ Synthetic data driven deep learning for plant phenotyping Hartley, Zane K.J. The need for large quantities of high quality training data is one of the overarching problems facing the Computer Vision and Deep Learning research community. The need to seek versatile, scalable solutions to this problem is imperative as neural networks become involved with almost every aspect of the modern world. The topic of this thesis is training neural networks with Synthetic Data, one of the most promising solutions to the problem of data scarcity. In this thesis I focus these attempts on plant phenotyping tasks, an important field of interest within Computer Vision concerned with the automatic measurement of the physical features of different plants. This thesis presents a number of Synthetic Datasets created with deep learning in mind, and then details a number of novel techniques for leveraging these datasets when working on phenotyping problems, focusing on domain adaptation, style transfer and network fine-tuning. I present a heatmap guidance extension for style transfer, and a clustering approach to deep learning training to improve generalisation on diverse target datasets. Then my work on 3D reconstruction is presented, where domain adaptation is performed simultaneously with training a volumetric regression network, allowing for an unsupervised domain adaptation approach using an unlabeled train set. I present a series of experiments comparing Synthetic Data and fine-tuning approach between CNN and Transformer based architectures. Finally I look at Diffusion Models, a new form of generative neural network that promises to be the future of synthetic data generation. 2024-07-23 Thesis (University of Nottingham only) NonPeerReviewed application/pdf en cc_by https://eprints.nottingham.ac.uk/77848/1/PhD_Thesis__With_Corrections_.pdf Hartley, Zane K.J. (2024) Synthetic data driven deep learning for plant phenotyping. PhD thesis, University of Nottingham. Deep Learning Computer Vision Plant Phenotyping
spellingShingle Deep Learning
Computer Vision
Plant Phenotyping
Hartley, Zane K.J.
Synthetic data driven deep learning for plant phenotyping
title Synthetic data driven deep learning for plant phenotyping
title_full Synthetic data driven deep learning for plant phenotyping
title_fullStr Synthetic data driven deep learning for plant phenotyping
title_full_unstemmed Synthetic data driven deep learning for plant phenotyping
title_short Synthetic data driven deep learning for plant phenotyping
title_sort synthetic data driven deep learning for plant phenotyping
topic Deep Learning
Computer Vision
Plant Phenotyping
url https://eprints.nottingham.ac.uk/77848/