Automated detection of workers and heavy equipment on construction sites: A convolutional neural network approach

© 2018 Elsevier Ltd Detecting the presence of workers, plant, equipment, and materials (i.e. objects) on sites to improve safety and productivity has formed an integral part of computer vision-based research in construction. Such research has tended to focus on the use of computer vision and pattern...

Full description

Bibliographic Details
Main Authors: Fang, W., Ding, L., Zhong, B., Love, Peter, Luo, H.
Format: Journal Article
Published: Pergamon Press 2018
Online Access:http://hdl.handle.net/20.500.11937/69099
_version_ 1848761967398879232
author Fang, W.
Ding, L.
Zhong, B.
Love, Peter
Luo, H.
author_facet Fang, W.
Ding, L.
Zhong, B.
Love, Peter
Luo, H.
author_sort Fang, W.
building Curtin Institutional Repository
collection Online Access
description © 2018 Elsevier Ltd Detecting the presence of workers, plant, equipment, and materials (i.e. objects) on sites to improve safety and productivity has formed an integral part of computer vision-based research in construction. Such research has tended to focus on the use of computer vision and pattern recognition approaches that are overly reliant on the manual extraction of features and small datasets ( < 10k images/label), which can limit inter and intra-class variability. As a result, this hinders their ability to accurately detect objects on construction sites and generalization to different datasets. To address this limitation, an Improved Faster Regions with Convolutional Neural Network Features (IFaster R-CNN) approach is used to automatically detect the presence of objects in real-time is developed, which comprises: (1) the establishment dataset of workers and heavy equipment to train the CNN; (2) extraction of feature maps from images using deep model; (3) extraction of a region proposal from feature maps; and (4) object recognition. To validate the model's ability to detect objects in real-time, a specific dataset is established to train the IFaster R-CNN models to detect workers and plant (e.g. excavator). The results reveal that the IFaster R-CNN is able to detect the presence of workers and excavators at a high level of accuracy (91% and 95%). The accuracy of the proposed deep learning method exceeds that of current state-of-the-art descriptor methods in detecting target objects on images.
first_indexed 2025-11-14T10:40:05Z
format Journal Article
id curtin-20.500.11937-69099
institution Curtin University Malaysia
institution_category Local University
last_indexed 2025-11-14T10:40:05Z
publishDate 2018
publisher Pergamon Press
recordtype eprints
repository_type Digital Repository
spelling curtin-20.500.11937-690992018-06-29T12:35:59Z Automated detection of workers and heavy equipment on construction sites: A convolutional neural network approach Fang, W. Ding, L. Zhong, B. Love, Peter Luo, H. © 2018 Elsevier Ltd Detecting the presence of workers, plant, equipment, and materials (i.e. objects) on sites to improve safety and productivity has formed an integral part of computer vision-based research in construction. Such research has tended to focus on the use of computer vision and pattern recognition approaches that are overly reliant on the manual extraction of features and small datasets ( < 10k images/label), which can limit inter and intra-class variability. As a result, this hinders their ability to accurately detect objects on construction sites and generalization to different datasets. To address this limitation, an Improved Faster Regions with Convolutional Neural Network Features (IFaster R-CNN) approach is used to automatically detect the presence of objects in real-time is developed, which comprises: (1) the establishment dataset of workers and heavy equipment to train the CNN; (2) extraction of feature maps from images using deep model; (3) extraction of a region proposal from feature maps; and (4) object recognition. To validate the model's ability to detect objects in real-time, a specific dataset is established to train the IFaster R-CNN models to detect workers and plant (e.g. excavator). The results reveal that the IFaster R-CNN is able to detect the presence of workers and excavators at a high level of accuracy (91% and 95%). The accuracy of the proposed deep learning method exceeds that of current state-of-the-art descriptor methods in detecting target objects on images. 2018 Journal Article http://hdl.handle.net/20.500.11937/69099 10.1016/j.aei.2018.05.003 Pergamon Press restricted
spellingShingle Fang, W.
Ding, L.
Zhong, B.
Love, Peter
Luo, H.
Automated detection of workers and heavy equipment on construction sites: A convolutional neural network approach
title Automated detection of workers and heavy equipment on construction sites: A convolutional neural network approach
title_full Automated detection of workers and heavy equipment on construction sites: A convolutional neural network approach
title_fullStr Automated detection of workers and heavy equipment on construction sites: A convolutional neural network approach
title_full_unstemmed Automated detection of workers and heavy equipment on construction sites: A convolutional neural network approach
title_short Automated detection of workers and heavy equipment on construction sites: A convolutional neural network approach
title_sort automated detection of workers and heavy equipment on construction sites: a convolutional neural network approach
url http://hdl.handle.net/20.500.11937/69099