Building BROOK: A multi-modal and facial video database for Human-Vehicle Interaction research

With the growing popularity of Autonomous Vehicles, more opportunities have bloomed in the context of Human-Vehicle Interactions. However, the lack of comprehensive and concrete database support for such specific use case limits relevant studies in the whole design spaces. In this paper, we present...

Full description

Bibliographic Details
Main Authors: Peng, Xiangjun, Huang, Zhentao, Sun, Xu
Format: Conference or Workshop Item
Language:English
Published: Unpublished 2020
Subjects:
Online Access:https://eprints.nottingham.ac.uk/60664/
_version_ 1848799791600893952
author Peng, Xiangjun
Huang, Zhentao
Sun, Xu
author_facet Peng, Xiangjun
Huang, Zhentao
Sun, Xu
author_sort Peng, Xiangjun
building Nottingham Research Data Repository
collection Online Access
description With the growing popularity of Autonomous Vehicles, more opportunities have bloomed in the context of Human-Vehicle Interactions. However, the lack of comprehensive and concrete database support for such specific use case limits relevant studies in the whole design spaces. In this paper, we present our work-in-progress BROOK, a public multi-modal database with facial video records, which could be used to characterise drivers' affective states and driving styles. We first explain how we over-engineer such database in details, and what we have gained through a ten-month study. Then we showcase a Neural Network-based predictor, leveraging BROOK, which supports multi-modal prediction (including physiological data of heart rate and skin conductance and driving status data of speed) through facial videos. Finally we discuss related issues when building such a database and our future directions in the context of BROOK. We believe BROOK is an essential building block for future Human-Vehicle Interaction Research. More details and updates about the project BROOK is online at https: //unnc-idl-ucc.github.io/BROOK/.
first_indexed 2025-11-14T20:41:17Z
format Conference or Workshop Item
id nottingham-60664
institution University of Nottingham Malaysia Campus
institution_category Local University
language English
last_indexed 2025-11-14T20:41:17Z
publishDate 2020
publisher Unpublished
recordtype eprints
repository_type Digital Repository
spelling nottingham-606642020-05-21T07:02:01Z https://eprints.nottingham.ac.uk/60664/ Building BROOK: A multi-modal and facial video database for Human-Vehicle Interaction research Peng, Xiangjun Huang, Zhentao Sun, Xu With the growing popularity of Autonomous Vehicles, more opportunities have bloomed in the context of Human-Vehicle Interactions. However, the lack of comprehensive and concrete database support for such specific use case limits relevant studies in the whole design spaces. In this paper, we present our work-in-progress BROOK, a public multi-modal database with facial video records, which could be used to characterise drivers' affective states and driving styles. We first explain how we over-engineer such database in details, and what we have gained through a ten-month study. Then we showcase a Neural Network-based predictor, leveraging BROOK, which supports multi-modal prediction (including physiological data of heart rate and skin conductance and driving status data of speed) through facial videos. Finally we discuss related issues when building such a database and our future directions in the context of BROOK. We believe BROOK is an essential building block for future Human-Vehicle Interaction Research. More details and updates about the project BROOK is online at https: //unnc-idl-ucc.github.io/BROOK/. Unpublished 2020-01-01 Conference or Workshop Item PeerReviewed application/pdf en cc_by https://eprints.nottingham.ac.uk/60664/1/Building%20BROOK%20A%20Multi-modal%20and%20Facial%20Video%20Database%20for%20Human-Vehicle%20Interaction%20Research.pdf Peng, Xiangjun, Huang, Zhentao and Sun, Xu (2020) Building BROOK: A multi-modal and facial video database for Human-Vehicle Interaction research. In: ACM CHI Conference on Human Factors in Computing Systems, 25-30 April 2020, Honolulu, HI, USA. (Unpublished) Human-VehicleInteractions; ComputerVision; Ergonomics
spellingShingle Human-VehicleInteractions; ComputerVision; Ergonomics
Peng, Xiangjun
Huang, Zhentao
Sun, Xu
Building BROOK: A multi-modal and facial video database for Human-Vehicle Interaction research
title Building BROOK: A multi-modal and facial video database for Human-Vehicle Interaction research
title_full Building BROOK: A multi-modal and facial video database for Human-Vehicle Interaction research
title_fullStr Building BROOK: A multi-modal and facial video database for Human-Vehicle Interaction research
title_full_unstemmed Building BROOK: A multi-modal and facial video database for Human-Vehicle Interaction research
title_short Building BROOK: A multi-modal and facial video database for Human-Vehicle Interaction research
title_sort building brook: a multi-modal and facial video database for human-vehicle interaction research
topic Human-VehicleInteractions; ComputerVision; Ergonomics
url https://eprints.nottingham.ac.uk/60664/