An interactive web-based toolset for knowledge discovery from short text log data

© Springer International Publishing AG 2017. Many companies maintain human-written logs to capture data on events such as workplace incidents and equipment failures. However, the sheer volume and unstructured nature of this data prevent it from being utilised for knowledge acquisition. Our web-based...

Full description

Bibliographic Details
Main Authors: Stewart, M., Liu, W., Cardell-Oliver, R., Griffin, Mark
Format: Conference Paper
Published: Springer 2017
Online Access:http://hdl.handle.net/20.500.11937/68738
_version_ 1848761878039232512
author Stewart, M.
Liu, W.
Cardell-Oliver, R.
Griffin, Mark
author_facet Stewart, M.
Liu, W.
Cardell-Oliver, R.
Griffin, Mark
author_sort Stewart, M.
building Curtin Institutional Repository
collection Online Access
description © Springer International Publishing AG 2017. Many companies maintain human-written logs to capture data on events such as workplace incidents and equipment failures. However, the sheer volume and unstructured nature of this data prevent it from being utilised for knowledge acquisition. Our web-based prototype software system provides a cohesive computational methodology for analysing and visualising log data that requires minimal human involvement. It features an interface to support customisable, modularised log data processing and knowledge discovery. This enables owners of event-based datasets containing short textual descriptions, such as occupational health & safety officers and machine operators, to identify latent knowledge not previously acquirable without significant time and effort. The software system comprises five distinct stages, corresponding to standard data mining milestones: exploratory analysis, data warehousing, association rule mining, entity clustering, and predictive analysis. To the best of our knowledge, it is the first dedicated system to computationally analyse short text log data and provides a powerful interface that visualises the analytical results and supports human interaction.
first_indexed 2025-11-14T10:38:40Z
format Conference Paper
id curtin-20.500.11937-68738
institution Curtin University Malaysia
institution_category Local University
last_indexed 2025-11-14T10:38:40Z
publishDate 2017
publisher Springer
recordtype eprints
repository_type Digital Repository
spelling curtin-20.500.11937-687382018-06-29T12:35:26Z An interactive web-based toolset for knowledge discovery from short text log data Stewart, M. Liu, W. Cardell-Oliver, R. Griffin, Mark © Springer International Publishing AG 2017. Many companies maintain human-written logs to capture data on events such as workplace incidents and equipment failures. However, the sheer volume and unstructured nature of this data prevent it from being utilised for knowledge acquisition. Our web-based prototype software system provides a cohesive computational methodology for analysing and visualising log data that requires minimal human involvement. It features an interface to support customisable, modularised log data processing and knowledge discovery. This enables owners of event-based datasets containing short textual descriptions, such as occupational health & safety officers and machine operators, to identify latent knowledge not previously acquirable without significant time and effort. The software system comprises five distinct stages, corresponding to standard data mining milestones: exploratory analysis, data warehousing, association rule mining, entity clustering, and predictive analysis. To the best of our knowledge, it is the first dedicated system to computationally analyse short text log data and provides a powerful interface that visualises the analytical results and supports human interaction. 2017 Conference Paper http://hdl.handle.net/20.500.11937/68738 10.1007/978-3-319-69179-4_61 Springer restricted
spellingShingle Stewart, M.
Liu, W.
Cardell-Oliver, R.
Griffin, Mark
An interactive web-based toolset for knowledge discovery from short text log data
title An interactive web-based toolset for knowledge discovery from short text log data
title_full An interactive web-based toolset for knowledge discovery from short text log data
title_fullStr An interactive web-based toolset for knowledge discovery from short text log data
title_full_unstemmed An interactive web-based toolset for knowledge discovery from short text log data
title_short An interactive web-based toolset for knowledge discovery from short text log data
title_sort interactive web-based toolset for knowledge discovery from short text log data
url http://hdl.handle.net/20.500.11937/68738