Towards enhancing unsupervised anomaly detection by improving complexity, dimensionality and class-boundary properties

Any observation that follows a pattern other than the expected one, i.e., the normal behaviour, is considered abnormal behaviour (also known as an anomaly). Abnormal behaviour is witnessed in various areas— for instance, a previously unseen high temperature during winter in a naturally cold environm...

Full description

Bibliographic Details
Main Author: Babaei, Kasra
Format: Thesis (University of Nottingham only)
Language:English
Published: 2022
Subjects:
Online Access:https://eprints.nottingham.ac.uk/67116/
_version_ 1848800388489150464
author Babaei, Kasra
author_facet Babaei, Kasra
author_sort Babaei, Kasra
building Nottingham Research Data Repository
collection Online Access
description Any observation that follows a pattern other than the expected one, i.e., the normal behaviour, is considered abnormal behaviour (also known as an anomaly). Abnormal behaviour is witnessed in various areas— for instance, a previously unseen high temperature during winter in a naturally cold environment. Prior research shows that anomalies can result in negative impacts such as financial losses in telecommunications or human fatalities in aviation accidents. Despite the advances made in the area of anomaly detection, detection methods underperform due to the challenges that affect and hinder the process of anomaly detection. In this work, three novel anomaly detection approaches are introduced each, of which aims at addressing one problem that debilitates the performance of anomaly detection. One of the problems in anomaly detection is having access to an ample amount of anomalous examples; therefore, the proposed methods in this work are all unsupervised as this type of learning is needless of having access to a labelled training set. The first contribution of this research is focused on reducing the execution time of a density-based method while maintaining the performance at a high level by applying a novel pruning-based preprocessing step. In density-based methods, measuring the density plays an important role, and as the dimensionality increases, the definition of density becomes harder. By using dimensionality reduction methods, it is possible to transform the high-dimensional input data into a low-dimensional form while maintaining essential features. In the second contribution, a novel dimensionality reduction method is introduced that is needless of having access to an anomaly and noise-free training set. When using One-Class Classifier methods, the performance varies as the size of the training set changes. Having access to a training set that includes more normal examples can improve the performance as the class-boundary becomes less ambiguous. The final contribution of this work is focused on improving the definition of class-boundary by proposing a data augmentation approach. The proposed approach generates augmented examples while simultaneously reduces the dimensionality of the input data.
first_indexed 2025-11-14T20:50:46Z
format Thesis (University of Nottingham only)
id nottingham-67116
institution University of Nottingham Malaysia Campus
institution_category Local University
language English
last_indexed 2025-11-14T20:50:46Z
publishDate 2022
recordtype eprints
repository_type Digital Repository
spelling nottingham-671162022-02-27T04:40:11Z https://eprints.nottingham.ac.uk/67116/ Towards enhancing unsupervised anomaly detection by improving complexity, dimensionality and class-boundary properties Babaei, Kasra Any observation that follows a pattern other than the expected one, i.e., the normal behaviour, is considered abnormal behaviour (also known as an anomaly). Abnormal behaviour is witnessed in various areas— for instance, a previously unseen high temperature during winter in a naturally cold environment. Prior research shows that anomalies can result in negative impacts such as financial losses in telecommunications or human fatalities in aviation accidents. Despite the advances made in the area of anomaly detection, detection methods underperform due to the challenges that affect and hinder the process of anomaly detection. In this work, three novel anomaly detection approaches are introduced each, of which aims at addressing one problem that debilitates the performance of anomaly detection. One of the problems in anomaly detection is having access to an ample amount of anomalous examples; therefore, the proposed methods in this work are all unsupervised as this type of learning is needless of having access to a labelled training set. The first contribution of this research is focused on reducing the execution time of a density-based method while maintaining the performance at a high level by applying a novel pruning-based preprocessing step. In density-based methods, measuring the density plays an important role, and as the dimensionality increases, the definition of density becomes harder. By using dimensionality reduction methods, it is possible to transform the high-dimensional input data into a low-dimensional form while maintaining essential features. In the second contribution, a novel dimensionality reduction method is introduced that is needless of having access to an anomaly and noise-free training set. When using One-Class Classifier methods, the performance varies as the size of the training set changes. Having access to a training set that includes more normal examples can improve the performance as the class-boundary becomes less ambiguous. The final contribution of this work is focused on improving the definition of class-boundary by proposing a data augmentation approach. The proposed approach generates augmented examples while simultaneously reduces the dimensionality of the input data. 2022-02-27 Thesis (University of Nottingham only) NonPeerReviewed application/pdf en cc_by https://eprints.nottingham.ac.uk/67116/1/thesis.pdf Babaei, Kasra (2022) Towards enhancing unsupervised anomaly detection by improving complexity, dimensionality and class-boundary properties. PhD thesis, University of Nottingham. anomaly detection point anomalies contextual anomalies collective anomalies
spellingShingle anomaly detection
point anomalies
contextual anomalies
collective anomalies
Babaei, Kasra
Towards enhancing unsupervised anomaly detection by improving complexity, dimensionality and class-boundary properties
title Towards enhancing unsupervised anomaly detection by improving complexity, dimensionality and class-boundary properties
title_full Towards enhancing unsupervised anomaly detection by improving complexity, dimensionality and class-boundary properties
title_fullStr Towards enhancing unsupervised anomaly detection by improving complexity, dimensionality and class-boundary properties
title_full_unstemmed Towards enhancing unsupervised anomaly detection by improving complexity, dimensionality and class-boundary properties
title_short Towards enhancing unsupervised anomaly detection by improving complexity, dimensionality and class-boundary properties
title_sort towards enhancing unsupervised anomaly detection by improving complexity, dimensionality and class-boundary properties
topic anomaly detection
point anomalies
contextual anomalies
collective anomalies
url https://eprints.nottingham.ac.uk/67116/