Intrusion detection models using enhanced denoising autoencoders and lightgbm classifier with improved detection performance
An intrusion detection system (IDS) is a software developed to monitor network traffic for suspicious activities to secure data transmission. The conventional IDS strategies are vulnerable to distorted high dimensional network traffic. To overcome this, we proposed an IDS that combines a denoising a...
| Main Author: | |
|---|---|
| Format: | Final Year Project / Dissertation / Thesis |
| Published: |
2023
|
| Subjects: | |
| Online Access: | http://eprints.utar.edu.my/6233/ http://eprints.utar.edu.my/6233/1/SHEIKH_ABDUL_HAMEED.pdf |
| _version_ | 1848886623235735552 |
|---|---|
| author | Sheikh, Abdul Hameed |
| author_facet | Sheikh, Abdul Hameed |
| author_sort | Sheikh, Abdul Hameed |
| building | UTAR Institutional Repository |
| collection | Online Access |
| description | An intrusion detection system (IDS) is a software developed to monitor network traffic for suspicious activities to secure data transmission. The conventional IDS strategies are vulnerable to distorted high dimensional network traffic. To overcome this, we proposed an IDS that combines a denoising autoencoder (DAE) and LightGBM classifier. The DAE aims to reduce the distortions in the network traffic by extracting the compressed hidden features representation. The LightGBM classifier aims to classify the samples using the histogram bins of the extracted features with larger gradients, which possibly boost the predictive capacity of
the model. To eliminate the deviations in the latent structure, the DAE is enhanced. They are 1. DAE with Jacobian Gradient Norm, which minimizes the larger partial derivatives of the encoder activation 2. DAE with Iterating Thresholding Function, which minimizes the larger magnitude values of the encoder activation weight 3. DAE with Data Pairwise Similarity Weight, which groups the similar data points with strong similarity weight in the encoder
activation clusters 4. DAE with Approximated Standard Normal Distribution, which approximates the latent structure to the standard normal distribution using inference strategy.
To evaluate the effectiveness of the proposed models, they are experimented using various benchmark datasets. Notice that our proposed models achieve higher detection rate, which outperform the existing IDS models against all the eight commonly used datasets.
|
| first_indexed | 2025-11-15T19:41:26Z |
| format | Final Year Project / Dissertation / Thesis |
| id | utar-6233 |
| institution | Universiti Tunku Abdul Rahman |
| institution_category | Local University |
| last_indexed | 2025-11-15T19:41:26Z |
| publishDate | 2023 |
| recordtype | eprints |
| repository_type | Digital Repository |
| spelling | utar-62332024-03-11T13:55:11Z Intrusion detection models using enhanced denoising autoencoders and lightgbm classifier with improved detection performance Sheikh, Abdul Hameed TA Engineering (General). Civil engineering (General) TK Electrical engineering. Electronics Nuclear engineering An intrusion detection system (IDS) is a software developed to monitor network traffic for suspicious activities to secure data transmission. The conventional IDS strategies are vulnerable to distorted high dimensional network traffic. To overcome this, we proposed an IDS that combines a denoising autoencoder (DAE) and LightGBM classifier. The DAE aims to reduce the distortions in the network traffic by extracting the compressed hidden features representation. The LightGBM classifier aims to classify the samples using the histogram bins of the extracted features with larger gradients, which possibly boost the predictive capacity of the model. To eliminate the deviations in the latent structure, the DAE is enhanced. They are 1. DAE with Jacobian Gradient Norm, which minimizes the larger partial derivatives of the encoder activation 2. DAE with Iterating Thresholding Function, which minimizes the larger magnitude values of the encoder activation weight 3. DAE with Data Pairwise Similarity Weight, which groups the similar data points with strong similarity weight in the encoder activation clusters 4. DAE with Approximated Standard Normal Distribution, which approximates the latent structure to the standard normal distribution using inference strategy. To evaluate the effectiveness of the proposed models, they are experimented using various benchmark datasets. Notice that our proposed models achieve higher detection rate, which outperform the existing IDS models against all the eight commonly used datasets. 2023 Final Year Project / Dissertation / Thesis NonPeerReviewed application/pdf http://eprints.utar.edu.my/6233/1/SHEIKH_ABDUL_HAMEED.pdf Sheikh, Abdul Hameed (2023) Intrusion detection models using enhanced denoising autoencoders and lightgbm classifier with improved detection performance. PhD thesis, UTAR. http://eprints.utar.edu.my/6233/ |
| spellingShingle | TA Engineering (General). Civil engineering (General) TK Electrical engineering. Electronics Nuclear engineering Sheikh, Abdul Hameed Intrusion detection models using enhanced denoising autoencoders and lightgbm classifier with improved detection performance |
| title | Intrusion detection models using enhanced denoising autoencoders and lightgbm classifier with improved detection performance |
| title_full | Intrusion detection models using enhanced denoising autoencoders and lightgbm classifier with improved detection performance |
| title_fullStr | Intrusion detection models using enhanced denoising autoencoders and lightgbm classifier with improved detection performance |
| title_full_unstemmed | Intrusion detection models using enhanced denoising autoencoders and lightgbm classifier with improved detection performance |
| title_short | Intrusion detection models using enhanced denoising autoencoders and lightgbm classifier with improved detection performance |
| title_sort | intrusion detection models using enhanced denoising autoencoders and lightgbm classifier with improved detection performance |
| topic | TA Engineering (General). Civil engineering (General) TK Electrical engineering. Electronics Nuclear engineering |
| url | http://eprints.utar.edu.my/6233/ http://eprints.utar.edu.my/6233/1/SHEIKH_ABDUL_HAMEED.pdf |