Balancing Exploitation And Exploration Search Behavior On Nature-Inspired Clustering Algorithms
Nature-inspired optimization-based clustering techniques are powerful, robust and more sophisticated than the conventional clustering methods due to their stochastic and heuristic characteristics. Unfortunately, these algorithms suffer with several drawbacks such as the tendency to be trapped or sta...
| Main Author: | |
|---|---|
| Format: | Thesis |
| Language: | English |
| Published: |
2018
|
| Subjects: | |
| Online Access: | http://eprints.usm.my/47436/ http://eprints.usm.my/47436/1/Balancing%20Exploitation%20And%20Exploration%20Search%20Behavior%20On%20Nature-Inspired%20Clustering%20Algorithms.pdf |
| _version_ | 1848880874953637888 |
|---|---|
| author | Alswaitti, Mohammed Y. T. |
| author_facet | Alswaitti, Mohammed Y. T. |
| author_sort | Alswaitti, Mohammed Y. T. |
| building | USM Institutional Repository |
| collection | Online Access |
| description | Nature-inspired optimization-based clustering techniques are powerful, robust and more sophisticated than the conventional clustering methods due to their stochastic and heuristic characteristics. Unfortunately, these algorithms suffer with several drawbacks such as the tendency to be trapped or stagnate into local optima and slow convergence rates. The latter drawbacks are consequences of the difficulty in balancing the exploration and exploitation processes which directly affect the final quality of the clustering solutions. Hence, this research has proposed three enhanced frameworks, namely, Optimized Gravitational-based (OGC), Density-Based Particle Swarm Optimization (DPSO), and Variance-based Differential Evolution with an Optional Crossover (VDEO) frameworks for data clustering. In the OGC framework, the exhibited explorative search behavior of the Gravitational Clustering (GC) algorithm has been addressed by (i) eliminating the agent velocity accumulation, and (ii) integrating an initialization method of agents using variance and median to subrogate the exploration process. Moreover, the balance between the exploration and exploitation processes in the DPSO framework is considered using a combination of (i) a kernel density estimation technique associated with new bandwidth estimation method and (ii) estimated multi-dimensional gravitational learning coefficients. Lastly, (i) a single-based solution representation, (ii) a switchable mutation scheme, (iii) a vector-based estimation of the mutation factor, and (iv) an optional crossover strategy are proposed in the VDEO framework. The overall performances of the three proposed frameworks have been compared with several current state-of-the-art clustering algorithms on 15 benchmark datasets from the UCI repository. The experimental results are also thoroughly evaluated and verified via non-parametric statistical analysis. Based on the obtained experimental results, the OGC, DPSO, and VDEO frameworks achieved an average enhancement up to 24.36%, 9.38%, and 11.98% of classification accuracy, respectively. All the frameworks also achieved the first rank by the Friedman aligned-ranks (FA) test in all evaluation metrics. Moreover, the three frameworks provided convergent performances in terms of the repeatability. Meanwhile, the OGC framework obtained a significant performance in terms of the classification accuracy, where the VDEO framework presented a significant performance in terms of cluster compactness. On the other hand, the DPSO framework favored the balanced state by producing very competitive results compared to the OGC and DPSO in both evaluation metrics. As a conclusion, balancing the search behavior notably enhanced the overall performance of the three proposed frameworks and made each of them an excellent tool for data clustering. |
| first_indexed | 2025-11-15T18:10:04Z |
| format | Thesis |
| id | usm-47436 |
| institution | Universiti Sains Malaysia |
| institution_category | Local University |
| language | English |
| last_indexed | 2025-11-15T18:10:04Z |
| publishDate | 2018 |
| recordtype | eprints |
| repository_type | Digital Repository |
| spelling | usm-474362021-11-17T03:42:13Z http://eprints.usm.my/47436/ Balancing Exploitation And Exploration Search Behavior On Nature-Inspired Clustering Algorithms Alswaitti, Mohammed Y. T. T Technology TK1-9971 Electrical engineering. Electronics. Nuclear engineering Nature-inspired optimization-based clustering techniques are powerful, robust and more sophisticated than the conventional clustering methods due to their stochastic and heuristic characteristics. Unfortunately, these algorithms suffer with several drawbacks such as the tendency to be trapped or stagnate into local optima and slow convergence rates. The latter drawbacks are consequences of the difficulty in balancing the exploration and exploitation processes which directly affect the final quality of the clustering solutions. Hence, this research has proposed three enhanced frameworks, namely, Optimized Gravitational-based (OGC), Density-Based Particle Swarm Optimization (DPSO), and Variance-based Differential Evolution with an Optional Crossover (VDEO) frameworks for data clustering. In the OGC framework, the exhibited explorative search behavior of the Gravitational Clustering (GC) algorithm has been addressed by (i) eliminating the agent velocity accumulation, and (ii) integrating an initialization method of agents using variance and median to subrogate the exploration process. Moreover, the balance between the exploration and exploitation processes in the DPSO framework is considered using a combination of (i) a kernel density estimation technique associated with new bandwidth estimation method and (ii) estimated multi-dimensional gravitational learning coefficients. Lastly, (i) a single-based solution representation, (ii) a switchable mutation scheme, (iii) a vector-based estimation of the mutation factor, and (iv) an optional crossover strategy are proposed in the VDEO framework. The overall performances of the three proposed frameworks have been compared with several current state-of-the-art clustering algorithms on 15 benchmark datasets from the UCI repository. The experimental results are also thoroughly evaluated and verified via non-parametric statistical analysis. Based on the obtained experimental results, the OGC, DPSO, and VDEO frameworks achieved an average enhancement up to 24.36%, 9.38%, and 11.98% of classification accuracy, respectively. All the frameworks also achieved the first rank by the Friedman aligned-ranks (FA) test in all evaluation metrics. Moreover, the three frameworks provided convergent performances in terms of the repeatability. Meanwhile, the OGC framework obtained a significant performance in terms of the classification accuracy, where the VDEO framework presented a significant performance in terms of cluster compactness. On the other hand, the DPSO framework favored the balanced state by producing very competitive results compared to the OGC and DPSO in both evaluation metrics. As a conclusion, balancing the search behavior notably enhanced the overall performance of the three proposed frameworks and made each of them an excellent tool for data clustering. 2018-08-01 Thesis NonPeerReviewed application/pdf en http://eprints.usm.my/47436/1/Balancing%20Exploitation%20And%20Exploration%20Search%20Behavior%20On%20Nature-Inspired%20Clustering%20Algorithms.pdf Alswaitti, Mohammed Y. T. (2018) Balancing Exploitation And Exploration Search Behavior On Nature-Inspired Clustering Algorithms. PhD thesis, Universiti Sains Malaysia. |
| spellingShingle | T Technology TK1-9971 Electrical engineering. Electronics. Nuclear engineering Alswaitti, Mohammed Y. T. Balancing Exploitation And Exploration Search Behavior On Nature-Inspired Clustering Algorithms |
| title | Balancing Exploitation And Exploration Search Behavior On Nature-Inspired Clustering Algorithms |
| title_full | Balancing Exploitation And Exploration Search Behavior On Nature-Inspired Clustering Algorithms |
| title_fullStr | Balancing Exploitation And Exploration Search Behavior On Nature-Inspired Clustering Algorithms |
| title_full_unstemmed | Balancing Exploitation And Exploration Search Behavior On Nature-Inspired Clustering Algorithms |
| title_short | Balancing Exploitation And Exploration Search Behavior On Nature-Inspired Clustering Algorithms |
| title_sort | balancing exploitation and exploration search behavior on nature-inspired clustering algorithms |
| topic | T Technology TK1-9971 Electrical engineering. Electronics. Nuclear engineering |
| url | http://eprints.usm.my/47436/ http://eprints.usm.my/47436/1/Balancing%20Exploitation%20And%20Exploration%20Search%20Behavior%20On%20Nature-Inspired%20Clustering%20Algorithms.pdf |