Novel multi-perspective usability evaluation framework for selection of open source software based on BWM and group VIKOR techniques
Increasing demand for open-source software (OSS) has raised the value of efficient selection in terms of quality; usability is an essential quality factor that significantly affects system acceptability and sustainability. Most large and complex software packages partitioned across multiple portals...
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Published: |
World Scientific Publishing
2021
|
| Online Access: | http://psasir.upm.edu.my/id/eprint/94378/ |
| _version_ | 1848861980779085824 |
|---|---|
| author | Dawood, Kareem A. Zaidan, A. A. Sharif, Khaironi Y. Ghani, Abdul A. Zulzalil, H. Zaidan, B. B. |
| author_facet | Dawood, Kareem A. Zaidan, A. A. Sharif, Khaironi Y. Ghani, Abdul A. Zulzalil, H. Zaidan, B. B. |
| author_sort | Dawood, Kareem A. |
| building | UPM Institutional Repository |
| collection | Online Access |
| description | Increasing demand for open-source software (OSS) has raised the value of efficient selection in terms of quality; usability is an essential quality factor that significantly affects system acceptability and sustainability. Most large and complex software packages partitioned across multiple portals and involve many users — each with their role in the software package; those users have different perspectives on the software package, defined by their knowledge, responsibilities, and commitments. Thus, a multi-perspective approach has been used in usability evaluation to overcome the challenge of inconsistency between users’ perspectives; the inconsistency challenge would lead to an ill-advised decision on the selection of a suitable OSS. This study aimed to assist the public and private organizations in evaluating and selecting the most suitable OSS. The evaluation of the OSS software packages to choose the best one is a challenging task owing to (a) multiple evaluation criteria, (b) criteria importance, and (c) data variation; thus, it is considered a sophisticated multi-criteria decision making (MCDM) problem; moreover, the multi-perspective usability evaluation framework for OSS selection lacks in the current literature. Hence, this study proposes a novel multi-perspective usability evaluation framework for the selection of OSS based on the multi-criteria analysis. Integration of best-worst method (BWM) and VIKOR MCDM techniques has been used for weighting and ranking OSS alternatives. BWM is utilized for weighting of evaluation criteria, whereas VIKOR is applied to rank OSS-LMS alternatives. Individual and group decision-making contexts, and the internal and external groups aggregation were used to demonstrate the efficiency of the proposed framework. A well-organized algorithmic procedure is presented in detail, and a case study was examined to illustrate the validity and feasibility of the proposed framework. The results demonstrated that BWM and VIKOR integration works effectively to solve the OSS software package benchmarking/selection problems. Furthermore, the ranks of OSS software packages obtained from the VIKOR internal and external group decision making were similar; the best OSS-LMS based on the two ways was ‘Moodle’ software package. Among the scores of groups in the objective validation, significant differences were identified; this indicated that the ranking results of internal and external VIKOR group decision making were valid, which pointed to the validation of the framework. |
| first_indexed | 2025-11-15T13:09:45Z |
| format | Article |
| id | upm-94378 |
| institution | Universiti Putra Malaysia |
| institution_category | Local University |
| last_indexed | 2025-11-15T13:09:45Z |
| publishDate | 2021 |
| publisher | World Scientific Publishing |
| recordtype | eprints |
| repository_type | Digital Repository |
| spelling | upm-943782023-04-04T06:42:05Z http://psasir.upm.edu.my/id/eprint/94378/ Novel multi-perspective usability evaluation framework for selection of open source software based on BWM and group VIKOR techniques Dawood, Kareem A. Zaidan, A. A. Sharif, Khaironi Y. Ghani, Abdul A. Zulzalil, H. Zaidan, B. B. Increasing demand for open-source software (OSS) has raised the value of efficient selection in terms of quality; usability is an essential quality factor that significantly affects system acceptability and sustainability. Most large and complex software packages partitioned across multiple portals and involve many users — each with their role in the software package; those users have different perspectives on the software package, defined by their knowledge, responsibilities, and commitments. Thus, a multi-perspective approach has been used in usability evaluation to overcome the challenge of inconsistency between users’ perspectives; the inconsistency challenge would lead to an ill-advised decision on the selection of a suitable OSS. This study aimed to assist the public and private organizations in evaluating and selecting the most suitable OSS. The evaluation of the OSS software packages to choose the best one is a challenging task owing to (a) multiple evaluation criteria, (b) criteria importance, and (c) data variation; thus, it is considered a sophisticated multi-criteria decision making (MCDM) problem; moreover, the multi-perspective usability evaluation framework for OSS selection lacks in the current literature. Hence, this study proposes a novel multi-perspective usability evaluation framework for the selection of OSS based on the multi-criteria analysis. Integration of best-worst method (BWM) and VIKOR MCDM techniques has been used for weighting and ranking OSS alternatives. BWM is utilized for weighting of evaluation criteria, whereas VIKOR is applied to rank OSS-LMS alternatives. Individual and group decision-making contexts, and the internal and external groups aggregation were used to demonstrate the efficiency of the proposed framework. A well-organized algorithmic procedure is presented in detail, and a case study was examined to illustrate the validity and feasibility of the proposed framework. The results demonstrated that BWM and VIKOR integration works effectively to solve the OSS software package benchmarking/selection problems. Furthermore, the ranks of OSS software packages obtained from the VIKOR internal and external group decision making were similar; the best OSS-LMS based on the two ways was ‘Moodle’ software package. Among the scores of groups in the objective validation, significant differences were identified; this indicated that the ranking results of internal and external VIKOR group decision making were valid, which pointed to the validation of the framework. World Scientific Publishing 2021-03-22 Article PeerReviewed Dawood, Kareem A. and Zaidan, A. A. and Sharif, Khaironi Y. and Ghani, Abdul A. and Zulzalil, H. and Zaidan, B. B. (2021) Novel multi-perspective usability evaluation framework for selection of open source software based on BWM and group VIKOR techniques. International Journal of Information Technology & Decision Making, 22 (1). pp. 187-277. ISSN 0219-6220; ESSN: 1793-6845 https://www.worldscientific.com/doi/epdf/10.1142/S0219622021500139 10.1142/S0219622021500139 |
| spellingShingle | Dawood, Kareem A. Zaidan, A. A. Sharif, Khaironi Y. Ghani, Abdul A. Zulzalil, H. Zaidan, B. B. Novel multi-perspective usability evaluation framework for selection of open source software based on BWM and group VIKOR techniques |
| title | Novel multi-perspective usability evaluation framework for selection of open source software based on BWM and group VIKOR techniques |
| title_full | Novel multi-perspective usability evaluation framework for selection of open source software based on BWM and group VIKOR techniques |
| title_fullStr | Novel multi-perspective usability evaluation framework for selection of open source software based on BWM and group VIKOR techniques |
| title_full_unstemmed | Novel multi-perspective usability evaluation framework for selection of open source software based on BWM and group VIKOR techniques |
| title_short | Novel multi-perspective usability evaluation framework for selection of open source software based on BWM and group VIKOR techniques |
| title_sort | novel multi-perspective usability evaluation framework for selection of open source software based on bwm and group vikor techniques |
| url | http://psasir.upm.edu.my/id/eprint/94378/ http://psasir.upm.edu.my/id/eprint/94378/ http://psasir.upm.edu.my/id/eprint/94378/ |