NCI evalution: assessment of higher order thinking skills via short free text answer
NCI a hybrid approach of Natural Language Processing (NLP), Convolutional Neural Network (CNN) and Information Theory are applied to assess higher order thinking skills via short free text answer. Data of students' examination scripts are collected from 3 domains namely Information Technology,...
| Main Authors: | , , |
|---|---|
| Format: | Proceeding Paper |
| Language: | English English English |
| Published: |
IEEE
2020
|
| Subjects: | |
| Online Access: | http://irep.iium.edu.my/80429/ http://irep.iium.edu.my/80429/1/80429%20NCI%20Evalution.pdf http://irep.iium.edu.my/80429/2/80429%20NCI%20Evalution%20SCOPUS.pdf http://irep.iium.edu.my/80429/13/NCI%20evalution_assessment%20of%20higher%20order%20thinking%20skills%20via%20short%20free%20text%20answer.pdf |
| _version_ | 1848788955727659008 |
|---|---|
| author | Lajis, Adidah Nasir, Haidawati Abdul Aziz, Normaziah |
| author_facet | Lajis, Adidah Nasir, Haidawati Abdul Aziz, Normaziah |
| author_sort | Lajis, Adidah |
| building | IIUM Repository |
| collection | Online Access |
| description | NCI a hybrid approach of Natural Language Processing (NLP), Convolutional Neural Network (CNN) and Information Theory are applied to assess higher order thinking skills via short free text answer. Data of students' examination scripts are collected from 3 domains namely Information Technology, Engineering and Management with a total of 479 answer scripts. All data are of tertiary level examinations. These answer text are firstly, processed by applying NLP. Next, the pattern of known-information is generated by applying CNN-seq concept and finally based on the pattern the amount of known-information is computed by applying information theory approach. Result shows that the proposed techniques achieved an excellent achievement of 0.89 and above for all domains and all level of higher order thinking skills. LSA based testing achieved from 0.47 to 0.83 agreement. This result supports that the proposed hybrid technique can improve automated short free text assessment in a given scope of domain and competency level. |
| first_indexed | 2025-11-14T17:49:03Z |
| format | Proceeding Paper |
| id | iium-80429 |
| institution | International Islamic University Malaysia |
| institution_category | Local University |
| language | English English English |
| last_indexed | 2025-11-14T17:49:03Z |
| publishDate | 2020 |
| publisher | IEEE |
| recordtype | eprints |
| repository_type | Digital Repository |
| spelling | iium-804292021-01-27T23:48:35Z http://irep.iium.edu.my/80429/ NCI evalution: assessment of higher order thinking skills via short free text answer Lajis, Adidah Nasir, Haidawati Abdul Aziz, Normaziah T Technology (General) NCI a hybrid approach of Natural Language Processing (NLP), Convolutional Neural Network (CNN) and Information Theory are applied to assess higher order thinking skills via short free text answer. Data of students' examination scripts are collected from 3 domains namely Information Technology, Engineering and Management with a total of 479 answer scripts. All data are of tertiary level examinations. These answer text are firstly, processed by applying NLP. Next, the pattern of known-information is generated by applying CNN-seq concept and finally based on the pattern the amount of known-information is computed by applying information theory approach. Result shows that the proposed techniques achieved an excellent achievement of 0.89 and above for all domains and all level of higher order thinking skills. LSA based testing achieved from 0.47 to 0.83 agreement. This result supports that the proposed hybrid technique can improve automated short free text assessment in a given scope of domain and competency level. IEEE 2020-04-06 Proceeding Paper PeerReviewed application/pdf en http://irep.iium.edu.my/80429/1/80429%20NCI%20Evalution.pdf application/pdf en http://irep.iium.edu.my/80429/2/80429%20NCI%20Evalution%20SCOPUS.pdf application/pdf en http://irep.iium.edu.my/80429/13/NCI%20evalution_assessment%20of%20higher%20order%20thinking%20skills%20via%20short%20free%20text%20answer.pdf Lajis, Adidah and Nasir, Haidawati and Abdul Aziz, Normaziah (2020) NCI evalution: assessment of higher order thinking skills via short free text answer. In: 2019 IEEE 6th International Conference on Smart Instrumentation, Measurement and Applications (ICSIMA 2019), 27 - 29 Aug 2019, Kuala Lumpur, Malaysia. https://ieeexplore.ieee.org/document/9057335 10.1109/ICSIMA47653.2019.9057335 |
| spellingShingle | T Technology (General) Lajis, Adidah Nasir, Haidawati Abdul Aziz, Normaziah NCI evalution: assessment of higher order thinking skills via short free text answer |
| title | NCI evalution: assessment of higher order thinking skills via short free text answer |
| title_full | NCI evalution: assessment of higher order thinking skills via short free text answer |
| title_fullStr | NCI evalution: assessment of higher order thinking skills via short free text answer |
| title_full_unstemmed | NCI evalution: assessment of higher order thinking skills via short free text answer |
| title_short | NCI evalution: assessment of higher order thinking skills via short free text answer |
| title_sort | nci evalution: assessment of higher order thinking skills via short free text answer |
| topic | T Technology (General) |
| url | http://irep.iium.edu.my/80429/ http://irep.iium.edu.my/80429/ http://irep.iium.edu.my/80429/ http://irep.iium.edu.my/80429/1/80429%20NCI%20Evalution.pdf http://irep.iium.edu.my/80429/2/80429%20NCI%20Evalution%20SCOPUS.pdf http://irep.iium.edu.my/80429/13/NCI%20evalution_assessment%20of%20higher%20order%20thinking%20skills%20via%20short%20free%20text%20answer.pdf |