Evaluating intelligibility in human translation and machine translation
Research in automated translation mostly aims to develop translation systems to further enhance the transfer of knowledge and information. This need of transfer has brought machine translation (MT) to show major steps in translation software development and encourages further research in various M...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Penerbit Universiti Kebangsaan Malaysia
2017
|
| Online Access: | http://journalarticle.ukm.my/12869/ http://journalarticle.ukm.my/12869/1/22088-65611-2-PB.pdf |
| _version_ | 1848813118968299520 |
|---|---|
| author | Norwati Md Yusof, Saadiyah Darus, Mohd Juzaiddin Ab Aziz, |
| author_facet | Norwati Md Yusof, Saadiyah Darus, Mohd Juzaiddin Ab Aziz, |
| author_sort | Norwati Md Yusof, |
| building | UKM Institutional Repository |
| collection | Online Access |
| description | Research in automated translation mostly aims to develop translation systems to further enhance the transfer of
knowledge and information. This need of transfer has brought machine translation (MT) to show major steps in
translation software development and encourages further research in various MT related areas. However, there
have been no focused investigations of criteria for evaluation particularly evaluation that considers human
evaluators and the reconciliation of human translation (HT) and MT. Thus, focusing on two attributes for
evaluation, namely Accuracy and Intelligibility, a study was conducted to investigate translation evaluation
criteria for content and language transfer through reconciliation of HT and MT evaluation based on human
evaluators’ perception. The study focused on human evaluators’ expectation of range of criteria for HT and MT
under the two attributes and the evaluation was tested on a machine system to observe the system’s performance
in terms of Accuracy and Intelligibility. This paper reports the range of criteria to evaluate translation in terms
of Intelligibility as expected by human evaluators in HT and MT in terms of content and language transfer. The
study uses a mixed method approach with soft data and hard data collection. The results demonstrate that the
range of each criteria identified for content evaluation in HT is expected to be higher than in MT. The
implications of the study are described to provide an understanding of evaluation for human and automated
translation in terms of Intelligibility. |
| first_indexed | 2025-11-15T00:13:07Z |
| format | Article |
| id | oai:generic.eprints.org:12869 |
| institution | Universiti Kebangasaan Malaysia |
| institution_category | Local University |
| language | English |
| last_indexed | 2025-11-15T00:13:07Z |
| publishDate | 2017 |
| publisher | Penerbit Universiti Kebangsaan Malaysia |
| recordtype | eprints |
| repository_type | Digital Repository |
| spelling | oai:generic.eprints.org:128692019-05-06T21:42:29Z http://journalarticle.ukm.my/12869/ Evaluating intelligibility in human translation and machine translation Norwati Md Yusof, Saadiyah Darus, Mohd Juzaiddin Ab Aziz, Research in automated translation mostly aims to develop translation systems to further enhance the transfer of knowledge and information. This need of transfer has brought machine translation (MT) to show major steps in translation software development and encourages further research in various MT related areas. However, there have been no focused investigations of criteria for evaluation particularly evaluation that considers human evaluators and the reconciliation of human translation (HT) and MT. Thus, focusing on two attributes for evaluation, namely Accuracy and Intelligibility, a study was conducted to investigate translation evaluation criteria for content and language transfer through reconciliation of HT and MT evaluation based on human evaluators’ perception. The study focused on human evaluators’ expectation of range of criteria for HT and MT under the two attributes and the evaluation was tested on a machine system to observe the system’s performance in terms of Accuracy and Intelligibility. This paper reports the range of criteria to evaluate translation in terms of Intelligibility as expected by human evaluators in HT and MT in terms of content and language transfer. The study uses a mixed method approach with soft data and hard data collection. The results demonstrate that the range of each criteria identified for content evaluation in HT is expected to be higher than in MT. The implications of the study are described to provide an understanding of evaluation for human and automated translation in terms of Intelligibility. Penerbit Universiti Kebangsaan Malaysia 2017 Article PeerReviewed application/pdf en http://journalarticle.ukm.my/12869/1/22088-65611-2-PB.pdf Norwati Md Yusof, and Saadiyah Darus, and Mohd Juzaiddin Ab Aziz, (2017) Evaluating intelligibility in human translation and machine translation. 3L; Language,Linguistics and Literature,The Southeast Asian Journal of English Language Studies., 23 (4). pp. 251-264. ISSN 0128-5157 http://ejournal.ukm.my/3l/issue/view/1059 |
| spellingShingle | Norwati Md Yusof, Saadiyah Darus, Mohd Juzaiddin Ab Aziz, Evaluating intelligibility in human translation and machine translation |
| title | Evaluating intelligibility in human translation and machine translation |
| title_full | Evaluating intelligibility in human translation and machine translation |
| title_fullStr | Evaluating intelligibility in human translation and machine translation |
| title_full_unstemmed | Evaluating intelligibility in human translation and machine translation |
| title_short | Evaluating intelligibility in human translation and machine translation |
| title_sort | evaluating intelligibility in human translation and machine translation |
| url | http://journalarticle.ukm.my/12869/ http://journalarticle.ukm.my/12869/ http://journalarticle.ukm.my/12869/1/22088-65611-2-PB.pdf |