Loading...
Questing for Quality Estimation A User Study
Escartin, Carla Parra Béchara, Hanna Orăsan, Constantin
Escartin, Carla Parra
Béchara, Hanna
Orăsan, Constantin
Editors
Other contributors
Affiliation
Epub Date
Issue Date
2017-06-06
Submitted date
Alternative
Abstract
Post-Editing of Machine Translation (MT) has become a reality in professional translation workflows. In order to optimize the management of projects that use post-editing and avoid underpayments and mistrust from professional translators, effective tools to assess the quality of Machine Translation (MT) systems need to be put in place. One field of study that could address this problem is Machine Translation Quality Estimation (MTQE), which aims to determine the quality of MT without an existing reference. Accurate and reliable MTQE can help project managers and translators alike, as it would allow estimating more precisely the cost of post-editing projects in terms of time and adequate fares by discarding those segments that are not worth post-editing (PE) and have to be translated from scratch. In this paper, we report on the results of an impact study which engages professional translators in PE tasks using MTQE. We measured translators? productivity in different scenarios: translating from scratch, post-editing without using MTQE, and post-editing using MTQE. Our results show that QE information, when accurate, improves post-editing efficiency.
Citation
Carla Parra Escartín, Hanna Béchara, Constantin Orăsan. Questing for Quality Estimation A User Study.
The Prague Bulletin of Mathematical Linguistics, 108(1), pp. 343–354. doi: 10.1515/pralin-2017-0032.
Publisher
Research Unit
PubMed ID
PubMed Central ID
Embedded videos
Type
Journal article
Language
en
Description
Series/Report no.
ISSN
1804-0462
EISSN
ISBN
ISMN
Gov't Doc #
Sponsors
EC