Average rating
Cast your vote
You can rate an item by clicking the amount of stars they wish to award to this item.
When enough users have cast their vote on this item, the average rating will also be shown.
Star rating
Your vote was cast
Thank you for your feedback
Thank you for your feedback
Authors
Sun, ShuoFomicheva, Marina
Blain, Frederic
Chaudhary, Vishrav
El-Kishky, Ahmed
Renduchintala, Adithya
Guzman, Francisco
Specia, Lucia
Issue Date
2020-12-31
Metadata
Show full item recordAbstract
Predicting the quality of machine translation has traditionally been addressed with language-specific models, under the assumption that the quality label distribution or linguistic features exhibit traits that are not shared across languages. An obvious disadvantage of this approach is the need for labelled data for each given language pair. We challenge this assumption by exploring different approaches to multilingual Quality Estimation (QE), including using scores from translation models. We show that these outperform singlelanguage models, particularly in less balanced quality label distributions and low-resource settings. In the extreme case of zero-shot QE, we show that it is possible to accurately predict quality for any given new language from models trained on other languages. Our findings indicate that state-of-the-art neural QE models based on powerful pre-trained representations generalise well across languages, making them more applicable in real-world settings.Citation
Sun, S., Fomicheva, M., Blain, F., Chaudhary, V., El-Kishky, A., Renduchintala, A., Guzman, F. and Specia, L. (2020) An exploratory study on multilingual quality estimation, 1st Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 10th International Joint Conference on Natural Language Processing, 4th-7th December, 2020. https://www.aclweb.org/anthology/2020.aacl-main.39Additional Links
https://www.aclweb.org/anthology/2020.aacl-main.39Type
Conference contributionLanguage
enDescription
This is an accepted manuscript of an article published by ACL, available online at: https://www.aclweb.org/anthology/2020.aacl-main.39 The accepted version of the publication may differ from the final published version.
Except where otherwise noted, this item's license is described as https://creativecommons.org/licenses/by-nc-nd/4.0/