Loading...
Thumbnail Image
Item

The Role of Corpus Pattern Analysis in Machine Translation Evaluation

Bechara, Hanna
Moze, Sara
El-Maarouf, Ismail
Orasan, Constantin
Hanks, Patrick
Mitkov, Ruslan
Alternative
Abstract
This paper takes a preliminary look at the relation between verb pattern matches in the Pattern Dictionary of English Verbs (PDEV) and translation quality through a qualitative analysis of human-ranked sentences from 5 different machine translation systems. The purpose of the analysis is not only to determine whether verbs in the automatic translations and their immediate contexts match any pre-existing semanto-syntactic pattern in PDEV, but also to establish links between hypothesis sentences and the verbs in the reference translation. It attempts to answer the question of whether or not the semantic and syntactic information captured by Corpus Pattern Analysis (CPA) can indicate whether a sentence is a “good” translation. Two human annotators manually identified the occurrence of patterns in 50 translations and indicated whether these patterns match any identified pattern in the corresponding reference translation. Results indicate that CPA can be used to distinguish between well and ill-formed sentences.
Citation
Hanna Béchara, Sara Može, Ismail El-Maarouf, Constantin Orăsan, Patrick Hanks, Ruslan Mitkov (2015) The Role of Corpus Pattern Analysis in Machine Translation Evaluation, Proceedings of the The 7th International Conference of the Iberian Association of Translation and Interpreting Studies (AIETI)
Publisher
Journal
Research Unit
DOI
PubMed ID
PubMed Central ID
Embedded videos
Type
Conference contribution
Language
en
Description
Series/Report no.
ISSN
EISSN
ISBN
9782970073659
ISMN
Gov't Doc #
Sponsors
Rights
Research Projects
Organizational Units
Journal Issue
Embedded videos