Bywood, L., Etchegoyhen, T., Georgakopoulou, P., Fishel, M., Jiang, J., Loenhout, G., Pozo, A., Turner, A., Volk, M. and Maucec, M. 2014. Machine translation for subtitling: a large-scale evaluation. LREC 2014, Ninth International Conference on Language Resources and Evaluation. Harpa Concert Hall and Conference Center, Reykjavik, Iceland 26 May 2014
| Title | Machine translation for subtitling: a large-scale evaluation |
|---|---|
| Authors | Bywood, L., Etchegoyhen, T., Georgakopoulou, P., Fishel, M., Jiang, J., Loenhout, G., Pozo, A., Turner, A., Volk, M. and Maucec, M. |
| Type | Conference paper |
| Abstract | This article describes a large-scale evaluation of the use of Statistical Machine Translation for professional subtitling. The work was carried out within the FP7 EU-funded project SUMAT and involved two rounds of evaluation: a quality evaluation and a measure of productivity gain/loss. We present the SMT systems built for the project and the corpora they were trained on, which combine professionally created and crowd-sourced data. Evaluation goals, methodology and results are presented for the eleven translation pairs that were evaluated by professional subtitlers. Overall, a majority of the machine translated subtitles received good quality ratings. The results were also positive in terms of productivity, with a global gain approaching 40%. We also evaluated the impact of applying quality estimation and filtering of poor MT output, which resulted in higher productivity gains for filtered files as opposed to fully machine-translated files. Finally, we present and discuss feedback from the subtitlers who participated in the evaluation, a key aspect for any eventual adoption of machine translation technology in professional subtitling |
| Keywords | statistical machine translation, user evaluation, subtitling |
| Year | 2014 |
| Conference | LREC 2014, Ninth International Conference on Language Resources and Evaluation |
| Publisher's version | License CC BY-SA 3.0 File Access Level Open (open metadata and files) |
| Publication dates | |
| Published | 26 May 2014 |
| Journal citation | pp. 46-53 |
| Book title | Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14) |
| Web address (URL) of conference proceedings | http://www.lrec-conf.org/proceedings/lrec2014/pdf/463_Paper.pdf |