Machine translation for subtitling: a large-scale evaluation

Bywood, L., Etchegoyhen, T., Georgakopoulou, P., Fishel, M., Jiang, J., Loenhout, G., Pozo, A., Turner, A., Volk, M. and Maucec, M. 2014. Machine translation for subtitling: a large-scale evaluation. LREC 2014, Ninth International Conference on Language Resources and Evaluation. Harpa Concert Hall and Conference Center, Reykjavik, Iceland 26 May 2014

TitleMachine translation for subtitling: a large-scale evaluation
AuthorsBywood, L.
Etchegoyhen, T.
Georgakopoulou, P.
Fishel, M.
Jiang, J.
Loenhout, G.
Pozo, A.
Turner, A.
Volk, M.
Maucec, M.
TypeConference paper
Abstract

This article describes a large-scale evaluation of the use of Statistical Machine Translation for professional subtitling. The work was carried out within the FP7 EU-funded project SUMAT and involved two rounds of evaluation: a quality evaluation and a measure of productivity gain/loss. We present the SMT systems built for the project and the corpora they were trained on, which combine professionally created and crowd-sourced data. Evaluation goals, methodology and results are presented for the eleven translation pairs that were evaluated by professional subtitlers. Overall, a majority of the machine translated subtitles received good quality ratings. The results were also positive in terms of productivity, with a global gain approaching 40%. We also evaluated the impact of applying quality estimation and filtering of poor MT output, which resulted in higher productivity gains for filtered files as opposed to fully machine-translated files. Finally, we present and discuss feedback from the subtitlers who participated in the evaluation, a key aspect for any eventual adoption of machine translation technology in professional subtitling

Keywordsstatistical machine translation, user evaluation, subtitling
Year2014
ConferenceLREC 2014, Ninth International Conference on Language Resources and Evaluation
Web address (URL) of conference proceedingshttp://www.lrec-conf.org/proceedings/lrec2014/pdf/463_Paper.pdf

Related outputs

Post-Editing in Practice: Process, Product and Networks
Nunes Vieira, L., Alonso, E. and Bywood, L. 2019. Post-Editing in Practice: Process, Product and Networks. JoSTrans - The Journal of Specialised Translation. 31.

Testing the retranslation hypothesis for audiovisual translation: the films of Volker Schlöndorff subtitled into English
Bywood, L. 2019. Testing the retranslation hypothesis for audiovisual translation: the films of Volker Schlöndorff subtitled into English. Perspectives: Studies in Translatology. 27 (6), pp. 815-832. doi:10.1080/0907676X.2019.1593467

Embracing the threat: machine translation as a solution for subtitling
Bywood, L., Etchegoyhen, T. and Georgakopoulou, P. 2017. Embracing the threat: machine translation as a solution for subtitling . Perspectives: Studies in Translatology. 25 (3), pp. 492-508. doi:10.1080/0907676X.2017.1291695

Machine translation quality in an audiovisual context
Burchardt, A., Lommel, A., Bywood, L., Harris, K. and Popovic, M. 2016. Machine translation quality in an audiovisual context. Target. 28 (2), pp. 206-221. doi:10.1075/target.28.2.03bur

Book review: 'In translation: translators on their work and what it means' edited by Esther Allen and Susan Bernofsky (2013)
Bywood, L. 2014. Book review: 'In translation: translators on their work and what it means' edited by Esther Allen and Susan Bernofsky (2013). JoSTrans - The Journal of Specialised Translation. 21, pp. 206-208.

MT in subtitling and the rising profile of the post-editor
Georgakopoulou, P. and Bywood, L. 2014. MT in subtitling and the rising profile of the post-editor. Multilingual. 25 (1), pp. 24-28.

SUMAT: an online service for subtitling by machine translation
Bywood, L., Georgakopoulou, P., Etchegoyhen, T., Fishel, M., Jiang, J., Loenhout, G., Pozo, A., Spiliotopoulos, D., Turner, A. and Maucec, M. 2013. SUMAT: an online service for subtitling by machine translation. Machine Translation (MT) Summit XIV. ACROPOLIS Conference Centre, Nice, France 02 Sep 2013

Parallel subtitle corpora and their applications in machine translation and translatology
Bywood, L., Volk, M., Fishel, M. and Georgakopoulou, P. 2013. Parallel subtitle corpora and their applications in machine translation and translatology. Perspectives: Studies in Translatology. 21 (4), pp. 595-610. doi:10.1080/0907676X.2013.831920

Embracing the threat: machine translation as a solution
Bywood, L., Georgakopoulou, P. and Etchegoyhen, T. 2013. Embracing the threat: machine translation as a solution. Subtitling: a collective approach. University of Nottingham, Nottingham, UK 12 Jul 2013

Permalink - https://westminsterresearch.westminster.ac.uk/item/99821/machine-translation-for-subtitling-a-large-scale-evaluation


Share this
Tweet
Email

Usage statistics

50 total views
0 total downloads
1 views this month
0 downloads this month
These values are for the period from September 2nd 2018, when this repository was created

Export as