FBK’s Multilingual Neural Machine Translation System for IWSLT 2017FBK’s Multilingual Neural Machine Translation System for IWSLT 2017

Surafel M. Lakew, Quintino F. Lotito, Marco Turchi, Matteo Negri, Marcello Federico

Abstract
Neural Machine Translation has been shown to enable inference and cross-lingual knowledge transfer across multiple language directions using a single multilingual model. Focusing on this multilingual translation scenario, this work summarizes FBK’s participation in the IWSLT 2017 shared task. Our submissions rely on two multilingual systems trained on five languages (English, Dutch, German, Italian, and Romanian). The first one is a 20 language direction model, which handles all possible combinations of the five languages. The second multilingual system is trained only on 16 directions, leaving the others as zero-shot translation directions (i.e representing a more complex inference task on language pairs not seen at training time). More specifically, our zero-shot directions are Dutch$German and Italian$Romanian (resulting in four language combinations). Despite the small amount of parallel data used for training these systems, the resulting multilingual models are effective, even in comparison with models trained separately for every language pair (i.e. in more favorable conditions). We compare and show the results of the two multilingual models against a baseline single language pair systems. Particularly, we focus on the four zero-shot directions and show how a multilingual model trained with small data can provide reasonable results. Furthermore, we investigate how pivoting (i.e using a bridge / pivot language for inference in a source!pivot!target translations) using a multilingual model can be an alternative to enable zero-shot translation in a low resource setting.
Anthology ID:
2017.iwslt-1.5
Volume:
Proceedings of the 14th International Conference on Spoken Language Translation
Month:
December 14-15
Year:
2017
Address:
Tokyo, Japan
Venue:
IWSLT
SIG:
SIGSLT
Publisher:
International Workshop on Spoken Language Translation
Note:
Pages:
35–41
Language:
URL:
https://aclanthology.org/2017.iwslt-1.5
DOI:
Bibkey:
Cite (ACL):
Surafel M. Lakew, Quintino F. Lotito, Marco Turchi, Matteo Negri, and Marcello Federico. 2017. FBK’s Multilingual Neural Machine Translation System for IWSLT 2017FBK’s Multilingual Neural Machine Translation System for IWSLT 2017. In Proceedings of the 14th International Conference on Spoken Language Translation, pages 35–41, Tokyo, Japan. International Workshop on Spoken Language Translation.
Cite (Informal):
FBK’s Multilingual Neural Machine Translation System for IWSLT 2017FBK’s Multilingual Neural Machine Translation System for IWSLT 2017 (Lakew et al., IWSLT 2017)
Copy Citation:
PDF:
https://aclanthology.org/2017.iwslt-1.5.pdf
Terminologies:
PDF Cite Search Translate