Investigation of text data augmentation for transformer training via translation technique
Articles
Dominykas Šeputis
Vilnius University, Lithuania
Published 2021-05-14
https://doi.org/10.15388/LMITT.2021.11
PDF

Keywords

none

How to Cite

Šeputis, D. (2021) “Investigation of text data augmentation for transformer training via translation technique”, Vilnius University Open Series, pp. 97–105. doi:10.15388/LMITT.2021.11.

Abstract

Data augmentation can improve model’s final accuracy by introducing new data samples to the dataset. In this paper, text data augmentation using translation technique is investigated. Synthetic translations, generated by Opus-MT model are compared to the unique foreign data samples in terms of an impact to the trans- former network-based models’ performance. The experimental results showed that multilingual models like DistilBERT in some cases benefit from the introduction of the addition artificially created data samples presented in a foreign language.

PDF

Downloads

Download data is not yet available.

Most read articles by the same author(s)

1 2 3 4 5 > >>