Preprocessing of Subword Encoding for NMT

Abstract

MASTER THESIS Kirill Semenov Pre-processing of the Subword Encoding for the Neural Machine Translation Institute of Formal and Applied Linguistics Supervisor of the master thesis: Mgr. Martin Popel, Ph.D. Study programme: Computer Science Study branch: Language Technologies and Computational Linguistics Prague 2024 I declare that I carried out this master thesis independently, and only with the cited sources, literature and other professional sources. It has not been used to obtain another or the same degree. I understand that my work relates to the rights and obligations under the Act No. 121/2000 Sb., the Copyright Act, as amended, in particular the fact that the Charles University has the right to conclude a license agreement on the use of this work as a school work pursuant to Section 60 subsection 1 of the Copyright Act. In . . . . . . . . . . . . . date . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Author's signature i Firstly, I would like to thank Martin Popel for encouraging me to take on the topic that combines the technical aspects of NLP and the linguistic analysis of tokenization. Since the field of NLP was relatively new to me, I am grateful for the attentive guidance in my work. This included both suggesting the directions of the research...