Translation of Hindi in Roman Script into English: Use of Transformer

Abstract

Translation from one language to another is a complex problem in machine learningand one in which the machine still cannot achieve satisfactory results. Therecent focus for solving this challenge has been on neural machine translation(NMT) techniques using architectures such as recurrent neural network (RNN)and long short-term memory (LSTM). Even though they give slightly better resultsthan the previously available conventional techniques, the transformer canoutperform these NMT techniques. To the best of our knowledge work is yet tobe carried out in translating Hindi language sentences written in Roman (English)letters into English. In this report, we discuss how the architecture of transformerthat uses attention mechanism is used to translate Hindi language sentences writtenin Roman letters into English sentences. Since there was no dataset availabletill now, our work also involves creating a dataset for training and testing. Ourresults are compared with other approaches using BLEU score as a measure.