Neural Machine Translation (NMT) for low resource languages is a challenging task due to unavailability of large parallel corpus. The efficacy of Transformer based NMT models largely depends on scale of the parallel corpus and the configuration of hyperparameters implemented during model training. This study aims to delve into and elucidate the impact of hyperparameters on the performance of NMT models for low resource languages. To accomplish this, a series of experiments are conducted using an open-source Hindi-Kangri corpus to train both supervised and semi-supervised NMT models. Throughout the experimentation process, a significant number of discrepancies were identified within the data-set, necessitating manual correction. The best translation performance evaluated with respect to the metrics such as BLEU (0–1), SacreBLEU (0–100), Chrf (0–100), Chrf+ (0–100), Chrf++ (0–100) and TER (%) is (0.15, 14.98, 41.43, 41.49, 38.77, 68.20) for Hindi to Kangri direction, and (0.283, 28.17, 49.71, 50.64, 48.63, 51.25) for Kangri to Hindi direction.
Kyunghyun ChoBart van MerriënboerCaglar GulcehreDzmitryBahdanauFethi BougaresHolger SchwenkYoshua Bengio Learning phrase representations usingRNN Encoder–Decoder for statistical Machine Translation. In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 1724–1734, (2014).
3.
Bahdanau DzmitryKyunghyun ChoBengioY. Neural machine translation by jointly learning to align and translate. ArXiv. 1409. (2014).
4.
Ashish VaswaniNoam ShazeerNiki ParmarJakob UszkoreitLlionJonesAidan GomezN.Łukasz KaiserIllia Polosukhin, Attention is all you need. In Proceedings of the 31st International Conference on Neural Information Processing Systems (NIPS’17) (2017).
5.
Jacob DevlinMing-Wei ChangKenton LeeKristina Toutanova BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1, pages 4171–4186, (2019).
6.
Ali AraabiChristof Monz Optimizing transformer for low-resource neural Machine Translation. In Proceedings of the 28th International Conference on Computational Linguistics, pages 3429–3435, (2020).
7.
Seamus LankfordHaithem AlfiAndy Way Transformers for low-resource languages: Is Féidir Linn!. In Proceedings of Machine Translation Summit XVIII: Research Track, pages 48–60. (2021).
BiljonE.V.PretoriusA.KreutzerJ. On optimal transformer depth for low-resource language translation, In The International Conference on Learning Representations (ICLR 2020), (2020).
10.
ChauhanS.SaxenaS.DanielP. Analysis of neural machine translation KANGRI language by unsupervised and semi supervised methods, IETE Journal of Research (2022), 1–11.
11.
ChauhanS.SaxenaS.DanielP. Monolingual and parallel corpora for Kangri low resource language, arXiv preprint arXiv:2103.11596. (2021).
12.
Ben AthiwaratkunAndrew Wilson and Anima Anandkumar Probabilistic FastText for multi-sense word embeddings, In Proceedings of the 56th Annual Meetingof the Association for Computational Linguistics (Volume 1: Long Papers), pages 1–11. 2018.
13.
ChenY.PerozziB.Al-RfouR.SkienaS.S. The expressive power of word embeddings, ArXiv, abs/1301.3226. (2013).
14.
Razvan PascanuTomas MikolovYoshua Bengio On the difficulty of training recurrent neural networks, In Proceedings of the 30th International Conference on International Conference on Machine Learning –Volume 28, (2013).
15.
StahlbergF.Neural machine translation: A review, Journal ofArtificial Intelligence Research69 (2020)343–418.
MaJ.LiJ.LiuY.ZhouS.LiX. Integrating dependency tree into self-attention for sentence representation, ICASSP 2022 –2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2022, pp. 8137–8141.
18.
Peter ShawJakob UszkoreitAshish Vaswani Self-attention with relative position representations, In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 2, pages 464–468. 2018.
Barret ZophDeniz YuretJonathan MayKevin Knight Transfer learning for low-resource neural machine translation, In Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, pages 1568–1575. 2016.
22.
Mieradilijiang MaimaitiYang LiuHuanbo LuanMaosong Sun, Enriching the transfer learning with pre-trained lexicon embeddingfor low-resource neural machine translation,Article, Tsinghua Scienceand Technology27(1) (2022)13.
23.
Shailashree SheshadriK.Deepa GuptaMarta Costa-JussàR.A voyage on neural machine translation for indic languages, Procedia Comput Sci218(C) (2023)2694–2712.
24.
PremjithB.Anand KumarM.Soman,K.P. Neural machine translation system for English to Indian language translation using MTIL parallel corpus: Special issue on natural language processing, Journal of Intelligent Systems, 2019.
25.
SheshadriS.K.DhanushA.PradyumnaN.V.S.SripathiS.R.Gupta,D. Reordering based unsupervised neural machine translation system for English To Telugu, 2022 13th International Conference on Computing Communication and Networking Technologies (ICCCNT), Kharagpur, India, 2022, pp. 1–6.
26.
SheshadriS.K.Sai Bharath,B.Hari Naga Sree Chandana Sarvani,A.Reddy Vijaya Bharathi ReddyP.Gupta,D. Unsupervised neural machine translation for English to Kannada using pre-trained language model, 2022 13th International Conference on Computing Communication and Networking Technologies (ICCCNT), Kharagpur, India, 2022, pp. 1–5.
27.
GadugoilaH.SheshadriS.K.NairP.C.GuptaD. Unsupervised pivot-based neural machine translation for English to Kannada, 2022 IEEE 19th India Council International Conference (INDICON), Kochi, India, 2022, pp. 1–6.
28.
SheshadriS.K.GuptaD.Costa-JussàM.R. Neural machine translation for Kashmiri to English and Hindi using pre-trained embeddings, 2022 OITS International Conference on Information Technology (OCIT), Bhubaneswar, India, 2022, pp. 238–243, doi: 10.1109/OCIT56763.2022.00053.
29.
PremjithB.SomanK.P.Anand KumarM.Jyothi Ratnam,D.Embedding linguistic features in word embedding for prepositionsense disambiguation in English–Malayalam machine translationcontext, Studies in Computational Intelligence823(2019), 341–370.
30.
AI4BharatJay GalaPranjal ChitaleA.RaghavanA.K.SumanthDoddapaneniVarun GummaAswanth KumarJanki NawaleAnupamaSujathaRatish PuduppullyVivek RaghavanPratyush KumarMitesh KhapraM.Raj DabreAnoop Kunchukuttan IndicTrans2: Towards High-Quality and Accessible Machine Translation Models for all 22 Scheduled Indian Languages, ArXiv, abs/2305.16307. (2023).
31.
LoneN.A.GiriK.J.BashirR. Machine intelligence for language translation from Kashmiri to English, Journal of Information & Knowledge Management (2022), 2250074.
32.
GusainR.DashS.R.ParidaS.JhaG.N. Automatic language identification: A case study of Pahari languages, Language Resources and Evaluation (2023), 1–27.
33.
Anoop KunchukuttanPratik MehtaPushpak Bhattacharyya The IIT Bombay English-Hindi parallel corpus, In Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC 2018). 2018.
34.
Rico SennrichBarry HaddowAlexandra Birch Neural machine translation of rare words with subword units, In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics, Volume 1, pages 1715–1725. 2016.
35.
Ben AthiwaratkunAndrew WilsonAnima Anandkumar Probabilistic fasttext for multi-senseword embeddings, In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 1–11. 2018.
36.
PenningtonJ.SocherR.ManningC.D. Glove: Global vectors for word representation. In Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP) (pp. 1532–1543). (2014, October).
Ye QiDevendra SachanMatthieu FelixSarguna PadmanabhanGraham Neubig When and why are pre-trained word embeddings useful for neural machine translation? In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 2 (Short Papers), pages 529–535. 2018.
Myle OttSergey EdunovAlexei BaevskiAngela FanSam GrossNathan NgDavid GrangierMichael Auli fairseq: A fast, extensible toolkit for sequence modeling, In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics (Demonstrations), pages 48–53. 2019.
41.
Van Der Walt,S.ColbertS.C.Varoquaux,G.The NumPy array: A structure for efficient numerical computation, Computing in Science & Engineering13(2) (2011)22–30.
42.
Steven BirdEdward Loper NLTK: The Natural Language Toolkit, In Proceedings of the ACL Interactive Poster and Demonstration Sessions, pages 214–217. 2004.
43.
Matt Post A call for clarity in reporting BLEU scores, In Proceedings of the Third Conference on Machine Translation: Research Papers, pages 186–191. 2018.
44.
Kishore PapineniSalim RoukosTodd WardWei-Jing Zhu Bleu: A method for automatic evaluation of machine translation, In Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics, pages 311–318. 2002.
45.
Matthew SnoverBonnie DorrRich SchwartzLinnea MicciullaJohn Makhoul A study of translation edit rate with targeted human annotation, In Proceedings of the 7th Conference of the Association for Machine Translation in the Americas: Technical Papers, pages 223–231. 2006.
46.
Maja Popović, chrF: character n-gram F-score for automatic MT evaluation, In Proceedings of the Tenth Workshop on Statistical Machine Translation, pages 392–395. 2015.
47.
TillmannC.NeyH.Word reordering and a dynamic programming beam search algorithm for statistical machine translation, Computational Linguistics29(1) (2003)97–133.
