The process of associating words with their relevant parts of speech is known as part-of-speech (POS) tagging. It takes a substantial amount of well-organized data or corpora and significant target language research to obtain good performance for a tagger. Mizo is a language that needs more research attention in computational linguistics due to its under-resourced nature. The limited availability of corpora and relevant literature adds complexity to the task of assigning POS labels to Mizo text. This paper explores two methods to potentially improve the Hidden Markov Model (HMM)-based POS tagger for the Mizo language. The proposed taggers are compared with the baseline HMM tagger and the N-gram taggers on the designed Mizo corpus, which consists of 72,077 manually tagged tokens. The experimental results proved that the two proposed taggers enhanced the HMM-based Mizo POS tagger, achieving 81.52% and 84.29% accuracy, respectively. Moreover, a comprehensive analysis of the performance of the suggested hybrid tagger was conducted, yielding a weighted average precision, recall, and F1-score of 83.09%, 77.88%, and 79.64% respectively.
JurafskyD. Speech & language processing, Pearson Education India (2000).
2.
VoutilainenA. Part-of-speech tagging, volume 219. The Oxford handbook of computational linguistics, 2003.
3.
ZothanlianaR. A Study of the Development of Mizo Language in Relation toWord Formation, PhD thesis, Mizoram University, 2020.
4.
Unesco atlas of the world’s languages in danger. http://www.unesco.org. Last accessed: 2021-09-13.
5.
RanjanP., BasuH. Part of speech tagging and local word grouping techniques for natural language parsing in hindi. In Proceedings of the 1st International Conference on Natural Language Processing (ICON 2003), Citeseer, 2003.
6.
EkbalA., HaqueR. and BandyopadhyayS., Maximum entropy based bengali part of speech tagging, A. Gelbukh (Ed.), Advances in, Natural Language Processing and Applications, Research in Computing Science (RCS) Journal33 (2008), 67–78.
7.
NarayanR., ChakravertyS. and SinghV.P., Neural network based parts of speech tagger for hindi, IFAC Proceedings47(1) (2014), 519–524.
8.
JaharaF., BaruaA., IqbalM.D., DasA., SharifO., HoqueM.M., SarkerI.H. Towards pos tagging methods for bengali language: A comparative analysis, In International Conference on Intelligent Computing & Optimization, Springer, 2020, pp. 1111–1123.
9.
SharmaS.K., LehalG.S. Using hidden markov model to improve the accuracy of punjabi pos tagger, In 2011 IEEE International Conference on Computer Science and Automation Engineering, IEEE, 2011, volume 2, pp. 697–701.
10.
PriyadarshiA. and SahaS.K., Towards the first maithili part of speech tagger: Resource creation and system development, Computer Speech & Language62 (2020), 101054.
11.
JobanputraC., ParikhN., VoraV., BhartiS.K. Parts-of-speech tagger for gujarati language using longshort-term-memory, In 2021 International Conference on Artificial Intelligence and Machine Vision (AIMV), IEEE, 2021, pp. 1–5.
12.
TailorC., PatelB. Hybrid pos tagger for gujarati text, In International Conference on Soft Computing and its Engineering Applications, Springer, 2020, pp. 134–144.
13.
GamitV., JoshiR., PatelE. A review on part-of-speech tagging on gujarati language, International Research Journal of Engineering and Technology (IRJET) (2019).
14.
ModiD., NainN. and NehraM., Part-of-speech tagging for hindi corpus in poor resource scenario, Journal of Multimedia Information System5(3) (2018), 147–154.
15.
MundotiyaR.K., KumarV., MehtaA., SinghA.K. Attention-based domain adaption using transfer learning for part-of-speech tagging: An experiment on the hindi language, In Proceedings of the 34th Pacific Asia Conference on Language, Information and Computation, 2020, pp. 471–477.
16.
DalalA., NagarajK., SawantU., ShelkeS. Hindi part-of-speech tagging and chunking: A maximum entropy approach, Proceeding of the NLPAI Machine Learning Competition, 2006.
17.
SwamyA. and SrinathS., Pos tagging and ner system for kannada using conditional random fields, International Journal of Information Retrieval Research (IJIRR)11(4) (2021), 1–13.
18.
DaimaryS., GoyalV., BarboraM. and SinghU., Development of part of speech tagger for assamese using hmm, International Journal of Synthetic Emotions (IJSE)9(1) (2018), 23–32.
19.
PathakD., NandiS., SarmahP. Aspos: Assamese part of speech tagger using deep learning approach, In 2022 IEEE/ACS 19th International Conference on Computer Systems and Applications (AICCSA), IEEE, 2022, pp. 1–8.
20.
SinghT.D., EkbalA., BandyopadhyayS. Manipuri pos tagging using crf and svm: A language independent approach, In Proceeding of 6th International conference on Natural Language Processing (ICON-2008), 2008, pp. 240–245.
21.
ThamM.J., A hybrid pos tagger for khasi, an under resourced language, International Journal of Advanced Computer Science and Applications11(10) (2020).
22.
WarjriS., PakrayP., LyngdohS.A. and MajiA.K., Part-of-speech (pos) tagging using deep learning-based approaches on the designed khasi pos corpus, Transactions on Asian and Low-Resource Language Information Processing21(3) (2021), 1–24.
23.
VaishaliP.K., KalpanaK., NamrataM.C. A rule-based approach for marathi part-of-speech tagging, In ICT with Intelligent Applications, Springer, 2022, pp. 773–785.
24.
AntonyP.J. and SomanK.P., Parts of speech tagging for indian languages: A literature survey, International Journal of Computer Applications34(8) (2011), 0975–8887.
25.
HarishB.S. and RanganR.K., A comprehensive survey on indian regional language processing, SN Applied Sciences2(7) (2020), 1–16.
26.
KumarD. and JosanG.S., Part of speech taggers for morphologically rich indian languages: A survey, International Journal of Computer Applications6(5) (2010), 32–41.
