AirBERT: A fine-tuned language representation model for airlines tweet sentiment analysis

Abstract

Airlines operate in a competitive marketplace and must upgrade their services to meet customer safety and comfort. Post-pandemic, the government and airlines resumed flights with many restrictions, the impact which is unexplored. An increasing number of customers use social media to leave reviews and in this age of Machine Learning (ML), if a model is available to automatically polarize flyer sentiments, it can help airlines upscale. In this work, a custom dataset is scraped from Twitter by including online reviews of five Indian airlines. Multiclass sentiment analysis using three classifiers, support vector machine, K-nearest neighbor and random forest with word2vec and TF-IDF word embeddings is implemented. AirBERT, a fine-tuned deep learning attention model based on bidirectional encoder representation from transformers is proposed. From results, it is observed that on ML, Random Forest with TF-IDF performs the best but the graphical processing unit and domain corpora trained AirBERT outperforms all the other models with an accuracy of 91%. Indigo airlines and Jet Airways received the maximum percentage of positive and negative reviews respectively. In performance comparison with three existing models on the USA airlines tweets dataset, the proposed model outperforms others trained on general domain corpora and matches state-of-the-art TweetBERTv2 model accuracy. The model can be deployed by airlines and other service industries to implement a customer relationship management (CRM) system.