Support for decision-making in checking the level of quality of student research works based on automated text analysis ( Asistencia para la toma de decisiones en la evaluación de la calidad de las investigaciones de los estudiantes basada en el análisis automático de textos )

Abstract

Spanish

The purpose of this study is to increase the efficiency of the analysis process and the objectivity of decision-making on the final assessment, showing the quality of student research works based on the use of an automated text analysis software product. The total number of evaluated research papers was more than 300 (average age of students: 21.6; SD = 34). During the experiment, the effectiveness of the software product Multifunctional Text Analyser (MTA) was tested on the specified sample. The text of the analysed research works can be assessed as qualitative if the complex indicator of the text fragments congruence of the work exceeds 70%. The current article can be used as a methodological and theoretical basis for implementing the principles of academic virtue in institutions of higher education.

Get full access to this article

View all access options for this article.

References

Advego . (2021a). Online semantic text analysis, seo-analysis of a text. https://advego.com/text/seo/

Advego . (2021b). Software for the uniqueness of the text checking. https://advego.com/plagiatus/

Aronsson

F. S.

Kuhlmann

Jelic

, & Östberg

(2021). Is cognitive impairment associated with reduced syntactic complexity in writing? Evidence from automated text analysis. Aphasiology, 35(7), 900–913. https://doi.org/10.1080/02687038.2020.1742282

Bhaumik

Chakraborty

Mukherjee

Bhattacharyya

, & Chattopadhyay

(2014). Towards reliable clustering of English text documents using correlation coefficient. In Sarangdevot

(Ed.), 2014 International Conference on Computational Intelligence and Communication Networks (pp. 530–535). IEEE. https://doi.org/10.1109/CICN.2014.121

Birjali

Beni-Hssane

Erritali

, & Madani

(2016). Information content measures of semantic similarity between documents based on hadoop system. In Ghennioui

(Ed.), 2016 International Conference on Wireless Networks and Mobile Communications (WINCOM) (pp. 187–192). IEEE. https://doi.org/10.1109/WINCOM.2016.7777212

Butakova

M. A.

Klimanskaya

E. V.

, & Yants

V. I

. (2013). A measure of information similarity for semistructured information analysis. Modern Problems of Science and Education, 6, 130. https://elibrary.ru/item.asp?id=21162562

Chua

Kulathuramaiyer

Ranaivo-Malançon

, & Iboi

(2018). A comparative study of sentiment-based graphs of text summaries. In Shah

(Ed.), 2018 IEEE 5th International Conference on Engineering Technologies and Applied Sciences (ICETAS) (pp. 1–5). IEEE. https://doi.org/10.1109/ICETAS.2018.8629240

Conjugateprior . (2021). Lowe W. ‘JFreq: Count words, quickly’. Java software version 0.5.4. http://www.conjugateprior.org/software/jfreq/

Fouche

Meng

Guo

Zhuang

H. L.

Bohm

, & Han

J. W.

(2020). Mining text outliers in document directories. In Wu

(Ed.), 20th IEEE International Conference on Data Mining (ICDM) (pp. 152–161). IEEE. https://doi.org/10.1109/ICDM50108.2020.00024

10.

Gerasimov

S. V.

Kurynin

R. V.

Mashechkin

I. V.

Petrovsky

M. P.

Tsarev

D. V.

, & Shestimerov

A. A.

(2013). Tools for assessing the quality of scientific-technical documents. In Avetisyan

(Ed.), Proceedings of the Institute for System Programming of the Russian Academy of Sciences (Vol. 24, pp. 359–378). Russian Academy of Sciences.

11.

Gupta

Khan

F. M.

, & Agarwal

. (2021). Exploring factors influencing mobile learning in higher education–a systematic review. International Journal of Interactive Mobile Technologies, 15(12), 141–157. https://doi.org/10.3991/ijim.v15i12.22503

12.

Khoo

C. S. G.

Nourbakhsh

, & Na

J. C

. (2012). Sentiment analysis of online news text: A case study of appraisal theory. Online Information Review, 36(6), 858–878. https://doi.org/10.1108/14684521211287936

13.

Kim

Y. S.

Rim

H. C.

, & Lee

D. G

. (2019). Business environmental analysis for textual data using data mining and sentence-level classification. Industrial Management & Data Systems, 119(1), 69–88. https://doi.org/10.1108/IMDS-07-2017-0317

14.

Kreines

E. M.

, & Kreines

M. G

. (2016). Control model for the alignment of the quality assessment of scientific documents based on the analysis of content-related context. Journal of Computer and Systems Sciences International, 55(6), 938–947. https://doi.org/10.1134/S1064230716050099

15.

Kunz

. (2019). An automated quantitative content analysis process for humanitarian logistics research. Journal of Humanitarian Logistics and Supply Chain Management, 9(3), 475–491. https://doi.org/10.1108/JHLSCM-06-2018-0051

16.

Leximancer . (2021). The program - content analysis of large volumes of text. https://www.leximancer.com/

17.

Liang

Liu

Chen

, & Jiang

. (2018). Extracting topic-sensitive content from textual documents — a hybrid topic model approach. Engineering Applications of Artificial Intelligence, 70, 81–91. https://doi.org/10.1016/j.engappai.2017.12.010

18.

Liu

, & Li

(2016). Semantic based text similarity computation. In Zhao

Ouyang

Yang

, & Ouyang

(Eds.), China Academic Conference on Printing & Packaging and Media Technology (pp. 343–348). Singapore: Springer. https://doi.org/10.1007/978-981-10-3530-2_43

19.

Lytvyn

Vysotska

Veres

Rishnyak

, & Rishnyak

(2016). Content linguistic analysis methods for textual documents classification. In Saifan

(Ed.), 2016 XIth International Scientific and Technical Conference Computer Sciences and Information Technologies (CSIT) (pp. 190–192). IEEE. https://doi.org/10.1109/STC-CSIT.2016.7589903

20.

Minasova

N. S.

, & Tarkhov

S. V

. (2015). Support for decision making in the evaluation of educational scientific-technical works on the basis of multifunctional automated analysis of text document. In Shoukourian

(Ed.), CSIT’2015 (pp. 186–190). CSIT.

21.

Minasova

N. S.

Tarkhov

S. V.

, & Tarkhova

L. M

. (2006). Models of formation and practical implementation of compiled training modules in the e-learning system. Otkrytoe Obrazovanie, 5, 21–29. https://cyberleninka.ru/article/n/modeli-formirovaniya-i-prakticheskaya-realizatsiya-skompilirovannyh-uchebnyh-moduley-v-sisteme-elektronnogo-obucheniya

22.

MindGems . (2021). Fast Dublicate File Finder. https://www.mindgems.com/products/Fast-Duplicate-File-Finder/Fast-Duplicate-File-Finder-About.htm

23.

MonoConc . (2021). Text data analysis tool. https://monoconc.com

24.

Moore

R. L.

Oliver

K. M.

, & Wang

. (2019). Setting the pace: Examining cognitive processing in MOOC discussion forums with automatic text analysis. Interactive Learning Environments, 27(5–6), 655–669. https://doi.org/10.1080/10494820.2019.1610453

25.

Nascimento

N. M.

Valentim

P. M. L.

, & Moro Cabero

M. M

. (2017). Reflections from the bibliometric analysis about documents types, information flows and documents evaluation. Encontros Bibli-Revista Eletrónica de Biblioteconomia e Ciência da Informação, 22(50), 59–75. https://doi.org/10.5007/1518-2924.2017v22n50p59

26.

Petchprasert

. (2021). Utilizing an automated tool analysis to evaluate EFL students’ writing performances. Asian-Pacific Journal of Second and Foreign Language Education, 6(1), 1. https://doi.org/10.1186/s40862-020-00107-w

27.

Popovič

, & Willett

. (1992). The effectiveness of stemming for natural‐language access to Slovene textual data. Journal of the American Society for Information Science, 43(5), 384–390. https://doi.org/10.1002/(SICI)1097-4571(199206)43:5%3C384::AID-ASI6%3E3.0.CO;2-L

28.

Porter

M. F

. (1980). An algorithm for suffix stripping. Program, 14(3), 130–137. https://doi.org/10.1108/eb046814

29.

Provalis Research . (2021). QDA Miner. A tool for qualitative analysis of text data. https://provalisresearch.com/

30.

Sanchez-Gomez

J. M.

Vega-Rodriguez

M. A.

, & Perez

C. J

. (2020). Experimental analysis of multiple criteria for extractive multi-document text summarization. Expert Systems with Applications, 140, 112904. https://doi.org/10.1016/j.eswa.2019.112904

31.

Sandhya

, & Govardhan

(2012). Analysis of similarity measures with wordnet based text document clustering. In Satapathy

S. C.

Avadhani

P. S.

, & Abraham

(Eds.), Proceedings of the International Conference on Information Systems Design and Intelligent Applications 2012 (India 2012) held in Visakhapatnam, India, January 2012 (pp. 703–714). Berlin, Heidelberg: Springer. https://doi.org/10.1007/978-3-642-27443-5_80

32.

Simankov

V. S.

, & Tolkachev

D. M.

(2014). Automatic assessment of semantic similarity of texts. In Kuzmina

(Ed.), Proceedings of the XXXVII International Scientific and Practical Conference (Vol. 8, No. 33, p. 104). SibAK. https://cyberleninka.ru/article/n/avtomaticheskaya-otsenka-smyslovogo-podobiya-tekstov

33.

Sisodia

D. S.

Choudhary

Vandana

, & Rai

. (2019). Agglomerative similarity measure based automated clustering of scholarly articles. In Tanveer

, & Pachori

(Eds.), Machine Intelligence and Signal Analysis (pp. 533–544). Springer. https://doi.org/10.1007/978-981-13-0923-6_46

34.

Sumathi

, & Grace

G. H.

(2021). A similarity measure for text document using term cardinality. IOP Conference Series: Materials Science and Engineering, 1012(1), 12059. https://doi.org/10.1088/1757-899X/1012/1/012059

35.

Tarkhova

Tarkhov

Nafikov

Akhmetyanov

Gusev

, & Akhmarov

. (2020). Infographics and their application in the educational process. International Journal of Emerging Technologies in Learning, 15(13), 63–80. https://doi.org/10.3991/.vi.14647%0d

36.

Tarkhov

S. V.

Minasova

N. S.

, & Kalimullina

G. R

. (2015). Certificate of state registration of computer programs No. 2015612998. In Multifunctional text analyzer (MTA) (p. 020042). Russian Federal Service for Intellectual Property, Patents and Trademarks. American Institute of Physics.

37.

Tarkhov

S. V.

Minasova

N. S.

Minasov

S. M.

, & Tarkhova

L. M.

(2018). Storage and processing technologies of cognitive content for eLearning systems. In Blonder

(Ed.), 2018 3rd Russian-Pacific Conference on Computer Technology and Applications (RPC) (pp. 1–6). IEEE. https://doi.org/10.1109/RPC.2018.8482185

38.

Tarkhov

S. V.

Tarkhova

L. M.

, & Shagiyeva

Y. R.

(2013). Information support of decision-taking in staff recruitment management process based on complex diagnostics. In Shoukourian

(Ed.), Proceedings of the 15th Workshop Computer Science and Information Technologies (CSIT’ 2013) (Vol. 2, pp. 138–142). Ufa -Vienna -Budapest - Bratislava. Zangak Publishing House.

39.

Text Analyzer . (2021). Official web site. https://www.textanalyzer.ru/

40.

Watt

R. J. C.

(2021). Last update. The program of content analysis of electronic documents . http://www.concordancesoftware.co.uk/

41.

Yadav

, & Sharan

. (2018a). Automatic text document summarization using graph based centrality measures on lexical network. International Journal of Information Retrieval Research, 8(3), 14–32. https://doi.org/10.4018/IJIRR.2018070102

42.

Yadav

, & Sharan

. (2018b). A new LSA and entropy-based approach for automatic text document summarization. International Journal on Semantic Web and Information Systems, 14(4), 1–32. https://doi.org/10.4018/IJSWIS.2018100101

43.

Yadav

C. S.

Sharan

Kumar

, & Biswas

. (2016). A new approach for single text document summarization. Advances in Intelligent Systems and Computing, 380, 401–411. https://doi.org/10.1007/978-81-322-2523-2_39