This study evaluated a bilingual text-mining system, which incorporated a bilingual taxonomy of key words and provided hierarchical visualization, for understanding learner-generated text in the learning management systems through automatic identification and counting of matching key words. A class of 27 in-service teachers studied a course “e-Learning in primary mathematics” was asked to reflect “what is e-Learning” before and after the course. Their concept of “e-Learning” was investigated by counting the matching key words using the text-mining system and a content analysis of learner-generated text using a rubric, respectively. The correlations of the results using these two methods were .823 and .840 in the preteaching and postteaching reflections. This text-mining system has the potential as a supporting tool for teachers to gain a general understanding of learner-generated text using the hierarchical visualization for supporting pedagogical decision-making, which can be applied to massive open online courses with a large enrolment of learners.
BleiD. M.NgA. Y.JordanM. I. (2003) Latent Dirichlet allocation. The Journal of Machine Learning Research3: 993–1022.
2.
BostockM.OgievetskyV.HeerJ. (2011) D3: Data-driven documents. IEEE Transactions on Visualization and Computer Graphics17(12): 2301–2309.
3.
Boyd-GraberJ.BleiD. M. (2009, June) Multilingual topic models for unaligned text. In: BilmesJ.NgA. Y. (eds) Proceedings of the Twenty-Fifth Conference on Uncertainty in Artificial Intelligence, Montreal, Canada: AUAI Press, pp. 75–82.
4.
ChangP.-C.GalleyM.ManningC. D. (2008, June) Optimizing Chinese word segmentation for machine translation performance. In: Callison-BurchC.KoehnP.MonzC.SchroederJ.FordyceC. S. (eds) Proceedings of the Workshop on Statistical Machine Translation, Stroudsburg, PA: Association for Computational Linguistics, pp. 224–232.
5.
ChuC.NakazawaT.KurohashiS. (2014) Iterative bilingual lexicon extraction from comparable corpora with topical and contextual knowledge. In: GelbukhA. (ed.) Computational Linguistics and Intelligent Text Processing, Berlin, Heidelberg: Springer, pp. 296–309.
6.
CimianoP.HothoA.StaabS. (2005) Learning concept hierarchies from text corpora using formal concept analysis. Journal of Artificial Intelligence Research24: 305–339.
7.
DaemsO.ErkensM.MalzahnN.HoppeH. U. (2014) Using content analysis and domain ontologies to check learners’ understanding of science concepts. Journal of Computers in Education1(2–3): 113–131.
8.
de OliveiraM. F.LevkowitzH. (2003) From visual data exploration to visual data mining: A survey. IEEE Transactions on Visualization and Computer Graphics9(3): 378–394.
9.
DzikovskaM.SteinhauserN.FarrowE.MooreJ.CampbellG. (2014) BEETLE II: Deep natural language understanding and automatic feedback generation for intelligent tutoring in basic electricity and electronics. International Journal of Artificial Intelligence in Education24(3): 284–332.
10.
ElmqvistN.FeketeJ.-D. (2010) Hierarchical aggregation for information visualization: Overview, techniques, and design guidelines. IEEE Transactions on Visualization and Computer Graphics16(3): 439–454.
11.
FeldmanR.DaganI. (1995, August) Knowledge discovery in textual databases (KDT). In: FayyadU. M.UthurusamyR. (eds) Proceedings of the First International Conference on Knowledge Discovery and Data Mining, Montreal, Canada: Association for the Advancement of Artificial Intelligence, pp. 112–117.
12.
FungP. (1995, June) Compiling bilingual lexicon entries from a non-parallel English-Chinese corpus. In: YarowskyD.ChurchK. (eds) Proceedings of the Third Workshop on Very Large Corpora, Cambridge: Massachusetts Institute of Technology, pp. 173–183.
13.
GaševićD.DawsonS.SiemensG. (2015) Let’s not forget: Learning analytics are about learning. TechTrends59(1): 64–71.
14.
GuptaV.LehalG. S. (2009) A survey of text-mining techniques and applications. Journal of Emerging Technologies in Web Intelligence1(1): 60–76.
15.
GutiérrezE. D.ShutovaE.LichtensteinP.de MeloG.GilardiL. (2016) Detecting cross-cultural differences using a multilingual topic model. Transactions of the Association for Computational Linguistics4: 47–60.
16.
HuangC. C.ChenM. H.YangP. C. (2015, July) Bilingual key word extraction and its educational application. In: ChenH.-H.TsengY.-H.MatsumotoY.WongL. H. (eds) Proceedings of 2nd Workshop on Natural Language Processing Techniques for Educational Applications, Beijing, China: Association for Computational Linguistics and Asian Federation of Natural Language Processing, pp. 43–48.
17.
KleinD.ManningC. D. (2003, July) Accurate unlexicalized parsing. In: HinrichsE. W.RothD. (eds) Proceedings of the 41st Annual Meeting on Association for Computational Linguistics, Stroudsburg, PA: Association for Computational Linguistics, pp. 423–430.
18.
KrstovskiK.SmithD. A.KurtzM. J. (2016, June) Online multilingual topic models with multi-level hyperpriors. In: Proceedings of 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Stroudsburg, PA: Association for Computational Linguistics, pp. 454–459.
19.
LárussonJ. A.WhiteB. (2012, April) Monitoring student progress through their written point of originality. In: ShumS. B.GasevicD.FergusonR. (eds) Proceedings of the 2nd International Conference on Learning Analytics and Knowledge, New York, NY: Association for Computing Machinery, pp. 212–221.
20.
LinF. R.HsiehL. S.ChuangF. T. (2009) Discovering genres of online discussion threads via text-mining. Computers & Education52(2): 481–495.
21.
LiuJ. N. K.HeY. L.LimE. H.WangX. Z. (2014) Domain ontology graph model and its application in Chinese text classification. Neural Computing and Applications24(3–4): 779–798.
22.
Manning, C. D., Surdeanu, M., Bauer, J., Finkel, J. R., Bethard, S., & McClosky, D. (2014, June). The Stanford CoreNLP natural language processing toolkit. In Proceedings of 52nd Annual Meeting of the Association for Computational Linguistics: System Demonstrations (pp. 55–60). Baltimore, Maryland: Association for Computational Linguistics.
23.
MingN. C.MingV. L. (2015) Visualizing and assessing knowledge from unstructured student writing. Technology, Instruction, Cognition & Learning10(1): 27–44.
24.
NewbyP. (2010) Research methods for education, Harlow, England: Pearson Education.
25.
Pérez-MarínD.Pascual-NietoI. (2010) Showing automatically generated students’ conceptual models to students and teachers. International Journal of Artificial Intelligence in Education20(1): 47–72.
26.
RiloffE.SchaferC.YarowskyD. (2002, February) Inducing information extraction systems for new languages via cross-language projection. In: Proceedings of the 19th International Conference on Computational Linguistics—Volume 1, Stroudsburg, PA: Association for Computational Linguistics, pp. 1–7.
27.
RomeroC.VenturaS. (2010) Educational data mining: A review of the state of the art. IEEE Transaction on Systems, Man, and Cybernetics, Part C: Applications and Reviews40(6): 601–618.
28.
SawilowskyS. S. (2009) New effect size rules of thumb. Journal of Modern Applied Statistical Methods8(2): 597–599.
29.
SherinB. (2012, April) Using computational methods to discover student science conceptions in interview data. In: ShumS. B.GasevicD.FergusonR. (eds) Proceedings of the 2nd International Conference on Learning Analytics and Knowledge, New York, NY: Association for Computing Machinery, pp. 188–197.
30.
ShneidermanB. (1996, September) The eyes have it: A task by data type taxonomy for information visualizations. Proceedings of the IEEE Symposium on Visual Languages, Los Alamitos, CA: IEEE, pp. 336–343.
31.
SmadjaF.McKeownK. R.HatzivassiloglouV. (1996) Translating collocations for bilingual lexicons: A statistical approach. Computational Linguistics22(1): 1–38.
32.
SongD.LinH.YangZ. (2007, September) Opinion mining in e-learning system. In: LiK.XiangY.JinH.QuW.CaoZ. (eds) Proceedings of International Conference on Network and Parallel Computing Workshops, Washington, DC: IEEE, pp. 788–792.
33.
SouthavilayV.YacefK.ReimannP.CalvoR. A. (2013) Analysis of collaborative writing processes using revision maps and probabilistic topic models. In: SuthersD.VerbertK.DuvalE.OchoaX. (eds) In Proceedings of 3rd ACM International Conference on Learning Analytics and Knowledge, New York, NY: Association for Computing Machinery, pp. 38–47.
34.
TeohS. T.MaK.-L. (2002, August) RINGS: A technique for visualizing large hierarchies. In: KobourovS. G.GoodrichM. T. (eds) Proceedings of the Revised Papers from the 10th International Symposium on Graph Drawing, London, England: Springer-Verlag, pp. 268–275.
35.
TeplovsC.FujitaN.VatrapuR. (2011, February) Generating predictive models of learner community dynamics. In: LongP.SiemensG.ConoleG.GasevicD. (eds) Proceedings of the 1st International Conference on Learning Analytics and Knowledge, New York, NY: Association for Computing Machinery, pp. 147–152.
36.
WilliamsC.D’MelloS. (2010, June) Predicting student knowledge level from domain-independent function and content words. In: AlevenV.KayJ.MostowJ. (eds) Proceedings of the 10th International Conference on Intelligent Tutoring Systems, Pittsburgh, PA: Springer-Verlag, pp. 62–71.
37.
YinJ.WangJ. (2014, August) A Dirichlet multinomial mixture model-based approach for short text clustering. In: MacskassyS.PerlichC. (eds) Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, New York, NY: Association for Computing Machinery, pp. 233–242.
38.
ZhaoY.QinB.LiuT.TangD. (2016) Social sentiment sensor: A visualization system for topic detection and topic sentiment analysis on microblog. Multimedia Tools and Applications75(15): 8843–8860.
39.
Zhou, J., & Wang, S. (2010). Concept mining and inner relationship discovery from text. In J. Zhang (Ed.), New Advances in Machine Learning (pp. 305–327). Rijeka, Croatia: InTech.
