We know little about how readers, especially readers with various characteristics, incorporate materials with highly synthesized words and graphs like infographics. We collected eye movements from 95 college students as they read infographics and categorized them into high-/low-score groups based on comprehension scores. Participants initially inspected the word areas that corresponded to the graph areas with the highest perceptual salience. The high-score group showed greater total fixation duration (TFD), TFD ratios of graphs, and transition numbers between words and graphs, indicating more processing of infographics. The low-score group showed greater TFD ratios of words and saccade amplitudes, indicating information-searching behavior.
AyresP.SwellerJ. (2022). The split-attention principle in multimedia learning. In MayerR. E.FiorellaL. (Eds.), The Cambridge handbook of multimedia learning (pp. 199–211). Cambridge University Press.
2.
BakemanR.GottmanJ. M. (1997). Observing interaction: An introduction to sequential analysis (2nd ed.). Cambridge University Press.
3.
BakerF. B. (2001). The basics of item response theory. ERIC Clearinghouse on Assessment and Evaluation.
4.
BauhoffV.HuffM.SchwanS. (2012). Distance matters: Spatial contiguity effects as trade-off between gaze switches and memory load. Applied Cognitive Psychology, 26, 863–871. https://doi.org/10.1002/acp.2887
5.
BrechmanJ. M.BellmanS.RobinsonJ. A.Treleaven-HassardS.VaranD. (2015). Which ticker format works best? Effects of updating and scrolling news content on viewer memory and program engagement. Journalism & Mass Communication Quarterly, 92(4), 970–985. https://doi.org/10.1177/1077699015604851
6.
CohenJ. A. (1988). Statistical power analysis for the behavioral sciences. Lawrence Erlbaum Associates.
7.
ComelloM. L.QianX.DealA. M.RibislK. M.LinnanL. A.TateD. F. (2016). Impact of game-inspired infographics on user engagement and information processing in an ehealth program. Journal of Medical Internet Research, 18(9), Article e237. http://doi.org/10.2196/jmir.5976
8.
DanV.RauterD. (2021). Explanatory reporting in video format: Contrasting perceptions to those of conventional news. Journalism Practice, 17(5), 1046–1067. https://doi.org/10.1080/17512786.2021.1966644
9.
de HaanY.KruikemeierS.LechelerS.SmitG.van der NatR. (2018). When does an infographic say more than a thousand words?Journalism Studies, 19(9), 1293–1312. http://doi.org/10.1080/1461670X.2016.1267592
10.
DuR. (2014). Book Review: Data journalism: Mapping the future, edited by John Mair and Richard Lance Keeble. Journalism & Mass Communication Quarterly, 91(3), 599–601. https://doi.org/10.1177/1077699014541786b
11.
EllingS.LentzL.De JongM. (2012). Combining concurrent think-aloud protocols and eye-tracking observations: An analysis of verbalizations and silences. IEEE Transactions on Professional Communication, 55(3), 206–220. https://doi.org/10.1109/TPC.2012.2206190
12.
GegenfurtnerA.LehtinenE.SäljöR. (2011). Expertise differences in the comprehension of visualizations: A meta-analysis of eye-tracking research in professional domains. Journal of Educational Psychology, 23, 523–552. https://doi.org/10.1007/s10648-011-9174-7
13.
HegartyM.JustM. A. (1993). Constructing mental models of machines from text and diagrams. Journal of Memory and Language, 32, 717–742. http://doi.org/10.1006/jmla.1993.1036
Hernandez-SanchezS.Moreno-PerezV.Garcia-CamposJ.Marco-LledóJ.Navarrete-MuñozE. M.Lozano-QuijadaC. (2020). Twelve tips to make successful medical infographics. Medical Teacher, 43, 1353–1359. https://doi.org/10.1080/0142159X.2020.1855323
16.
HolmqvistK.NyströmM.AnderssonR.DewhurstR.HalszkaJ.van de WeijerJ. (2011). Eye tracking: A comprehensive guide to methods and measures. Oxford University Press.
17.
HortonA. (2016). Infographic designers’ sketchbooks by Steven Heller and Rick Landers. Technical Communication, 63(2), 174–175.
18.
JianY. C. (2016). Fourth graders’ cognitive processes and learning strategies for reading illustrated biology texts: Eye movement measurements. Reading Research Quarterly, 51(1), 93–109. https://doi.org/10.1002/rrq.125
19.
JianY. C.KoH. W. (2017). Influences of text difficulty and reading ability on learning illustrated science texts for children: An eye movement study. Computers and Education, 113, 263–279. https://doi.org/10.1016/j.compedu.2017.06.002
20.
JianY. C.WuC. J. (2012). The effect of arrows in an illustration when reading scientific text: Evidence from eye movements [in Chinese]. Chinese Journal of Psychology, 54, 385–402.
21.
KingA. J.BolN.CumminsR. G.JohnK. K. (2019). Improving visual behavior research in communication science: An overview, review, and reporting recommendations for using eye-tracking methods. Communication Methods and Measures, 13(3), 149–177. https://doi.org/10.1080/19312458.2018.1558194
22.
KuikenJ.SchuthA.SpittersM.MarxM. (2017). Effective headlines of newspaper articles in a digital environment. Digital Journalism, 5(10), 1300–1314. https://doi.org/10.1080/21670811.2017.1279978
23.
LackmannS.LégerP. M.CharlandP.AubéC.TalbotJ. (2021). The influence of video format on engagement and performance in online learning. Brain Sciences, 11(2), 128. https://doi.org/10.3390/brainsci11020128
24.
LanX.ShiY.ZhangY.CaoN. (2021). Smile or scowl? Looking at infographic design through the affective lens. IEEE Transactions on Visualization and Computer Graphics, 27(6), 2796–2807. https://doi.org/10.1109/TVCG.2021.3074582
25.
LeeE. W. J.HoS. S. (2018). Are photographs worth more than a thousand words? Examining the effects of photographic–textual and textual-only frames on public attitude toward nuclear energy and nanotechnology. Journalism & Mass Communication Quarterly, 95(4), 948–970. https://doi.org/10.1177/1077699017741090
26.
LeeW. K.WuC. J. (2018). Eye movements in integrating geometric text and figure: Scanpaths and given-new effects. International Journal of Science and Mathematics Education, 16(4), 699–714. https://doi.org/10.1007/s10763-016-9790-2
27.
LiuC. Y.WuC. J. (2022). Effects of working memory and relevant knowledge on reading texts and infographics. Reading & Writing, 36, 2319–2343. https://doi.org/10.1007/s11145-022-10368-1
28.
MajooniA.MasoodM.AkhavanA. (2018). An eye-tracking study on the effect of infographic structures on viewer’s comprehension and cognitive load. Information Visualization, 17(3), 257–266.
29.
MasonL.TornatoraM. C.PluchinoP. (2013). Do fourth graders integrate text and picture in processing and learning from an illustrated science text? Evidence from eye-movement patterns. Computers and Education, 60(1), 95–109. https://doi.org/10.1016/j.compedu.2012.07.011
30.
MayerR. E. (2009). Multimedia learning (2nd ed.). Cambridge University Press.
31.
MengM. (2023). Using eye tracking to study information selection and use in procedures. IEEE Transactions on Professional Communication, 66(1), 208–229. https://doi.org/10.1109/TPC.2022.3228021
32.
OliverM. B.RaneyA. A. (2023). Media effects research in Journalism & Mass Communication Quarterly. Journalism & Mass Communication Quarterly, 100(4), 793–807. https://doi.org/10.1177/10776990231203539
33.
PaasF.SwellerJ. (2022). Implications of cognitive load theory for multimedia learning. In MayerR. E.FiorellaL. (Eds.), The Cambridge handbook of multimedia learning (pp. 73–81). Cambridge University Press.
34.
Schmidt-WeigandF.KohnertA.GlowallaU. (2010). A closer look at split visual attention in system- and self-paced instruction in multimedia learning. Learning and Instruction, 20(2), 100–110. http://doi.org/10.1016/j.learninstruc.2009.02.011
35.
SchroederN. L.CenkciA. T. (2018). Spatial contiguity and spatial split-attention effects in multimedia learning environments: A meta-analysis. Educational Psychology Review, 30(3), 679–701. https://doi.org/10.1007/s10648-018-9435-9
36.
SmithJ. M.RobertsonM. K. (2021). (Info)Graphically inclined: A framework of infographic learning. The Reading Teacher, 74(4), 439–449. https://doi.org/10.1002/trtr.1966
WangT. N.JianY. C.WuC. J.LiP. (2022). Science reading and self-regulated learning: Evidence from eye movements of middle-school readers. The Journal of Educational Research, 115(1), 11–24. https://doi.org/10.1080/00220671.2021.201263
39.
WuC. J.LiuC. Y. (2021). Eye-movement study of students’ scientific argumentations with multiple representations. Physical Review Physics Education Research, 17, 010125. https://doi.org/10.1103/PhysRevPhysEducRes.17.010125
40.
WuC. J.LiuC. Y.YangC. H.WuC. Y. (2021). Children’s reading performances in illustrated science texts: Comprehension, eye movements, and interpretation of arrow symbols. International Journal of Science Education, 43(1), 105–127. https://doi.org/10.1080/09500693.2020.1858515
