This literature review, conducted in the context of a doctoral research in human-computer interaction, explores innovative strategies for adapting illustrations to meet the needs of visually impaired children. The focus is on the integration of haptic and multisensory technologies in interactive illustrations for narration content. Technological advances, such as programmable electronic devices, enhance reader engagement and create immersive illustrations and storytelling experiences. Key initiatives include the development of haptic scenarios, tactile illustrations, and vibrotactile interfaces, highlighting their educational potential. These advances continue to evolve with the development of technical devices and associated methodologies.
ValenteDChennazLArchambaultD, et al.Comprehension of a multimodal book by children with visual impairments. Br J Vis Impair2024; 42(1): 276–286. DOI: 10.1177/02646196231172071.
2.
BaraFGentazEValenteD. The effect of illustrations on the reading process of tactile books: an exploratory study. J Vis Impair Blind (JVIB)2018; 112(6).
3.
MascleCJouffraisCKaminskiG, et al.Des ronds de texture pour illustrer les livres tactiles: observations de séances de lecture avec des enfants déficients visuels. In: ANAE. Construire une école Inclusive2022; 177: 265–273.
4.
NormanJ. Tactile picture books: their importance for young blind children. Br J Vis Impair2003; 21(3): 111–114. DOI: 10.1177/026461960302100305.
5.
NormanJ. If I remember rightly – tactile illustrations enable greater access to books. Br J Vis Impair2004; 22(2): 71–73. DOI: 10.1177/0264619604046641.
6.
MascleCValenteDBaraF. Recherche participative pour favoriser l’entrée dans la lecture de jeunes enfants déficients visuels. ANAE2024; 189: 159–164.
7.
ValenteD. Tactile books for blind children: a design for all approach. In: 11th EAD conference proceedings: the value of design research, Sheffield: Sheffield Hallam University, 2016. DOI: 10.7190/ead/2015/88.
8.
ArchambaultDNegrerieSBlainS. Design of augmented tactile books for blind children. J Tech Persons Disabil2022; 10.
9.
FadlaouiYArchambaultD. Augmented tactile book: design of a multisensory page prototype. In: AchambaultDKouroupetroglouG (eds) Studies in health technology and informatics. Amsterdam: IOS Press, 2023, pp. 543–550. DOI: 10.3233/SHTI230675.
10.
ZhaoSLehmanJIsrarA, et al.Using haptic inputs to enrich story listening for young children. In: Proceedings of the 14th international conference on interaction design and children, Boston, MA: ACM, 2015, pp. 239–242. DOI: 10.1145/2771839.2771886.
11.
AliIZhaoSSchwaljeK, et al.Feel effects: enriching storytelling with haptic feedback. Trans Appl Percept2014; 11(3): 1–17. DOI: 10.1145/2641570.
12.
YannierNYannierNIsrarA, et al.FeelSleeve: haptic feedback to enhance early reading. In: Proceedings of the 33rd annual ACM conference on human factors in computing systems, Seoul Republic of Korea: ACM, 2015, pp. 1015–1024. DOI: 10.1145/2702123.2702396.
13.
ZahoSAliIKlatzkyR. Intermanual apparent tactile motion on handheld tablets. In: 2015 IEEE world haptics conference (WHC), Evanston, IL: IEEE, 2015, pp. 241–247. DOI: 10.1109/WHC.2015.7177720.
14.
AliIKimS-CStecJ, et al.Surround haptics: tactile feedback for immersive gaming experiences. In: CHI ’12 extended abstracts on human factors in computing systems. Austin, TX, USA: ACM, 2012, pp. 1087–1090. DOI: 10.1145/2212776.2212392.
15.
AliIPoupyrevI. Tactile brush: drawing on skin with a tactile grid display. In: Proceedings of the SIGCHI conference on human factors in computing systems, Vancouver, BC, Canada: ACM, 2011, pp. 2019–2028. DOI: 10.1145/1978942.1979235.
16.
IsrarAPoupyrevI. Control space of apparent haptic motion. In: 2011 IEEE world haptics conference, Istanbul: IEEE, 2011, pp. 457–462. DOI: 10.1109/WHC.2011.5945529.
17.
AliIPoupyrevI. Exploring surround haptics displays. In: CHI ’10 extended abstracts on human factors in computing systems. Atlanta, GA, USA: ACM, 2010, pp. 4171–4176. DOI: 10.1145/1753846.1754121.
18.
AliIZhaoSSchwemlerZ, et al.Stereohaptics toolkit for dynamic tactile experiences. In: HCI international 2019 – late breaking papers. Ed. by Constantine Stephanidis. Vol. 11786. Series Title: Lecture notes in computer science. Cham: Springer International Publishing, 2019, pp. 217–232. DOI: 10.1007/978-3-030-30033-3_17.
19.
ZhaoSSchwemlerZFritzA, et al.Stereo haptics: designing haptic interactions using audio tools. In: Proceedings of the TEI ’16: tenth international conference on tangible, embedded, and embodied interaction, Eindhoven, Netherlands: ACM, 2016, pp. 778–781. DOI: 10.1145/2839462.2854120.
20.
AliISchwemlerZBedfordJ, et al.Stereohaptics: a haptic interaction toolkit for tangible virtual experiences. In: ACM SIGGRAPH 2016 studio, Anaheim, CA: ACM, 2016, pp. 1–57. DOI: 10.1145/2929484.2970273.
21.
SullivanJLDunkelbergerNBradleyJ, et al.Multi-sensory stimuli improve distinguishability of cutaneous haptic cues. IEEE Trans Haptics2020; 13(2): 286–297. DOI: 10.1109/TOH.2019.2922901.
22.
DunkelbergerNSullivanJBradleyJ, et al.Conveying language through haptics: a multi-sensory approach. In: Proceedings of the 2018 ACM international symposium on wearable computers, Singapore: ACM, 2018, pp. 25–32. DOI: 10.1145/3267242.3267244.
23.
ChenJTurcottJCastilloP, et al.Learning to feel words: a comparison of learning approaches to acquire haptic words. In Proceedings of the 15th ACM symposium on applied perception, Vancouver, BC, Canada: ACM, 2018, pp. 1–7. DOI: 10.1145/3225153.3225174.
24.
PezentEIsrarASamadM, et al.Tasbi: multisensory squeeze and vibrotactile wrist haptics for augmented and virtual reality. In: 2019 IEEE world haptics conference (WHC), Tokyo, Japan: IEEE, 2019, pp. 1–6. DOI: 10.1109/WHC.2019.8816098.
25.
PezentEMacklinAYauJM, et al.Multisensory pseudo-haptics for rendering manual interactions with virtual objects. Adv Int Sys2023; 5(5): 2200303. DOI: 10.1002/aisy.202200303.
26.
PezentECambioBO’MalleyMK. Syntacts: open-source software and hardware for audio-controlled haptics. IEEE Trans Haptics2021; 14(1): 225–233. DOI: 10.1109/TOH.2020.3002696.
27.
PezentEIsrarASamadM, et al.Explorations of wrist haptic feedback for AR/VR interactions with Tasbi. In: Extended abstracts of the 2020 CHI conference on human factors in computing systems, Honolulu, HI, USA: ACM, 2020, pp. 1–4. DOI: 10.1145/3334480.3383151.
28.
PezentEAgarwalPHartcher-OrBrienJ, et al.Design, control, and psychophysics of Tasbi: a force-controlled multimodal haptic bracelet. IEEE Trans Robot2022; 38(5): 2962–2978. DOI: 10.1109/TRO.2022.3164840.
29.
PezentEO’MalleyMKIsrarA, et al.Explorations of wrist haptic feedback for AR/VR interactions with Tasbi. In: Adjunct proceedings of the 35th annual ACM symposium on user interface software and technology, Bend, OR, USA: ACM, 2022, pp. 1–5. DOI: 10.1145/3526114.3558658.
30.
ValenteDBaraFAfonso-JacoA, et al.La perception tactile des propriétés spatiales des objets chez les personnes aveugles. Enfance2021; 1(1): 69–84. DOI: 10.3917/enf2.211.0069.
31.
ValenteDPalamaAGentazE. Exploring 3D miniatures with action simulations by finger gestures: Study of a new embodied design for blind and sighted children. PLoS One2021; 16(2): e0245472. DOI: 10.1371/journal.pone.0245472. Ed. by Tiago Guerreiro.
32.
ValenteDPalamaAMalsertJ, et al.Adults’ visual recognition of actions simulations by finger gestures (ASFGs) produced by sighted and blind individuals. PLoS One2019; 14(3): e0214371. DOI: 10.1371/journal.pone.0214371, Ed. by Welber Marinovic.
33.
MascleCJouffraisCKaminskiG, et al.Displaying easily recognizable tactile pictures: a comparison of three illustration techniques with blind and sighted children. J Appl Dev Psychol2022; 78: 101364. DOI: 10.1016/j.appdev.2021.101364.
34.
MascleCJouffraisCKaminskiG, et al.Tactile perception of line and dotted pictograms by sighted and blind people. In: Année Psychol2023; 123(4): 587–612. DOI: 10.3917/anpsy1.234.0587.
35.
MascleCJouffraisCKaminskiG, et al.Tactile pictograms displayed on pin array tablets for blind children. In: 2022 IEEE haptics symposium (HAPTICS), Santa Barbara, CA, USA: IEEE, 2022, pp. 1–5. DOI: 10.1109/HAPTICS52432.2022.9765607.
36.
MascleCJouffraisCKaminskiG, et al.Vers l’utilisation de pictogrammes affichables sur des tablettes à picots rétractables pour l’illustration de livres tactiles: importance de la résolution de la tablette. In: Actes de la 10ème conférence sur les environnements informatiques pour l’Apprentissage humain, Fribourg: Marie Lefevre and Christine Michel, 2021, pp. 348–353.
37.
FadlaouiYArchambaultD. Conception d’un prototype, d’une illustration multisensorielle. In: Des solutions personnalisées pour des besoins spécifiques. Paris: Ifrath, 2024, pp. 151–155.
38.
ReveszG. Psychology and art of the blind. Longmans: Green, 1952.
39.
EdirisingheCPodariNCheokAD. A multi-sensory interactive reading experience for visually impaired children; a user evaluation. Personal Ubiquitous Comput2018; 26(3): 807–819. DOI: 10.1007/s00779-018-1127-4.
40.
NishinoHPodariNSiniS, et al.Alice and her friend: a black “picture book” of multisensory interaction for visually-impaired children. In: Proceedings of the 13th international conference on advances in computer entertainment technology, Osaka, Japan: ACM, 2016, pp. 1–6. DOI: 10.1145/3001773.3001783.
IreneP. Crafting tools for textile electronic making. In: Proceedings of the 2017 CHI conference extended abstracts on human factors in computing systems, Denver, CO, USA: ACM, 2017, pp. 409–412. DOI: 10.1145/3027063.3052972.
44.
IreneP. Crafting stories: smart and electronic textile craftsmanship for interactive books. In: Proceedings of the fifteenth international conference on tangible, embedded, and embodied interaction, Salzburg, Austria: ACM, 2021, pp. 1–12. DOI: 10.1145/3430524.3446076.
45.
HonauerMMoorthyPHorneckerE. Interactive Soft toys for infants and toddlers - design recommendations for age-appropriate play. In: Proceedings of the annual symposium on computer-human interaction in play, Barcelona, Spain: ACM, 2019, pp. 265–276. DOI: 10.1145/3311350.3347147.
46.
MoorthyPHonauerMHorneckerE, et al.Hello world: a children’s touch and feel books enhanced with DIY electronics. In: Proceedings of the 16th international conference on mobile and ubiquitous multimedia, Stuttgart, Germany: ACM, 2017, pp. 481–488. DOI: 10.1145/3152832.3157811.
47.
ValenteDMascleCChennazL, et al.Améliorer les illustrations dans les livres jeunesse à destination des enfants avec un handicap visuel: cinq pistes d’adaptation proposées ou validées par la recherche. RIHV2024; 1. DOI: 10.5077/journals/rihv.2024.e1624.
48.
KaraoğluSGünayAVeryeri AlacaI. Designing a crossover multisensory picturebook with older adults at a care home. Design Res Soc DRS Dig Lib2024; 2. DOI: 10.21606/drs.2024.780.
