This research explores the relationship between music and visual art through the visual artworks of four Indonesian students. Focusing on eight paintings inspired by two types of instrumental music, the study employs a qualitative multi-method approach, including Inquiry Graphics and Peircean’s semiotic analysis, to understand the creative process. The study focuses on eight paintings inspired by two instrumental pieces: Yiruma’s “River Flows in You” and Clifford Brown’s “Joy Spring.” Through free-painting experiments and semi-structured interviews, the research results in two key approaches to transduction (intersemiotic translation): one that reflects the formal qualities of music through visual elements and another that interprets the music through the lens of personal and cultural narratives. The result of this study underscores the value of multimodality in art education, showing how this approach enhances creativity and cognitive engagement across disciplines, including music, visual art, fashion, and product design.
AguiarDQueirozJ (2013) Semiosis and intersemiotic translation. Semiotica2013: 196. DOI: 10.1515/sem-2013-0060.
2.
Al FatahG (2017) Analisis Improvisasi Trumpet Pada Lagu “Joy Spring” Karya Clifford Brown (Thesis). Yogyakarta, Indonesia: UPT Perpustakaan ISI Yogyakarta.
3.
AthanasopoulosGAntovićM (2018) Conceptual integration of sound and image: a model of perceptual modalities. Musicae Scientiae22(1): 72–87. DOI: 10.1177/1029864917713244.
4.
BartonGRiddleS (2021) Culturally responsive and meaningful music education: multimodality, meaning-making, and communication in diverse learning contexts. Research Studies in Music Education44(2): 345–362. DOI: 10.1177/1321103x211009323.
5.
BatemanJ. A. (2018a) Peircean semiotics and multimodality: Towards a new synthesis. Multimodal Communication7(1). Available at: https://doi.org/10.1515/mc-2017-0021.
6.
BautistaATanLSPonnusamyLD, et al. (2015) Curriculum integration in arts education: connecting Multiple Art forms through the idea of ‘space. Journal of Curriculum Studies48(5): 610–629. DOI: 10.1080/00220272.2015.1089940.
CanningJ (2007) Pedagogy as a discipline: emergence, sustainability and professionalisation. Teaching in Higher Education12(3): 393–403. DOI: 10.1080/13562510701278757.
9.
CreswellJW (2015) A Concise Introduction to Mixed Methods Research. Thousand Oaks, CA: Sage.
10.
CrowleyS. (2022) Making visible the invisible. Art/Research International. A Transdisciplinary Journal7(1): 156–185. Available at: https://doi.org/10.18432/ari29618.
11.
EdgarIR (1999) The imagework method in health and social science research. Qualitative Health Research9(2): 198–211. DOI: 10.1177/104973299129121785.
12.
ElderfieldJMunroT (1971) Form and style in the arts: an introduction to aesthetic morphology. Leonardo4(4): 391. DOI: 10.2307/1572520.
13.
ElkoshiR (2019) When sounds, colors, and shapes meet: investigating Children’s Audiovisual Art in response to classical music. International Journal of Music Education37(4): 576–592. DOI: 10.1177/0255761419866084.
14.
GiannosKAthanasopoulosGCambouropoulosE (2021) Cross-modal associations between Harmonic Dissonance and visual roughness. Music & Science4: 205920432110554. DOI: 10.1177/20592043211055484.
15.
GreeneTCBellPABoyerWN (1983) Coloring the environment: hue, arousal, and boredom. Bulletin of the Psychonomic Society21(4): 253–254. DOI: 10.3758/bf03334701.
JakobsonRoman. (1959) On Linguistic Aspects of Translation. Achilles Fang et al. On Translation. Cambridge, Mass: Harvard University Press, 232–239.
18.
Jamalus (1988) Panduan Pengajaran Buku Pengajaran Musik Melalui Pengalaman Musik. Yogyakarta, Indonesia: Kanisius.
19.
KandinskyWBahrA (2021) Point and Line to Plane: Contribution to the Analysis of the Pictorial Elements. Zürich, Switzerland: Lars Müller Publishers.
20.
KavanaghD (2004) Ocularcentrism and its others: a framework for metatheoretical analysis. Organization Studies25(3): 445–464. DOI: 10.1177/0170840604040672.
KressG (2000) Multimodality: challenges to thinking about language. Tesol Quarterly34(2): 337. DOI: 10.2307/3587959.
23.
LackovicNatasa (2017) Book review: Collective knowledge arises from multimodal, dialogic intertextuality: Learning in the age of Digital Reason (2017) by Petar Jandric.Knowledge Cultures5(5). Available at: https://doi.org/10.22381/kc5520178, Submitted for publication.
24.
LiuM (2022) Paintings of music. The Journal of Aesthetics and Art Criticism80(2): 151–163. DOI: 10.1093/jaac/kpac003.
25.
MeadowsES (2011) Clifford Brown in Los angeles. Black Music Research Journal31(1): 45. DOI: 10.5406/blacmusiresej.31.1.0045.
26.
MurtiAA (2024) Tinjauan estetika pada permainan piano “River Flows in You” karya Yiruma. Repertoar Jurnal4(2).
NewfieldDR (2009) Transmodal semiosis in classrooms: Case studies from South Africa (thesis). In: Transmodal Semiosis in Classrooms: Case Studies from South Africa. London, UK: University of London.
29.
PlassJLHeidigSHaywardEO, et al. (2014) Emotional design in multimedia learning: effects of shape and color on affect and learning. Learning and Instruction29: 128–140. DOI: 10.1016/j.learninstruc.2013.02.006.
30.
RainerO. (1925) Musikalische graphik: Studien und versuche uber die wechselbeziehungen zwischen ton- und Farbharmonien. Deutscher Verlag fur Jugend und Volk.
31.
RichardBTreichelCJ (2013) Increasing secondary teachers’ capacity to integrate the Arts. The Clearing House: A Journal of Educational Strategies, Issues and Ideas86(6): 224–228. DOI: 10.1080/00098655.2013.826488.
32.
RuscsandaMD (2020) Aspects of the relationship between music and painting and their influence on Schoenberg and Kandinsky. Bulletin of The Transylvania University of Brasov, Series VIII – Performing Arts; 12: 91–100. DOI: 10.31926/but.pa.2019.12.61.21.
33.
ScardamaliaMBereiterC (2006) Knowledge building: theory, pedagogy, and technology. The Cambridge Handbook of the Learning Sciences. New York: Cambridge University Press, 97–115.
Smith-ShankDL (2007) Reflections on semiotics, visual culture, and pedagogy. Semiotica2007: 164. DOI: 10.1515/sem.2007.027.
36.
SookkaewJChongkonPChaikaewN (2022) Technology of digital art for adapting ancient visual art designs. International Journal of Emerging Technology and Advanced Engineering12(8): 125–135. DOI: 10.46338/ijetae0822_16.
37.
SpenceCDi StefanoN (2022) Coloured hearing, colour music, colour organs, and the search for perceptually meaningful correspondences between colour and sound. I-Perception13(3): 20416695221092802. DOI: 10.1177/20416695221092802.
38.
WibisonoS (2023) Photography as cinematic ekphrasis: intermedial study in Garin Nugroho’s opera Jawa. Harmonia: Journal of Arts Research and Education23(1): 64–78. DOI: 10.15294/harmonia.v23i1.39633.
39.
YildirimA.SimsekH. (2005) Qualitative research: Methods in Social Sciences. SeckIn PublIcaItons.
