Significant digitization efforts have resulted in large multimodal music collections, which comprise music-related documents of various types and formats including text, symbolic data, audio, image, and video. The challenge is to organize, understand, and search musical content in a robust, efficient, and intelligent manner. Key issues concern the development of methods for analysing, correlating, and annotating the available multimodal material, thus identifying and establishing semantic relationships across various music representations and formats. Here, one important task is referred to as music synchronization, which aims at identifying and linking semantically corresponding events present in different versions of the same underlying musical work. In this paper, we give an introduction to music synchronization and show how synchronization techniques can be integrated into novel user interfaces that allow music lovers and researchers to access and explore music in all its different facets thus enhancing human involvement with music and deepening music understanding.
ArifiVlora, ClausenMichael, KurthFrank, and MüllerMeinard. 2004. Synchronization of music data in score-, MIDI- and PCM-format. Computing in Musicology13: 9–33.
2.
BelloJuan Pablo, DaudetLaurent, AbdallahSamer, DuxburyChris, DaviesMike, and SandlerMark B.. 2005. A tutorial on onset detection in music signals.IEEE Transactions on Speech and Audio Processing13(5): 1035–47.
3.
BrownAndrew. 1999. Music, media and making: humanising digital media in music education. International Journal of Music Education33(1): 10–7.
4.
BrownAndrew. 2007. Computers in Music Education. London: Routledge.
5.
BartschMark A., and WakefieldGregory H.. 2005. Audio thumbnailing of popular music using chroma-based representations. IEEE Transactions on Multimedia7(1): 96–104.
6.
DunnJon W., ByrdDonald, NotessMark, RileyJenn, and ScherleRyan. 2006. Variations2: Retrieving and using music in an academic setting. Communications of the ACM, Special Issue49(8): 53–48.
7.
DannenbergRoger, and HuNing. 2003. Polyphonic audio matching for score following and intelligent audio editors. Proceedings of theICMC, San Francisco, USA, 27–34.
8.
DixonSimon. 2007. Evaluation of the audio beat tracking system BeatRoot. Journal of New Music Research36: 39–50.
9.
DannenbergRoger, and RaphaelChristopher. 2006. Music score alignment and computer accompaniment. Communications of the ACM, Special Issue49(8): 39–43.
10.
DixonSimon, and WidmerGerhard. 2005. MATCH: A music alignment tool chest. Proceedings of the ISMIR, London, GB, 492–7.
11.
FujiharaHiromasa, GotoMasataka, OgataJun, KomataniKazunori, OgataTetsuya, and OkunoHiroshi G.. 2006. Automatic synchronization between lyrics and music CD recordings based on Viterbi alignment of segregated vocal signals. Proceedings of the Eighth IEEE International Symposium on Multimedia, 257–64.
12.
FremereyChristian, KurthFrank, MüllerMeinard, and ClausenMichael. 2007. A demonstration of the SyncPlayer system. Proceedings of theISMIR, Vienna, Austria, 131–2.
13.
FremereyChristian, MüllerMeinard, KurthFrank, and ClausenMichael. 2008. Automatic mapping of scanned sheet music to audio recordings. Proceedings of theISMIR, Philadelphia, USA, 413–8.
14.
KlapuriAnssi, and DavyManuel. 2006. Signal processing methods for music transcription. Springer.
15.
KurthFrank, DammDavid, FremereyChristian, MüllerMeinard, and ClausenMichael. 2008. A framework for managing multimodal digitised music collections. Proceedings of the 12th European Conference on Research and Advanced Technology for Digital Libraries (ECDL), 334–45.
16.
KurthFrank, MüllerMeinard, FremereyChristian, ChangYoon-Ha, and ClausenMichael. 2007. Automated synchronization of scanned sheet music with audio recordings. Proceedings of theISMIR, Vienna, Austria, 261–6.
17.
KiralyZsuzsanna. 2003. Solfeggio 1: a vertical ear training instruction assisted by the computer. International Journal of Music Education40(1): 41–58.
18.
LangnerJörg, and GoeblWerner. 2003. Visualizing expressive performance in tempo-loudness space. Computer Music Journal27(4): 69–83.
19.
MüllerMeinard, KurthFrank, DammDavid, FremereyChristian, and ClausenMichael. 2007. Lyrics-based audio retrieval and multimodal navigation in music collections. Proceedings of the 11th European Conference on Digital Libraries (ECDL), 112–23.
20.
MüllerMeinard, KurthFrank, and RöderTido. 2004. Towards an efficient algorithm for automatic score-to-audio synchronization. Proceedings of the ISMIR, Barcelona, Spain, 365–72.
21.
MüllerMeinard, MattesHenning, and KurthFrank. 2006. An efficient multiscale approach to audio synchronization. Proceedings of the ISMIR, Victoria, Canada, 192–7.
22.
MüllerMeinard. 2007. Information retrieval for music and motion. Springer.
23.
RaphaelChristopher. 2004. A hybrid graphical model for aligning polyphonic audio with musical scores. Proceedings of the ISMIR, Barcelona, Spain, 387–94.
24.
SappCraig Stuart.2007. Comparative analysis of multiple musical performances. Proceedings of theISMIR, Vienna, Austria, 497–500.
25.
SmithKenneth H. 2009. The effect of computer-assisted instruction and field independence on the development of rhythm sight-reading skills of middle school instrumental students. International Journal of Music Education27(1): 59–68.
26.
SoulezFerréol, RodetXavier, and SchwarzDiemo. 2003. Improving polyphonic and poly-instrumental music to score alignment. Proceedings of theISMIR, Baltimore, USA, 143–148.
27.
StevensRobin S. 1991. The best of both worlds: An eclectic approach to the use of computer technology in music education. International Journal of Music Education17(1): 24–36.
28.
TuretskyRobert J., and EllisDaniel P. W.. 2003. Ground-truth transcriptions of real music from force-aligned MIDI syntheses. Proceedings of theISMIR, Baltimore, USA, 135–141.
29.
WidmerGerhard, DixonSimon, GoeblWerner, PampalkElias, and TobudicAsmir. 2003. In search of the Horowitz factor. AI Magazine24(3): 111–30.
30.
WangYe, KanMin-Yen, Tin Lay Nwe, Arun Shenoy, and Jun Yin. LyricAlly: automatic synchronization of acoustic musical signals and textual lyrics. In MULTIMEDIA ‘04: Proceedings of the 12th annual ACM international conference on multimedia, 212–219. New York, NY, USA: ACM Press.
