Sage Journals: Discover world-class research

Abstract

This article describes how transportation distances such as the Earth Mover's Distance can be used for measuring melodic similarity for notated music. We represent music notation as weighted point sets in a two-dimensional space of onset time and pitch. The Earth Mover's Distance can then be used for comparing point sets by determining how much work it would take to convert one of the point sets into the other by moving weight between the point sets.

For evaluating how well this method and other methods agree with human perception of melodic similarity, we established a ground truth for the RISM A/II collection based on the opinions of human experts.

The RISM A/II collection contains about half a million musical incipits. For 22 queries, we filtered the collection so that about 50 candidates per query were left, each of which we then presented to about 30 human experts (out of a group of 37 experts) for a final ranking. We present our filtering methods, the experiment design, the resulting ground truth, and a new measure (called “Average Dynamic Recall”) that can be used for comparing different similarity measures with the ground truth.

Get full access to this article

View all access options for this article.

References

Byrd

, & Crawford

(2002). Problems of music information retrieval in the real world. Information Processing and Management, 38, 249–72.

Cooper

W. S.

(1968). Expected search length: A single measure of retrieval effectiveness based on weak ordering action of retrieval systems. Journal of the American Society for Information Science and Technology, 19 (1), 13–41.

Hawking

(2001). Overview of the TREC-9 Web Track. In E. M. Voorhees & D.K. Harman (eds), Proceedings of the 9^th Text Retrieval Conference TREC-9, Gaithersburg, MD.

Howard

(1997). Plaine and easie code: A code for music bibliography. In Selfridge-Field

(ed), Beyond MIDI: The Handbook of Musical Codes. Cambridge, MA: MIT Press.

Järvelin

, & Kekäläinen

(2002a). Cumulated gain-based evaluation of IR techniques. ACM Transactions on Information Systems, 20 (4), 422–46.

Kekäläinen

, & Järvelin

(2002b). Using graded relevance assessments in IR evaluation. Journal of the American Society for Information Science and Technology, 53 (13), 1120–9.

Krumhansl

C. L.

(1990). Cognitive foundations of musical pitch, Oxford: Oxford University Press.

Lemström

, Mäkinen

, Pienimäki

, Turkia

, & Ukkonen

(2003). The C-BRAHMS project. In Proceedings of the Fourth International Conference on Music Information Retrieval (pp. 237–8).

Losee

R. M.

(1998). Text retrieval and filtering: analytic models of performance. Boston: Kluwer Academic.

10.

Lui

S. H.

, Horner

, & Ayers

(2005). MIDI to SP-MIDI transcoding using phrase stealing. In Lewin-Richter

, & Serra

(eds), Proceedings of the 2005 International Computer Music Conference, San Francisco: International Computer Music Association.

11.

Min

(n.d.). Evofunc: evolutionary optimisation function of the library “Reusable Evolutionary Algorithms in Shape Matching” (REALISM). Retrieved from http://www.cs.uu.nl/centers/give/multimedia/matching/shame.html.

12.

Müllensiefen

, & Frieler

(2004). Measuring melodic similarity: Human vs. algorithmic judgments. In R. Parncutt, A. Kessler & F. Zimmer (Eds.), Proceedings of the Conference on Interdisciplinary Musicology CIM04 on CD-ROM. Graz, Austria.

13.

Prechelt

, & Typke

(2001). An interface for melody input. ACM Transactions on Computer-Human Interaction, 8 (2), 133–49.

14.

RISM (2002). Ræpertoire International des Sources Musicales (RISM). Særie A/II, manuscrits musicaux après 1600. München, Germany: K. G. Saur Verlag.

15.

Rocchio

J. J.

(1966). Document retrieval systems — Optimization and evaluation. PhD dissertation. Harvard.

16.

Rubner

, Tomasi

, & Guibas

L. J.

(1998). A metric for distributions with applications to image databases. In Proceedings of the IEEE International Conference on Computer Vision (pp. 59–66), Washington, DC: IEEE Computer Society.

17.

Salton

, & McGill

M. J.

(1983). Introduction to Modern Information Retrieval. New York: McGraw-Hill.

18.

Selfridge-Field

(1998). Conceptual and representational issues in melodic comparison. Computing in Musicology, 11, 3–64.

19.

Shmulevich

, Yli-Harja

, Coyle

, Povel

, & Lemström

(2001). Perceptual issues in music pattern recognition: Complexity of rhythm and key finding. Computers and the Humanities, 35, 23–35.

20.

Typke

, den Hoed

, de Nooijer

, Wiering

, & Veltkamp

R. C.

, (2005). A ground truth for half a million musical incipits. Journal of Digital Information Management, 3 (1), 34–9. Ground truth data available at http://give-lab.cs.uu.nl/orpheus/.

21.

Typke

, Giannopoulos

, Veltkamp

R. C.

, Wiering

, & van Oostrum

, (2003). Using transportation distances for measuring melodic similarity. In Proceedings of the Fourth International Conference on Music Information Retrieval(pp. 107–14).

22.

Typke

, Veltkamp

R. C.

, & Wiering

(2004). Searching notated polyphonic music using transportation distances. In Dongge

(ed), Proceedings of the ACM Multimedia Conference (pp. 128–35), Alpha, NJ: Sheridan Printing.

23.

Voorhees

E. M.

, & Harman

D. K.

(2000). Overview of the eighth Text REtrieval Conference (TREC-8). In E.M. Voorhees & D.K. Harman (eds), Proceedings of the Eighth Text REtrieval Conference (TREC-8), pp. 1–24.

Transportation distances and human perception of melodic similarity

Abstract

Get full access to this article

References