Studying a creative act with computers: Music performance studies with automated discovery methods

Abstract

The purpose of this article is to demonstrate how advanced computer methods may be able to provide new insights into a complex creative activity such as music performance. The context is an inter-disciplinary research project in which Artificial Intelligence (AI) methods are used to analyse patterns in performances by human artists. In asking how the computer can take us closer to an understanding of creativity in music performance, we identify two pertinent research strategies within our project: the use of machine learning algorithms that try to discover common performance principles and thus help separate the “rationally explainable” aspects of performance from the more genuinely “creative” ones, and the use of data mining methods that can discover, visualise and describe performance patterns that seem to be characteristic of the style of particular artists and thus may be more directly related to their individual creativity. Some preliminary results are briefly presented that are indicative of the kinds of discoveries these algorithms can make. Some general issues regarding (musical) creativity and its relation to Artificial Intelligence are also briefly discussed.

Get full access to this article

View all access options for this article.

References

Chen

S. F.

(1995). Bayesian grammar induction for language modeling. In Proceedings of the 33rd Annual Meeting of the Association for Computational Linguistics (pp. 228–35).

Colton

(1999). Refactorable numbers: A machine invention. Journal of Integer Sequences, 2, article 99.1.2.

Dixon

(2001). Automatic extraction of tempo and beat from expressive performances. Journal of New Music Research, 30(1, 39–58.

Dixon

(2003). Analysis of musical content in digital audio. In di Marco

(ed.), Computer Graphics and Multimedia: Applications, Problems, and Solutions (in press).

Dixon

Goebl

Widmer

(2002a). The Performance Worm: Real time visualisation of expression based on Langner's tempo-loudness animation. In Proceedings of the International Computer Music Conference (ICMC'2002) (pp. 361–4). Göteborg, Sweden.

Dixon

Goebl

Widmer

(2002b). Real time tracking and visualisation of musical expression. In Proceedings of the 2nd International Conference on Music and Artificial Intelligence (ICMAI'2002 (pp. 58–68). Edinburgh, Scotland.

Friberg

(1995). A quantitative rule system for musical performance. Doctoral Dissertation, Royal Institute of Technology (KTH), Stockholm, Sweden.

Fürnkranz

(1999). Separate-and-conquer rule learning. Artificial Intelligence Review, 13(1, 3–54.

Gabrielsson

(1999). The performance of music. In Deutsch

(ed.), The psychology of music (2nd ed.) (pp. 501–602). San Diego, CA: Academic Press.

10.

Langner

Goebl

(2002). Representing expressive performance in tempo-loudness space. In Proceedings of the ESCOM Conference on Musical Creativity (CDrom). Liège, Belgium.

11.

Langner

Goebl

(2003). Visualizing expressive performance in tempo-loudness space. Computer Music Journal, 27(4, 69–83.

12.

Lavrac

Dzeroski

(1994). Inductive logic programming. Chichester, UK: Ellis Horwood.

13.

Mitchell

T. M.

(1997). Machine learning. New York, Ny: McGraw-Hill.

14.

Muggleton

King

R.d.

Sternberg

M.J. E.

(1992). Protein secondary structure prediction using logic-based machine learning. Protein Engineering, 5(7, 647–57.

15.

Quinlan

J. R.

(1993). C4.5: Programs for machine learning. San Francisco, CA: Morgan Kaufmann.

16.

Repp

(1992). Diversity and commonality in music performance: An analysis of timing microstructure in Schumann's “Träumerei”. Journal of the Acoustical Society of America, 92(5, 2546–68.

17.

Stamatatos

(2002). Quantifying the differences between music performers: Score vs. norm. In Proceedings of the International Computer Music Conference (ICMC'2002) (pp. 376–82). Göteborg, Sweden.

18.

Stamatatos

Widmer

(2002). Music performer recognition using an ensemble of simple classifiers. In Proceedings of the 15th European Conference on Artificial Intelligence (ECAI'2002) (pp. 335–9). Lyon, France.

19.

Todd

(1989). Towards a cognitive theory of expression: The performance and perception of rubato. Contemporary Music Review, 4, 405–16.

20.

Todd

(1992). The dynamics of dynamics: A model of musical expression. Journal of the Acoustical Society of America, 91, 3540–50.

21.

Valdés-Pérez

R. E.

(1995). Machine discovery in chemistry: New results. Artificial Intelligence, 74(1, 191–201.

22.

Valdés-Pérez

R. E.

(1996). A new theorem in particle physics enabled by machine discovery. Artificial Intelligence, 82(1–2), 331–9.

23.

Widmer

(2000). Large-scale induction of expressive performance rules: First quantitative results. In Proceedings of the International Computer Music Conference (ICMC'2000) (pp. 344–7). Berlin, Germany.

24.

Widmer

(2001a). Using AI and machine learning to study expressive music performance: Project survey and first report. AI Communications, 14(3, 149–62.

25.

Widmer

(2001b). Discovering strong principles of expressive music performance with the PLCG rule learning strategy. In Proceedings of the 11th European Conference on Machine Learning (ECML'01) (pp. 552–63). Freiburg, Germany.

26.

Widmer

(2002a). Machine discoveries: Some simple, robust local expression principles. Journal of New Music Research, 31(1, 37–50.

27.

Widmer

(2002b). In search of the Horowitz Factor: Interim report on a musical discovery project. In Proceedings of the 5th International Conference on Discovery Science (DS'02) (pp. 13–32). Lübeck, Germany.

28.

Widmer

Tobudic

(2003). Playing Mozart by analogy: Learning multi-level timing and dynamics strategies. Journal of New Music Research, 32(3, 259–68.

29.

Windsor

W. L.

Clarke

E. F.

(1997). Expressive timing and dynamics in real and artificial musical performances: Using an algorithm as an analytical tool. Music Perception, 15(2, 127–52.

30.

Witten

I. H.

Frank

(1999). Data mining. San Francisco, CA: Morgan Kaufmann.

31.

Zwicker

Fastl

(2001). Psychoacoustics. Facts and models. Berlin: Springer.