The purpose of this study was to examine the effects of music experience and excerpt familiarity on the internal consistency of performance evaluations. Participants included nonmusic majors who had not participated in high school music ensembles, nonmusic majors who had participated in high school music ensembles, music majors, and experts (graduate music majors and music faculty). Participants listened to 45 piano performances of two familiar stimuli and one unfamiliar stimulus and rated each for accuracy and musical expression. Fifteen excerpts were repeated within the presentation of stimuli so that internal consistency could be calculated. Results indicated that both expertise and familiarity significantly affected internal consistency and that these two factors interacted significantly. Internal consistency means reflected linear trends, with more experienced groups demonstrating greater internal consistency for both accuracy and expression evaluations. Greater internal consistency was also evidenced for familiar excerpts, although the effect size associated with this variable was modest. Findings suggest that expertise is a salient influence on the consistency of performance evaluations.
Abeles, H.F. (1973). Development and application of a clarinet performance adjudication scale. Journal of Research in Music Education , 21, 246-255.
2.
Bergee, M.J. (1987). An application of the facet-factorial approach to scale construction in the development of a rating scale for euphonium and tuba music performance. Unpublished doctoral dissertation, University of Kansas, Lawrence.
3.
Bergee, M.J. (1988). Use of an objectively constructed rating scale for the evaluation of brass juries: A criterion-related study. Missouri Journal of Research in Music Education, 5, 6-25.
4.
Bergee, M.J. (1993). A comparison of faculty, peer and self-evaluation of applied brass jury performances. Journal of Research in Music Education, 41, 19-37.
5.
Bergee, M.J. (1997). Relationships among faculty, peer and self-evaluations of applied performances. Journal of Research in Music Education , 45, 601-612.
6.
Bergee, M.J. (2003). Faculty interjudge reliability of music performance evaluation. Journal of Research in Music Education, 51, 137-150.
7.
Bergee, M.J. (2006). Validation of a model of extramusical influences on solo and small-ensemble festival ratings. Journal of Research in Music Education, 54, 244-256.
8.
Bergee, M.J., & McWhirter, J.L. (2005). Selected influences on solo and small ensemble festival ratings: Replication and extension. Journal of Research in Music Education, 53, 177-190.
9.
Bergee, M.J., & Westfall, C.R. (2005). Stability of a model explaining selected extramusical influences on solo and small-ensemble festival ratings . Journal of Research in Music Education, 53, 253-271.
10.
Byo, J.L., & Brooks, R. (1994). A comparison of junior high musicians' and music educators' performance evaluations of instrumental music. Contributions to Music Education, 21, 26-38.
11.
Davis, L.P. (1981). The effects of structured singing activities and evaluation practice on elementary band students' instrumental achievement. Unpublished doctoral dissertation, The Ohio State University .
12.
Duerksen, G.L. (1972). Some effects of expectation on evaluation of recorded musical performances. Journal of Research in Music Education , 20, 268-272.
13.
Duke, R.A., & Simmons, A.L. (2006). The nature of expertise: Narrative descriptions of 19 common elements observed in the lessons of three renowned artist-teachers . Bulletin of the Council for Research in Music Education , 170, 7-19.
14.
Fiske, H.E. (1975). Judge-group differences in the rating of secondary school trumpet performances. Journal of Research in Music Education, 23, 186-196.
15.
Fiske, H.E. (1977a). Relationship of selected factors in trumpet performance adjudication. Journal of Research in Music Education, 25, 256-263.
16.
Fiske, H.E. (1977b). Who's to judge: New insights into performance adjudication. Music Educators Journal, 64, 23-25.
17.
Fiske, H.E. (1978). The effect of a training procedure in musical performance evaluation on judge reliability. Ontario Educational Research Council Report.
18.
Friedman, H., Kent, J.R., & Dudek, A. (1992). Instant Pleasure (Version 1.1) [Computer software] . Columbus, OH: Martin Shawn.
19.
Geringer, J.M., Madsen, C.K., MacLeod, R.B., & Droe, K. (2006). The effect of articulation style on perception of modulated tempo. Journal of Research in Music Education , 54, 324-336.
20.
Heath, C.E. (1976). The effect of instruction on the consistency of ratings given in the adjudication of trumpet solo excerpts. Unpublished doctoral dissertation, Indiana University.
21.
Hewitt, M.P. (2002). Self-evaluation tendencies of junior high instrumentalists . Journal of Research in Music Education, 50, 215-226.
22.
Hewitt, M.P. (2005). Self-evaluation accuracy among high school and middle school instrumentalists. Journal of Research in Music Education, 53, 148-161.
23.
Jones, H. (1986). An application of the facet-factorial approach to scale construction in the development of a rating scale for high school vocal solo performance. Unpublished doctoral dissertation, University of Oklahoma.
24.
Kinney, D.W. (2004). The effect of school performing ensemble participation on the ability to perform and perceive expression in music. International Journal of Music Education, 22, 45-58.
25.
Kostka, M.J. (1997). Effects of self-assessment and successive approximations on "knowing" and "valuing" selected keyboard skills. Journal of Research in Music Education, 45, 273-281.
26.
MENC-The National Association for Music Education. (1994). The national standards for arts education: What every young American should know and be able to do in the arts. Reston, VA: Music Educators National Conference.
27.
Morrison, S.J., Montemayer, M., & Wiltshire, E.S. (2004). The effect of a recorded model on band students' performance self-evaluations, achievement and attitude . Journal of Research in Music Education, 52, 116-129.
28.
Nichols, J.P. (1991). A factor analysis approach to the development of a rating scale for snare drum performance. Unpublished doctoral dissertation , University of Iowa.
29.
Roberts, B. (1975). Judge-group differences in the ratings of piano performances. Unpublished master's thesis, University of Western Ontario, London, Canada.
30.
Saunders, T.C., & Holahan, J.M. (1997). Criteria-specific rating scales in the evaluation of high school instrumental performance. Journal of Research in Music Education, 45, 259-272.
31.
Sparks, G.E. (1990). The effect of self-evaluation on musical achievement, attentiveness, and attitudes of elementary school instrumental students. Unpublished doctoral dissertation, Louisiana State University.
32.
Towers, R. (1980). Age-group differences in judge reliability of solo voice performances. Unpublished master's thesis, University of Western Ontario, London, Canada.
33.
Wapnick, J., Flowers, P.J., Alegant, M., & Jasinskas, L. (1993). Consistency in piano performance evaluation. Journal of Research in Music Education, 41, 282-292.
34.
Wapnick, J., Ryan, C., Campbell, L., Deek, P., Lemire, R., & Darrow, A. (2005). Effects of excerpt tempo and duration on musicians' ratings of high-level piano performances. Journal of Research in Music Education, 53, 162-176.
35.
Zdzinski, S.F., & Barnes, G.V. (2002). Development and validation of a string performance rating scale. Journal of Research in Music Education, 50, 245-255.
