The purpose of this study was to investigate the reliability and perceived pedagogical utility of a multidimensional weighted performance assessment rubric used in Kansas state high school large-group festivals. Data were adjudicator rubrics (N = 2,016) and adjudicator and director questionnaires (N = 515). Rubric internal consistency was moderately high (.88). Dimension reliability ranged from moderately low (W = .47) to moderate (W = .77). Total score reliability was moderately high (W = .80) and rating reliability was moderate (W = .72). Findings suggested that reliability on the whole was within the range of previously researched music performance assessment tools. Questionnaire results suggested that the rubric provided a better instrument for justifying ratings and more detailed descriptions of what constituted acceptable performances than previously researched nonrubric forms; hence, adjudicators and directors perceived the rubric as possessing improved pedagogical utility.
Abeles, H. ( 1973). Development and validation of a clarinet performance adjudication scale. Journal of Research in Music Education , 21, 246-255.
2.
Asmus, E. ( 1999). Rubrics: Definitions, benefits, history, and type. Retrieved from the University of Miami Frost School of Music Web site: http://www.music.miami.edu/assessment/rubricsdef.html
3.
Azzara, C.D. ( 1993). The effect of audiation-based improvisation techniques on musical achievement of elementary music students. Journal of Research in Music Education, 41, 328-342.
Bergee, M.J. ( 1987). An investigation of the facet-factorial approach to scale construction in the development of a rating scale for euphonium and tuba music performance. Dissertation Abstracts International, 49, 1086.
6.
Bergee, M.J. ( 1988). The use of an objectively constructed rating scale for the evaluation of brass juries: A criterion related study. Missouri Journal of Research in Music Education, 5(5), 6-25.
7.
Bergee, M.J. ( 1989). An investigation of the efficacy of using an objectively constructed rating scale for the evaluation of university-level single reed juries. Missouri Journal of Research in Music Education, 26, 74-91.
8.
Bergee, M.J. ( 1997). Relationships among faculty, peer, and self-evaluation of applied performances. Journal of Research in Music Education , 45, 601-612.
9.
Bergee, M.J. ( 2003). Faculty interjudge reliability of music performance evaluation . Journal of Research in Music Education, 51, 137-150.
10.
Burnsed, V., Hinkle, D., & King, S. ( 1985). Performance evaluation reliability at selected concert festivals. Journal of Band Research, 21(1), 22-29.
11.
Ciorba, C.R., & Smith, N.Y. ( 2009). Measurement of instrumental and vocal undergraduate performance juries using a multidimensional assessment rubric. Journal of Research in Music Education, 57, 5-15.
12.
Cooksey, J.M. ( 1977). A facet-factorial approach to rating high school choral music performance. Journal of Research in Music Education , 25, 100-114.
13.
Fiske, H.E., Jr. ( 1975). Judge-group differences in the rating of secondary school trumpet performances. Journal of Research in Music Education , 23, 186-196.
14.
Fiske, H.E., Jr. ( 1977). Relationship of selected factors in trumpet performance adjudication reliability. Journal of Research in Music Education , 25, 256-263.
15.
Garman, B.R., Boyle, J.D., & DeCarbo, N.J. ( 1991). Orchestra festival ratings: Interjudge agreement and relationships between performance categories and final ratings. Research Perspectives in Music Education, 2, 19-24.
16.
Gordon, E. ( 2002). Rating scales and their uses for evaluating achievement in music performance. Chicago: GIA.
17.
Horowitz, R.A. ( 1994). The development of a rating scale for jazz guitar improvisation performance. Dissertation Abstracts International, 11, 3443.
18.
Isaac, S., & Michael, W.B. ( 1997). Handbook in research and evaluation for education and the behavioral sciences. San Diego, CA: Educational and Industrial Testing Services.
19.
Jones, H., Jr. ( 1986). An application of a facet-factorial approach to scale construction in the development of a rating scale for high school solo vocal performance. Dissertation Abstracts International, 47, 1230.
20.
Krippendorff, K. ( 1980). Content analysis: An introduction to its methodology . Newbury Park, CA: Sage.
21.
Latimer, M.E., Jr. ( 2007). Adjudicator reliability: A comparison of the use of state festival choir and global score audition forms. Contributions to Music Education, 34(2), 67-82.
22.
Levinowitz, L.M. ( 1989). An investigation of preschool children’s comparative capability to sing songs with and without words. Bulletin of the Council for Research in Music Education, 100, 14-19.
23.
Menc. (1996). Performance standards for music. Reston, VA: Author.
24.
Menc. (2009). Other solo and ensemble adjudication sheets. Retrieved from http://www.menc.org/resources/view/other-solo-and-ensemble-adjudication-sheets
25.
Nichols, J.P. ( 1991). A factor analysis approach to the development of a rating scale for snare drum performance. Dissertation Abstracts International , 46, 3282.
26.
Norris, C.E. & Borst, J.D. ( 2007). An examination of the reliabilities of two choral festival adjudication forms. Journal of Research in Music Education , 55, 237-251.
27.
Radocy, R.E. ( 1986). On quantifying the uncountable in musical behavior. Bulletin of the Council of Research in Music Education, 88, 22-31.
Rutkowski, J. ( 1990). The measurement and evaluation of children’s singing voice development. Quarterly Journal of Music Teaching and Learning, 1(1/2), 81-95.
30.
Saunders, T.C., & Holahan, J.M. ( 1997). Criteria specific rating scales in the evaluation of high school instrumental performance. Journal of Research in Music Education, 45, 259-272.
31.
Sax, G., & Cormack, T.R. ( 1966). The effects of various forms of item arrangements on test performance. Journal of Educational Measurement, 22, 371-376.
32.
Smith, B.P., & Barnes, G.V. ( 2007). Development and validation of an orchestra performance rating scale. Journal of Research in Music Education, 55, 268-280.
33.
Stevens, D.D., & Levi, A. ( 2005). Introduction to rubrics: An assessment tool to save time, convey effective feedback, and promote student learning. Sterling, VA: Styus.
34.
Whitcomb, R. ( 1999). Writing rubrics for the music classroom. Music Educators Journal, 85(6), 26-32.
35.
Zdzinski, S.F., & Barnes, G.V. ( 2002). Development and validation of a string performance rating scale. Journal of Research in Music Education, 50, 245-255.
