Influence of Primary Performance Area,Education Level,and Performance Quality on Pre-Service Music Teachers’ Ratings of String Orchestra Performances

Abstract

The purpose of this study was to examine the influence of primary performance area, education level, and performance quality on pre-service music teachers’ evaluations of middle school string orchestra performances. Participants (N = 78) were pre-service band, choral, and orchestra teachers who self-reported their academic status as lower (n = 39) and upper (n = 39) classmen. Participants assigned ratings to interpretation-musicianship, dynamics, balance/blend, and other factors on a 7-point Likert-type scale with criteria-specific descriptors. Repeated-measures ANOVA tests revealed that participants were able to distinguish between both good and poor performances. Upper classmen pre-service music teachers assigned more favorable ratings to interpretation-musicianship and balance/blend than lower classmen. Pre-service choral teachers gave less favorable ratings than pre-service orchestra teachers for interpretation-musicianship and balance/blend. Descriptive analysis revealed that upper classmen pre-service music teachers assigned more favorable ratings than lower classmen. For all evaluation statements, pre-service choral teachers gave the least favorable ratings and pre-service orchestra teachers assigned the most favorable.

Keywords

education level primary performance area performance quality string orchestra pre-service

Get full access to this article

View all access options for this article.

References

Asmus

(1999). Rubrics: Definitions, benefits, history, and type. Retrieved from the University of Miami Frost School of Music Web site: http://www.music.miami.edu/assessment/rubricsdef.html

Austin

J. R.

(1990). Competition is music education the loser? Music Educators Journal, 76, 21–25. doi: 10.2307/3400964

Barnes

G. V.

, & McCashin

(2005). Practices and procedures in state adjudicated orchestra festivals. Update: Applications of Research in Music Education, 23, 34–41. doi: 10.1177/87551233050230020105

Batey

A. L.

(2002). Take the terror out of adjudication. Teaching Music, 10, 40–46.

Bergee

M. J.

(1993). A comparison of faculty, peer, and self-evaluation of applied brass jury performance. Journal of Research in Music Education, 41, 19–27. doi: 10.2307/3345476

Bergee

M. J.

(1997). Relationships among faculty, peer, and self-evaluations of applied performances. Journal of Research in Music Education, 45, 601–612. doi: 10.2307/3345425

Bergee

M. J.

(2003). Faculty interjudge reliability of music performance evaluation. Journal of Research in Music Education, 51, 137–150. doi: 10.2307/3345847

Blom

, & Poole

(2004). Peer assessment of tertiary music performance: Opportunities for understanding performance assessment and performing through experience and self-refection. British Journal of Music Education, 21, 111–125. doi: 10.1017/S0265051703005539

Boeckman

(2002). Grade inflation in band contest ratings: A trend study. Journal of Band Research, 38, 25–36.

10.

Brakel

T. D.

(2006). Inter-judge reliability of the Indiana State School Music Association high school instrumental festival. Journal of Band Research, 42, 59–69.

11.

Brittin

R. V.

, Sheldon

, & Tian

T. L.

(2002). Instrumentalists in Singapore: Assessment of solo performances with compact disc, piano, or no accompaniment. Bulletin of the Council for Research in Music Education, 153/4, 1–7.

12.

Byo

J. L.

, & Brooks

(1994). A comparison of junior high musicians’ and music educators’ performance evaluations of instrumental music. Contributions to Music Education, 21, 26–38.

13.

Ciorba

C. R.

, & Smith

N. Y.

(2009). Measurement of instrumental and vocal undergraduate juries using a multidimensional assessment rubric. Journal of Research in Music Education, 57, 5–15. doi: 10.1177/0022429409333405

14.

Doerksen

P. F.

(1999). Aural-diagnostic and prescriptive skills of preservice and expert instrumental music teachers. Journal of Research in Music Education, 20, 268–272. doi: 10.2307/3345830

15.

Ekholm

(1997). Evaluation of solo vocal performance: A comparison of students with experts. Update: Applications of Research in Music Education, 16, 3–7.

16.

Fiske

H. E.

(1975). Judge-group differences in the rating of secondary schools trumpet performances. Journal of Research in Music Education, 23, 186–196.

17.

Fiske

H. E.

(1977). Relationship of selected factors in trumpet performance adjudication reliability. Journal of Research in Music Education, 25, 256–263.

18.

Garman

B. R.

, Boyle

J. D.

, & DeCarbo

N. J.

(1991). Orchestra festival evaluations: Interjudge agreement and relationships between performance categories and final ratings. Research Perspectives in Music Education, 2, 19–24.

19.

Geringer

J. M.

, Allen

M. L.

, MacLeod

R. B.

, & Scott

(2009). Using a prescreening rubric for all-state violin selection: Influences of performance and teaching experience. Update: Applications of Research in Music Education, 28, 41–46. doi: 10.1177/8755123309344109

20.

Geringer

J. M.

, & Johnson

C. M.

(2007). Effects of excerpt duration, tempo, and performance level on musician's ratings of wind band performances. Journal of Research in Music Education, 55, 289–301. doi: 10.1177/0022429408317366

21.

Geringer

J. M.

, Madsen

C. K.

, & Dunnigan

(2001). Trumpet tone quality versus intonation revisited: Two extensions. Bulletin of the Council for Research in Music Education, 148, 65–76.

22.

Hassel

B. E.

, & Hassel

E. A.

(2009, December). Race to the top: Accelerating college and career readiness in states. Retrieved from http://www.achieve.org/RTTT-TeacherEffectiveness

23.

Hewitt

M. P.

(2002). Self-evaluation tendencies of junior high instrumentalists. Journal of Research in Music Education, 50, 215–226. doi: 10.2307/3345799

24.

Hewitt

M. P.

(2005). Self-evaluation accuracy among high school and middle school instrumentalists. Journal of Research in Music Education, 53, 148–161. doi: 10.1177/002242940505300205

25.

Hewitt

M. P.

(2007). Influence of primary performance instrument and education level on music performance evaluation. Journal of Research in Music Education, 55, 18–30. doi: 10.1177/002242940705500103

26.

Hewitt

M. P.

, & Smith

B. P.

(2004). The influence of teaching-career level and primary performance instrument on the assessment of musical performance. Journal of Research in Music Education, 52, 314–327. doi: 10.1177/002242940405200404

27.

Hunter

, & Russ

(1996). Peer assessment in performance studies. British Journal of Music Education, 13, 67–78.

28.

Indiana State School Music Association. (1999). Official adjudicator's comment sheet: Bands and orchestras. Indianapolis, IN.

29.

Johnson

C. M.

, & Geringer

J. M.

(2007). Predicting music majors’ overall ratings of wind band performances: Elements of music. Bulletin of the Council for Research in Music Education, 173, 25–38.

30.

Kinney

D. W.

(2009). Internal consistency of performance evaluations as a function of music expertise and excerpt familiarity. Journal of Research in Music Education, 56, 322–337. doi: 10.1177/0022429408328934

31.

Lafferty

(1997). The visual effect of embouchure on the evaluation of young clarinet players. Contributions to Music Education, 24, 73–84.

32.

Lee

(2009, December 10). Districts cautious with state's “race to the top.” Illinois Statehouse News. Retrieved from http://illinois.statehousenewsonline.com/426/districts-cautious-with-state “race-to-the-top”

33.

Madsen

C. K.

, & Geringer

J. M.

(1999). Comparison of good versus bad tone quality/intonation of vocal and string performances: Issues concerning measurement and reliability of the continuous response digital interface. Bulletin of the Council for Research in Music Education, 141, 86–92.

34.

Massel

P. M.

(1978). The influence of voice quality and the visual element on vocal adjudication. Unpublished master's thesis, The University of Western Ontario.

35.

Mills

(1987). Assessment of solo musical performance - a preliminary study. Bulletin of the Council for Research in Music Education, 91, 119–125.

36.

National Association for Music Education. (2011). NAfME position statement on teacher evaluation. Retrieved from http://musiced.nafme.org/about/position-statements/teacher-evaluation

37.

Napoles

(2009). The effect of score use on musicians’ ratings of choral performance. Journal of Research in Music Education, 57, 267–279. doi: 10.1177/0022429409343423

38.

Pope

D. A.

(2012a). The effect of performance quality, audio and video performances, tempo, and adjudicator experience on music majors’ evaluations of string orchestra performances (Doctoral Dissertation). Retrieved from ProQuest Dissertations and Theses. (AAT 1095529936)

39.

Pope

D. A.

(2012b). The effect of score use, performance level, and instrumentation on musicians’ evaluations of orchestral performances. Missouri Journal of Research in Music Education, 49, 17–29.

40.

Repp

B. H.

(1996). The art of inaccuracy: Why pianists’ errors are difficult to hear. Music Perception: An Interdisciplinary Journal, 14, 161–183. doi: 10.2307/40285716

41.

Roberts

(1975). Judge group differences in the rating of piano performances. Unpublished master's thesis, University of Western Ontario.

42.

Rohrer

T. P.

(2002). The debate on competition in music in the twentieth century. Update: Applications of Research in Music Education, 21, 38–47. doi: 1177/87551233020210010501

43.

Schleff

J. S.

(1992). Critical judgments of undergraduate music education students in response to recorded music performances. Contributions to Music Education, 19, 60–74.

44.

Siddell-Strebel

(2007). The effects of non-musical components on the ratings of performance quality (Doctoral dissertation). Retrieved from ProQuest Dissertations and Theses. (AAT NR32324)

45.

Simmons

A. L.

(2005). The relationship between prospective teachers’ tone quality evaluations and their knowledge of wind instrument pedagogy. Update: Applications of Research in Music Education, 23, 42–51. doi: 10.1177/87551233050230020106

46.

Thompson

, & Williamon

(2003). Evaluating evaluation: Musical performance assessment as a research tool. Music Perception: An Interdisciplinary Journal, 21, 21–41.

47.

Wapnick

, & Ekholm

(1997). Expert consensus in solo voice performance evaluation. Journal of Voice, 11, 429–436. doi: http://dx.doi.org/10.1016/S0892-1997(97)80039-2

48.

Wapnick

, Ryan

, Campbell

, Deek

, Lemire

, & Darrow

A. A.

(2005). Effects of excerpt tempo and duration on musicians’ ratings of high-level piano performances. Journal of Research in Music Education, 53, 162–176.

49.

Williams

(2009, December 14). Who would have guessed that the race would look like this? [Web log post] Retrieved from http://www.dfer.org/2009/12/who_would_have.php

50.

Winter

(1993). Music performance assessment: A study of the effects of training and experience on the criteria used by music examiners. International Journal of Music Education, 22, 34–39.