Sage Journals: Discover world-class research

Abstract

This study’s purposes were to develop a rating scale for midlevel band performance and validate a theoretical structure for the scale. Research questions were (a) What qualities describe excellent seventh- and eighth-grade band performance? (b) What items constitute a Midlevel Band Performance Rating Scale (MBPRS)? (c) How reliable is the MBPRS? and (d) Does the MBPRS demonstrate construct validity? Mixed methods were employed, in particular the exploratory sequential design, which has a three-phase variant involving the development of an instrument of assessment. During Phase 1, 20 middle school band directors were asked to provide descriptions of excellent band performance at the middle level, of whom 10 responded. Their statements were grouped into categories and translated into 27 items appropriate for a rating scale. During Phase 2, 151 students participating in four different concert band ensembles at three universities used the items to rate one seventh- and one eighth-grade band performance. After item analyses confirmed their suitability, the 27 items became a Midlevel Band Performance Rating Scale. Internal consistency (coefficient alpha) of the 27 items was good for both sets of ratings, .90 for seventh grade and .92 for eighth grade. Phase 3 established construct validity for the two sets of ratings by confirming that their underlying structures were consistent with previous research.

Keywords

music performance assessment rating scale middle-level band mixed methods

Get full access to this article

View all access options for this article.

References

American Educational Research Association. (2014). Standards for educational and psychological testing. Washington, DC: Author.

ATLAS.ti (2017). (Version 8) [Computer Software]. Berlin, Germany: ATLAS.ti Scientific Software Development GmbH.

Bergee

M. J.

(1988). An application of the facet-factorial approach to scale construction in the development of a rating scale for euphonium and tuba music performance (Doctoral dissertation, University of Kansas, 1987). Dissertation Abstracts International, 49, 1086A.

Bergee

M. J.

(1994, July). Developing a formal construct: Structuring concert band performance via scale assessment. Poster presentation at the meeting of the International Society for Music Education, Tampa, FL.

Bergee

M. J.

(1995). Primary and higher-order factors in a scale assessing concert band performance. Bulletin of the Council for Research in Music Education, 126, 1–14.

Bergee

M. J.

(2004, April). Principal-component instability in concert band performance structure. Paper presented at the biennial meeting of MENC: The National Association for Music Education, Minneapolis, MN.

Bergee

M. J.

(2007). Performer, rater, occasion, and sequence as sources of variability in music performance assessment. Journal of Research in Music Education, 55, 344–358. doi:10.1177/0022429408317515

Bergee

M. J.

(2015). A theoretical structure of high school concert band performance. Journal of Research in Music Education, 63, 145–161. doi:10.1177/0022429415585959

Brittin

R. Y.

(2002). Instrumentalists’ assessment of solo performances with compact disc, piano, or no accompaniment. Journal of Research in Music Education, 50, 63–74. doi:10.2307/3345693

10.

Brown

T. A.

Moore

M. T.

(2012). Confirmatory factor analysis. In Hoyle

R. H.

(Ed.), Handbook of structural equation modeling (pp. 361–379). New York, NY: Guilford Press.

11.

Browne

M. W.

Cudek

(1993). Alternative ways of assuming model fit. In Bolton

K. A.

Lang

J. S.

(Eds.), Testing structural equation models (pp. 136–162). Thousand Oaks, CA: Sage.

12.

Byrne

B. M.

(2016). Structural equation modeling with AMOS (3rd ed.). New York, NY: Routledge.

13.

Cofer

R. S.

(1998). Effects of conducting-gesture instruction on seventh-grade band students’ performance response to conducting emblems. Journal of Research in Music Education, 46, 360–373. doi:10.2307/3345548

14.

Cooksey

J. M.

(1977). A facet-factorial approach to rating high school choral music performance. Journal of Research in Music Education, 25, 100–114. doi:10.2307/3345190

15.

Creswell

J. W.

Plano Clark

V. L.

(2011). Designing and conducting mixed methods research (2nd ed.). Thousand Oaks, CA: Sage.

16.

Creswell

J. W.

Plano Clark

V. L.

Gutmann

M. L.

Hanson

W. E.

(2003). Advanced mixed methods research designs. In Tashakkori

Teddlie

(Eds.), Handbook of mixed methods in social and behavioral research (pp. 209–240). Thousand Oaks, CA: Sage.

17.

DCamp

C. B.

(1980). An application of the facet-factorial approach to scale construction in the development of a rating scale for high school band performance. Dissertation Abstracts International, 41, 1462A.

18.

Fitzpatrick

K. R.

(2006). The effect of instrumental music participation and socioeconomic status on Ohio fourth-, sixth-, and ninth-grade proficiency test performance. Journal of Research in Music Education, 53, 148–161. doi:10.1177/002242940605400106

19.

Fitzpatrick

K. R.

(2016). Points of convergence in music education: The use of data labels as a strategy for mixed methods integration. Journal of Mixed Methods Research, 10, 273–291. doi:10.1177/1558689814560264

20.

Glaser

B. G.

Strauss

A. L.

(1967). The discovery of grounded theory: Strategies for qualitative research. Chicago, IL: Aldine.

21.

Hamann

K. L.

(2003). Identification of expressiveness in small ensemble performances by middle school students. Bulletin of the Council for Research in Music Education, 155, 24–32.

22.

Hewitt

M. P.

(2005a). The effects of model timbre and register differences on middle school brass and woodwind performance. Bulletin of the Council for Research in Music Education, 164, 7–17.

23.

Hewitt

M. P.

(2005b). Self-evaluation accuracy among high school and middle school instrumentalists. Journal of Research in Music Education, 53, 148–161. doi:10.1177/002242940505300205

24.

Johnson

(2017). The effect of symmetrical and asymmetrical peer-assisted learning structures on music achievement and learner engagement in seventh-grade band. Journal of Research in Music Education, 65, 163–178. doi:10.1177/0022429417712486

25.

Kerlinger

F. N.

Lee

H. B.

(2000). Foundations of behavioral research (4th ed.). Belmont, CA: Wadsworth.

26.

Latimer

Bergee

M. J.

Cohen

M. L.

(2010). Reliability and perceived pedagogical utility of a weighted music performance assessment rubric. Journal of Research in Music Education, 58, 168–183. doi:10.1177/0022429410369836

27.

Likert

(1932). A technique for the measurement of attitudes. Archives of Psychology, 140, 5–55.

28.

Lincoln

Y. S.

Guba

E. G.

(1985). Naturalistic inquiry. Thousand Oaks, CA: Sage.

29.

Martin

(2012). The musical self-efficacy beliefs of middle-school band students: An investigation of sources, meanings, and relationships with attributions for success and failure. Bulletin of the Council for Research in Music Education, 191, 45–60. doi:10.5406/bulcouresmusedu.191.0045

30.

Miksza

Prichard

Sorbo

(2012). An observational study of intermediate band students’ self-regulated practice behaviors. Journal of Research in Music Education, 53, 148–161. doi:10.1177/0022429412455201

31.

Morrison

S. J.

(2000). Effect of melodic context, tuning behaviors, and experience on the intonation accuracy of wind players. Journal of Research in Music Education, 53, 148–161. doi:10.2307/3345455

32.

Morrison

S. J.

Montemayor

Wiltshire

E. S.

(2004). The effect of a recorded model on band students’ performance self-evaluations, achievement, and attitude. Journal of Research in Music Education, 52, 116–129. doi:10.2307/3345434

33.

Nunnally

J. C.

Bernstein

I. H.

(1994). Psychometric theory (3rd ed.). New York, NY: McGraw-Hill.

34.

Russell

B. E.

(2015). An empirical study of a solo performance assessment model. Journal of Research in Music Education, 33, 359–371. doi:10.1177/0255761415581282

35.

Sagen

D. P.

(1983). The development and validation of a university band performance rating scale. Journal of Band Research, 18(2), 1–11.

36.

Smith

D. T.

(2009). Development and validation of a rating scale for wind jazz improvisation performance. Journal of Research in Music Education, 57, 217–235. doi:10.1177/0022429409343549

37.

Spector

P. E.

(1992). Summated rating scale construction: An introduction. Thousand Oaks, CA: Sage.

38.

Strauss

Corbin

(1990). Basics of qualitative research: Grounded theory procedures and techniques. Thousand Oaks, CA: Sage.

39.

Tashakkori

Teddlie

(Eds.). (2003). Handbook of mixed methods in social and behavioral research. Thousand Oaks, CA: Sage.

40.

Thorndike

R. M.

Thorndike-Christ

T. M.

(2011). Measurement and evaluation in psychology and education (8th ed.). Boston, MA: Pearson.

41.

West

S. G.

Taylor

A. B.

(2012). Model fit and model selection in structural equation modeling. In Hoyle

R. H.

(Ed.), Handbook of structural equation modeling (pp. 209–231). New York, NY: Guilford Press.

42.

Zdzinski

S. F.

(1991). Measurement of solo instrumental music performance: A review of literature. Bulletin of the Council for Research in Music Education, 109, 47–58.

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.66 MB

0.00 MB

Development and Validation of a Scale Assessing Midlevel Band Performance: A Mixed Methods Study

Abstract

Keywords

Get full access to this article

References

Supplementary Material