Validation of Two Subjective Rating Systems for Synchronized Swimming

Abstract

The purpose of this study was to investigate the validity of two subjective approaches to judging in synchronized swimming. Scores assigned by nationally accredited officials to 28 solo and 33 duet competitors at the 1977 Senior National AAU Outdoor Synchronized Swimming championships were examined through a multitrait-multimethod matrix. The use of one panel of 7 raters to award both execution and content scores to a performance was compared to an experimental method in which these scores were independently awarded by two panels of raters. An examination of the interrelationships between methods and scores revealed a tendency for the single panel to treat execution and content as one. Further attention to the proposal of two separate panels is recommended.

Get full access to this article

View all access options for this article.

References

Althauser, R. P. Inferring validity from the multitrait-multimethod matrix: another assessment. In H. L. Cosner (Ed.), Sociological Methodology, 1973-74. Washington, D.C.: Jossey-Bass Publishers, 1974.

Alwin, D. F. Approaches to the interpretation of relationships in the multitrait-multimethod matrix. In H. L. Costner (Ed.), Sociological Methodology, 1973-74. Washington, D.C.: Jossey-Bass Publishers, 1974.

Campbell, D. T. and Fiske, D. W. Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 1959, 56, 81-105.

Landers, D. M. Effect of the number of categories systematically observed on individual and group performance ratings. Perceptual and Motor Skills, 1969, 29, 731-735.

Scheer, J. K. and Ansorge, C. J. Effects of naturally induced judges' expectations on the ratings of physical performances. Research Quarterly , 1975, 46, 463-469.

Stephenson, D. A. and Jackson, A. S. The effects of training and position on judges ratings of a gymnastics event. Research Quarterly, 1977, 48, 177-180.

Wilson, V. E. Objectively, validity, and reliability of gymnastic judging. Research Quarterly, 1976, 47, 169-173.