Rating scales are standard instruments in psychology. They force the research participant to provide a numerical estimate of an assumed “degree” of some characteristic along a linear scale. We prove that such numerical estimates are artifacts based on unknown psychological processes that are used in the making of a rating. Psychology’s current use of rating scales entails reliance upon unexplored and abbreviated introspection. It superimposes upon the rater the use of real numbers for the subjective construction of the ratings. The axiomatic superimposition of the notion of “degree” of subjective estimates by the rating task overlooks the qualitative (structural) relation between the implied opposites. We propose the reconstruction of the rating tasks into a method that accesses the process of meaning construction by the rater. When the rater faces a rating task, a field of meanings is constructed in terms of dialogical oppositions. These oppositions can be observed to lead to the moment of subjective synthesis (the rating outcome). Examples are given of the tracing of the process of subjective synthesis from an empirical study using NEO PI items. We claim that reconstruction of the rating task in terms of the study of microgenesis of rating processes allows psychology access to the reality of the workings of the human mind.
Boring, E.G. ( 1923). Intelligence as the tests test it. The New Republic, 35, 35-37.
2.
Costa, P.T., Jr., & McCrae, R.R. (1992). NEO PI-R professional manual . Odessa, FL: Psychological Assessment Resources, Inc.
3.
Danziger, K. ( 1988). A question of identity: Who participated in psychological experiements? In J.G. Morawski (Ed.), The rise of experimentation in American psychology (pp. 35-53). New Haven, CT: Yale University Press.
4.
Danziger, K. ( 1990a). Constructing the subject: Historical origins of psychological research. Cambridge, UK: Cambridge University Press.
5.
Danziger, K. ( 1990b). Statistical method and the historical development of research practice in American psychology. In L. Kruger, G. Gigerenzer, & M.S. Morgan (Eds.), The probabilistic revolution (Vol. 2, pp. 35-49). Cambridge, MA: MIT Press.
6.
Diriwächter, R., Valsiner, J., & Sauck, C. ( 2004). Microgenesis in making sense of oneself: Constructive recycling of personality inventory items. Forum: Qualitative Social Research, 6(1), Article 11. Retrieved from http://nbn-resolving.de/urn:nbn:de:0114-fqs0501113
Gergen, K. ( 1985). The social constructionist movement in modern psychology . American Psychologist, 40, 266-275.
9.
Gigerenzer, G. ( 1990). Probabilistic thinking and the fight against subjectivity . In L. Kruger, G. Gigerenzer, & M.S. Morgan (Eds.), The probabilistic revolution (pp. 11-35). Cambridge, MA: MIT Press.
10.
Gigerenzer, G., Todd, P., & the ABC Group. (1999). Simple heuristics that make us smart. New York, NY: Oxford University Press.
11.
Hornstein, G.A. ( 1988). Quantifying psychological phenomena: Debates, dilemmas and implications. In J.G. Morawski (Ed.), The rise of experimentation in American psychology (pp. 1-35). New Haven, CT: Yale University Press.
12.
Howard, G. ( 1994). Why do people say nasty things about self-reports? Journal of Organizational Behavior, 15, 399-404.
13.
Josephs, I. ( 2000). A psychological analysis of a psychological phenomenon: The dialogical construction of phenomenon: The dialogical construction of meaning. Social Science Information, 39, 115-129.
14.
Knorr-Cetina, K. ( 1999). Epistemic cultures: How the sciences make knowledge. Cambridge, MA: Harvard University Press.
15.
Kusch, M. ( 1999). Psychological knowledge: A social history and philosophy . London, UK: Routledge.
16.
Lewin, K. ( 1933a). Environmental forces. In C. Murchison (Ed.), A handbook of child psychology (Vol. 2, pp. 590-625). Worcester, MA: Clark University Press.
17.
Lewin, K. ( 1933b). The definition of a field at a given point in time. Psychological Review, 50, 292-310.
18.
Lewin, K. ( 1936). Principles of topological psychology. New York, NY: McGraw-Hill.
19.
Lewin, K. ( 1939). Field theory and experiments in psychology: Concepts and methods. American Journal of Sociology, 44, 868-896.
20.
Likert, R. ( 1932). A technique for the measurement of attitudes. Archives of Psychology, 140, 5-53.
21.
Lustina, M.J. ( 2004). A comparison of Andrich’s scale model and Rost’s successive interval model. Unpublished doctoral thesis, University of Texas at Austin.
22.
McReynolds, P., & Ludwig, K. ( 1984). Christian Thomasius and the origin of psychological rating scales. Isis, 75, 546-553.
23.
Michell, J. ( 1997). Quantitative science and the definition of measurement in psychology. British Journal of Psychology, 88, 355-383.
24.
Michell, J. ( 1999). Measurement in psychology. Cambridge , UK: Cambridge University Press.
25.
Michell, J. ( 2000). Normal science, pathological science and psychometrics . Theory & Psychology, 10, 639-667.
26.
Michell, J. ( 2003). The quantitative imperative: Positivism, naïve realism and the place in quantitative methods in psychology, Theory & Psychology, 13, 5-31.
27.
Michell, J. ( 2005). The meaning of the quantitative imperative: A response to Niaz. Theory & Psychology, 15, 257-263.
28.
Molenaar, P.C. ( 2004). A manifesto on psychology as idiographic science: Bringing the person back into scientific psychology, this time forever. Measurement: Interdisciplinary Research and Perspectives, 2, 201-218.
29.
Molenaar, P.C., Huizenga, H., & Nesselroade, J. (2003). The relationship between the structure of inter-individual and intra-individual variability. In U. Staudinger & U. Lindenberger (Eds.), Understanding human development (pp. 339-360). Dordrecht, The Netherlands: Kluwer.
30.
Molenaar, P.C., & Valsiner, J. ( 2005). How generalization works through the single case: A simple idiographic process of individual psychotherapy case. International Journal of Idiographic Science, 1, 1-13.
31.
Morawski, J.G. ( 1988a). Impossible experiments and practical constructions: The social bases of psychologists’ work. In J.G. Morawski (Ed.), The rise of experimentation in American psychology (pp. 72-94). New Haven, CT: Yale University Press.
32.
Morawski, J.G. ( 1988b). Introduction. In J.G. Morawksi (Ed.), The rise of experimentation in American psychology (pp. vii-xvii). New Haven, CT: Yale University Press.
33.
Ramul, K. ( 1963). Some early measurements and ratings in psychology. American Psychologist, 18, 653-659.
34.
Rosenbaum, P.J., & Auerbach, C. ( 2008, August). A dialogical view of depression. Paper presented at the 5th International Conference on the Dialogical Self, Cambridge, UK.
35.
Rosenbaum, P.J., & Valsiner, J. ( 2004, August). The dialogical imperative of the rating process: How meanings emerge in the use of rating scales. In T. Zittoun (Chair), Symposium 11. Conducted at the 3rd International Conference on the Dialogical Self, Warsaw, Poland.
36.
Saville, P., & Wilson, E. ( 1991). The reliability and validity of normative and ipsative approaches in the measurement of personality. Journal of Occupational Psychology, 64, 219-238.
37.
Schwarz, N. ( 1999). Self-reports: How the questions shape the answer. American Psychologist, 54, 93-105.
38.
Silva, F. ( 1993). Psychometric foundations and behavioural assessment. Newbury Park, CA: Sage.
39.
Surgan, S. ( 2001). Is random error useful for developmental psychology?Forum: Qualitative Social Research, 2(3), Article 19. Retrieved from http://nbn-resolving.de/urn:nbn:de:0114-fqs0103190
40.
Tenopyr, M. ( 1988). Artifactual reliability of forced-choice scales. Journal of Applied Psychology, 73, 749-751.
41.
Thompson, N.S., & Valsiner, J. ( 2002). Doesn’t a dance require dancers? Behavioral and Brain Sciences, 25, 641-642.
42.
Thurstone, L. ( 1927). Psychophysical analysis. American Journal of Psychology, 38, 368-389.
43.
Toomela, A. ( 2007). Culture of science: Strange history of the methodological thinking in psychology. Integrative Psychological and Behavioral Sciences, 1, 6-20.
44.
Valsiner, J. ( 2005). Affektive entwicklung im kulturellen context [Affective development in cultural context]. In Enzyklopädie der psychologie: Vol. 3. Soziale, emotionale und personlichkeitsenwicklung [Encyclopedia of psychology: Vol. 3. Social, emotional and personality development] (pp. 677-728). Göttingen, Germany: Hogrefe.
45.
Valsiner, J., Bibace, R., & LaPushin, T. ( 2005). What happens when a researcher asks a question? In R. Bibace, J.D. Laird , K. Noller, & J. Valsiner (Eds.), Science and medicine in dialogue: Thinking through particulars and universals (pp. 275-288). Westport, CT: Praeger.
46.
Valsiner, J., Diriwächter, R., & Sauck, C. ( 2005). Diversity in unity: Standard questions and non-standard interpretations. In R. Bibace, J.D. Laird, K.L. Noller, & J. Valsiner (Eds.), Science and medicine in dialogue: Thinking through particulars and universals (pp. 289-307). Westport, CT: Praeger.
47.
Wagoner, B., & Valsiner, J. ( 2005). Rating tasks in psychology: From static ontology to dialogical synthesis of meaning. In A. Gülerce, I. Hofmeister, G. Saunders , & J. Kaye (Eds.), Contemporary theorizing in psychology: Global perspectives (pp. 197-213). Toronto, Canada: Captus.
