Sage Journals: Discover world-class research

Abstract

I first argue that there are three major currents in the contemporary debate on operationalism. These are: (a) methodologists who criticize operationalism qua philosophy, (b) psychologists who practice operationalization that is allegedly philosophically noncommittal, and (c) critics who claim that psychologists’ validation practices commit them to stronger operationalism than psychologists realize. I then outline respectful operationalism and argue that it avoids the main criticisms of operationalism while incorporating some of the epistemic benefits of operational definitions. I show how respectful operationalism aligns with other operationalism-friendly theories, such as generalizability theory and Michael T. Kane’s argument-based approach to validity.

Keywords

measurement operational definitions operationalism psychometrics realism

Get full access to this article

View all access options for this article.

References

Alexandrova

(2017). A philosophy for the science of well-being. Oxford University Press.

Alexandrova

Haybron

D. M.

(2016). Is construct validation valid? Philosophy of Science, 83(5), 1098–1109. https://doi.org/10.1086/687941

Angner

(2013). Is it possible to measure happiness? European Journal for Philosophy of Science, 3(2), 221–240. https://doi.org/10.1007/s13194-013-0065-2

Bagby

R. M.

Ryder

A. G.

Schuller

D. R.

Marshall

M. B.

(2004). The Hamilton depression rating scale: Has the gold standard become a lead weight? American Journal of Psychiatry, 161(12), 2163–2177. https://doi.org/10.1176/appi.ajp.161.12.2163

Boring

E. G.

(1923). Intelligence as the tests test it. New Republic, 36, 35–37. https://brocku.ca/MeadProject/sup/Boring_1923.html

Borsboom

(2005). Measuring the mind: Conceptual issues in contemporary psychometrics. Cambridge University Press.

Borsboom

(2006). The attack of the psychometricians. Psychometrika, 71(3), 425–440. https://doi.org/10.1007/s11336-006-1447-6

Borsboom

Mellenbergh

G. J.

van Heerden

(2003). The theoretical status of latent variables. Psychological Review, 110(2), 203–219. https://doi.org/10.1037/0033-295X.110.2.203

Bridgman

P. W.

(1927). The logic of modern physics. Macmillan.

10.

Bridgman

P. W.

(1959). The way things are. Harvard University Press.

11.

Carnap

(1950a). Empiricism, semantics, and ontology. Revue Internationale de Philosophie, 4(11), 20–40. https://www.jstor.org/stable/23932367?seq=1

12.

Carnap

(1950b). Logical foundations of probability. University of Chicago Press.

13.

Cartwright

Hardie

(2017). Predicting what will happen when you intervene. Clinical Social Work Journal, 45(3), 270–279. https://doi.org/10.1007/s10615-016-0615-0

14.

Chang

(2004). Inventing temperature: Measurement and scientific progress. Oxford University Press.

15.

Chang

(2009). Operationalism. In Zalta

E. N.

(Ed.), The Stanford encyclopedia of philosophy (Fall 2009 ed.). https://plato.stanford.edu/archives/win2019/entries/operationalism/

16.

Chang

(2017a). Epistemic iteration and natural kinds: Realism and pluralism in taxonomy. In Kendler

Parnas

(Eds.), Issues in psychiatry IV: Classification of psychiatric illnesses (pp. 229–245). Oxford University Press.

17.

Chang

(2017b). Operationalism: Old lessons and new challenges. In Mößner

Nordmann

(Eds.), Reasoning in measurement (pp. 25–38). Routledge.

18.

Coolican

(2014). Research methods and statistics in psychology (6th ed.). Psychology Press.

19.

Cronbach

L. J.

Meehl

P. E.

(1955). Construct validity in psychological tests. Psychological Bulletin, 52(4), 281–302. https://doi.org/10.1037/h0040957

20.

Cronbach

L. J.

Rajaratnam

Gleser

G. C.

(1963). Theory of generalizability: A liberalization of reliability theory. British Journal of Statistical Psychology, 16(2), 137–163. https://doi.org/10.1111/j.2044-8317.1963.tb00206.x

21.

Douglas

(2015). Values in science. In Humphreys

(Ed.), The Oxford handbook of philosophy of science. Oxford University Press. https://doi.org/10.1093/oxfordhb/9780199368815.013.28

22.

Dutilh Novaes

. (2020). Carnapian explication and ameliorative analysis: A systematic comparison. Synthese, 197, 1011–1034. https://doi.org/10.1007/s11229-018-1732-9

23.

Evans

Rooney

B. J.

(2011). Methods in psychological research (2nd ed.). SAGE.

24.

Feest

(2005). Operationism in psychology: What the debate is about, what the debate should be about. Journal of the History of the Behavioral Sciences, 41(2), 131–149. https://doi.org/10.1002/jhbs.20079

25.

Fiske

D. W.

(1971). Measuring the concepts of personality. Aldine.

26.

Flanagan

O. J.

Jr. (1980). Skinnerian metaphysics and the problem of operationism. Behaviorism, 8(1), 1–13. https://www.jstor.org/stable/27758948?seq=1

27.

Frank

P. G.

(1956). The validation of scientific theories. Beacon Press.

28.

Garner

Hake

Eriksen

(1956). Operationism and the concept of perception. Psychological Review, 63(3), 149–159. https://doi.org/10.1037/h0042992

29.

Gillies

D. A.

(1972). Operationalism. Synthese, 25(1/2), 1–24. https://doi.org/10.1007/BF00484997

30.

Gould

S. J.

(1981). The mismeasure of man. W.W. Norton & Company.

31.

Green

C. D.

(1992). Of immortal mythological beasts. Theory & Psychology, 2(3), 291–320. https://doi.org/10.1177/0959354392023003

32.

Gygi

J., A., H.

Schweizer

Grob

(2017). The predictive validity of four intelligence tests for school grades: A small sample longitudinal study. Frontiers in Psychology, 8, Article 375. https://doi.org/10.3389/fpsyg.2017.00375

33.

Hacking

(1983). Representing and intervening: Introductory topics in the philosophy of natural science. Cambridge University Press.

34.

Hamilton

(1960). A rating scale for depression. Journal of Neurology, Neurosurgery, and Psychiatry, 23(1), 56–62. https://doi.org/10.1136/jnnp.23.1.56

35.

Hamilton

White

(1959). Clinical syndromes in depressive states. Journal of Mental Science, 105(441), 985–998. https://doi.org/10.1192/bjp.105.441.985

36.

Haslam

S. A.

McGarty

(2003). Research methods and statistics in psychology. SAGE.

37.

Hempel

C. G.

(1950). Problems and changes in the empiricist criterion of meaning. Revue Internationale de Philosophie, 4(11), 41–63. https://www.jstor.org/stable/23932368?seq=1

38.

Hempel

C. G.

(1954). A logical appraisal of operationism. The Scientific Monthly, 79(4), 215–220. https://www.jstor.org/stable/21072?seq=1

39.

Hempel

C. G.

(1966). Philosophy of natural science. Prentice-Hall.

40.

Hood

S. B.

(2008). Latent variable realism in psychometrics. Indiana University Press.

41.

Howick

Glasziou

Aronson

J. K.

(2013). Problems with using mechanisms to solve the problem of extrapolation. Theoretical Medicine and Bioethics, 34(4), 275–291. https://doi.org/10.1007/S11017-013-9266-0

42.

Hull

D. L.

(1968). The operational imperative: Sense and nonsense in operationism. Systematic Zoology, 17(4), 438–457. https://doi.org/10.2307/2412042

43.

Hyman

S. E.

(2010). The diagnosis of mental disorders: The problem of reification. Annual Review of Clinical Psychology, 6(1), 155–179. https://doi.org/10.1146/annurev.clinpsy.3.022806.091532

44.

Kane

(1982). A sampling model for validity. Applied Psychological Measurement, 6(2), 125–160. https://doi.org/10.1177/014662168200600201

45.

Kane

(2006). In praise of pluralism: A comment on Borsboom. Psychometrika, 71(3), 441–445. https://doi.org/10.1007/s11336-006-1491-2

46.

Kane

(2013). Validating the interpretations and uses of test scores. Journal of Educational Measurement, 50(1), 1–73. https://doi.org/10.1111/jedm.12000

47.

Kane

M. T.

(2016). Validity as the evaluation of the claims based on test scores. Assessment in Education: Principles, Policy & Practice: Validity, 23(2), 309–311. https://doi.org/10.1080/0969594X.2016.1156645

48.

Leahey

T. H.

(1980). The myth of operationism. The Journal of Mind and Behavior, 1(2), 127–143. https://doi.org/10.2307/43852818

49.

Loevinger

(1947). A systematic approach to the construction and evaluation of tests of ability. In Dashiell

J. F.

(Ed.), Psychological monographs (Vol. 61). American Psychological Association.

50.

Lovett

B. J.

Hood

(2011). Realism and operationism in psychiatric diagnosis. Philosophical Psychology, 24(2), 207–222. https://doi.org/10.1080/09515089.2011.558498

51.

Machamer

Darden

Craver

C. F.

(2000). Thinking about mechanisms. Philosophy of Science, 67(1), 1–25. https://doi.org/10.1086/392759

52.

Maraun

M. D.

Gabriel

S. M.

(2013). Illegitimate concept equating in the partial fusion of construct validation theory and latent variable modeling. New Ideas in Psychology, 31(1), 32–42. https://doi.org/10.1016/J.NEWIDEAPSYCH.2011.02.006

53.

Maul

(2017). Rethinking traditional methods of survey validation. Measurement: Interdisciplinary Research and Perspectives, 15(2), 51–69. https://doi.org/10.1080/15366367.2017.1348108

54.

McClimans

(2013). The role of measurement in establishing evidence. Journal of Medicine and Philosophy, 38(5), 520–538. https://doi.org/10.1093/jmp/jht041

55.

McClimans

Browne

Cano

(2017). Clinical outcome measurement: Models, theory, psychometrics and practice. Studies in History and Philosophy of Science, Part A(65–66), 67–73. https://doi.org/10.1016/j.shpsa.2017.06.004

56.

McGrane

J. A.

(2015). Stevens’ forgotten crossroads: The divergent measurement traditions in the physical and psychological sciences from the mid-twentieth century. Frontiers in Psychology, 6, Article 431. https://doi.org/10.3389/fpsyg.2015.00431

57.

Meehl

P. E.

(1995). Bootstraps taxometrics: Solving the classification problem in psychopathology. American Psychologist, 50(4), 266–275. https://doi.org/10.1037/0003-066X.50.4.266

58.

Michell

(1990). An introduction to the logic of psychological measurement. Lawrence Erlbaum Associates.

59.

Michell

(1997). Quantitative science and the definition of measurement in psychology. British Journal of Psychology, 88(3), 355–383. https://doi.org/10.1111/j.2044-8295.1997.tb02641.x

60.

Michell

(2008). Is psychometrics pathological science? Measurement: Interdisciplinary Research & Perspective, 6(1–2), 7–24. https://doi.org/10.1080/15366360802035489

61.

Nersessian

N. J.

(2008). Creating scientific concepts. MIT Press.

62.

Peirce

C. S.

(1878, January). Illustrations of the logic of science II: How to make our ideas clear. Popular Science Monthly, 12, 286–302. https://archive.org/details/popularsciencemo12newy

63.

Peterson

(2018). Methodological empiricism and the choice of measurement models in social sciences. European Journal for Philosophy of Science, 8(3), 831–854. https://doi.org/10.1007/s13194-018-0212-x

64.

Rogers

(1989). Operationism in psychology: A discussion of contextual antecedents and an historical interpretation of its longevity. Journal of the History of the Behavioral Sciences, 25(2), 139–153. https://doi.org/10.1002/1520-6696(198904)25:2<139::AID-JHBS2300250204>3.0.CO;2-E

65.

Rozeboom

(2005). Meehl on metatheory. Journal of Clinical Psychology, 61(10), 1317–1354. https://doi.org/10.1002/jclp.20184

66.

Slaney

Racine

(2013). What’s in a name? Psychology’s ever evasive construct. New Ideas in Psychology, 31(1), 4–12. https://doi.org/10.1016/J.NEWIDEAPSYCH.2011.02.003

67.

Slife

B. D.

Wright

C. D.

Yanchar

S. C.

(2016). Using operational definitions in research: A best-practices approach. The Journal of Mind and Behavior, 37(2), 119–139. https://www.jstor.org/stable/44631540?seq=1

68.

Stevens

S. S.

(1934). The volume and intensity of tones. The American Journal of Psychology, 46(3), 397–408. https://doi.org/10.2307/1415591

69.

Stevens

S. S.

(1935). The operational definition of psychological concepts. Psychological Review, 42(6), 517–527. https://doi.org/http://dx.doi.org/10.1037/h0056973

70.

Thase

Entsuah

Rudolph

(2001). Remission rates during treatment with venlafaxine or selective serotonin reuptake inhibitors. British Journal of Psychiatry, 178(03), 234–241. https://doi.org/10.1192/bjp.178.3.234

71.

Trout

J. D.

(1998). Measuring the intentional world: Realism, naturalism, and quantitative methods in the behavioral sciences. Oxford University Press.

72.

van Fraassen

. (1980). The scientific image. Oxford University Press.

73.

Vessonen

(2019a). Operationalism and realism in psychometrics. Philosophy Compass, 14(10), Article e12624. https://doi.org/10.1111/phc3.12624

74.

Vessonen

(2019b). Representing and constructing: Psychometrics from the perspectives of measurement theory and concept formation [Doctoral dissertation, Cambridge University]. https://doi.org/10.17863/CAM.36695

75.

Watson

J. B.

(1913). Psychology as the behaviorist views it. Psychological Review, 20(2), 158–177. https://doi.org/10.1037/h0074428

76.

Weiskopf

(2009). The plurality of concepts. Synthese, 169(1), 145–173. https://doi.org/10.1007/s11229-008-9340-8

77.

Worboys

(2013). The Hamilton rating scale for depression: The making of a “gold standard” and the unmaking of a chronic illness, 1960–1980. Chronic Illness, 9(3), 202–219. https://doi.org/10.1177/1742395312467658

78.

Yoakum

Yerkes

(1920). Army mental tests. H. Holt & Company.

79.

Zajac

Shrestha

Patel

Poretsky

(2017). The main events in the history of diabetes mellitus. In Poretsky

(Ed.), Principles of diabetes mellitus (3rd ed., pp. 3–19). Springer.

Respectful operationalism

Abstract

Keywords

Get full access to this article

References