Statistical positivism versus critical scientific realism. A comparison of two paradigms for motivation research: Part 1. A philosophical and empirical analysis of statistical positivism
Restricted accessResearch articleFirst published online December, 2018
Statistical positivism versus critical scientific realism. A comparison of two paradigms for motivation research: Part 1. A philosophical and empirical analysis of statistical positivism
In this two-part publication, we compare two paradigms—statistical positivism and critical scientific realism—in their application to research on academic motivation. In the first part, the propositions of statistical positivism and their applications to psychological research are presented. An empirical study in this part combines self-determination and achievement goal theories and builds a statistically integrated model of motivation of 385 college students using path analysis. This part ends with a critical analysis of this statistical model and the knowledge about motivation that it provides. In the second part, the propositions of critical scientific realism are articulated. An empirical study in Part 2 utilizes these propositions and initiates realist interviewing of 12 purposefully selected students. Using within- and between-case analyses, a model of a motivational mechanism of successful university students is proposed. The authors conclude that the continued use of statistical positivism generates minimal new knowledge about the mechanisms of academic motivation. This paradigm should be replaced with the realist one and a case-based methodology, which have a better chance to advance research and improve understanding of academic motivation.
AndersonJ. (2015). Exploring the mechanisms of academic motivation: An integration of self-determination and achievement goal theories from a critical realist perspective (Unpublished Master’s thesis). University of Saskatchewan, Saskatoon, Canada.
2.
BaconF. (2000). The new organon. Cambridge, UK: Cambridge University Press. (Original work published 1620)
3.
BarlowD. H.NockM. K. (2009). Why can’t we be more idiographic in our research?Perspectives on Psychological Science, 4(1), 19–21. doi: 10.1111/j.1745–6924.2009.01088.x
4.
BaumeisterR. F.VohsK. D.FunderD. C. (2007). Psychology as the science of self-reports and finger movements: Whatever happened to actual behavior?Perspectives on Psychological Science, 2(4), 396–403. doi: 10.1111/j.1745–6916.2007.00051.x
5.
BhaskarR. (2008). A realist theory of science. London, UK: Verso. (Original work published 1975)
6.
BickhardM. H. (1992). Myth of science: Misconceptions of science in contemporary psychology. Theory & Psychology, 2, 321–337.
7.
BickhardM. H. (2001). The tragedy of operationalism. Theory & Psychology, 11, 35–44.
8.
BlumerH. (1956). Sociological analysis and the “variable”. American Sociological Review, 21(6), 683–690.
9.
BourdieuP. (2004). Science of science and reflexivity. Chicago, IL: The University of Chicago Press.
10.
BungeM. (2004). Does it work?: The search for explanatory mechanisms. Philosophy of the Social Sciences, 34(2), 182–210.
11.
ByrneD. (2009). Causality and interpretation in qualitative policy-related research. In ByrneD.RaginC. C. (Eds.), The SAGE handbook of case-based methods (pp. 511–521). Los Angeles, CA: Sage.
12.
CapraF.LuisiP. L. (2014). The systems view of life: A unified vision. Cambridge, UK: Cambridge University Press.
13.
CarlsonR. (1971). Where is the person in personality research?Psychological Bulletin, 75(3), 203–219.
14.
CarnapR. (1995). An introduction to the philosophy of science. New York, NY: Dover Publications. (Original work published 1966)
ChirkovV. (2016). Fundamentals of research on culture and psychology: Theory and methods. New York, NY: Routledge.
17.
ChirkovV.AndersonJ. (2018). Statistical positivism versus critical scientific realism. A comparison of two paradigms for motivation research: Part 2. A philosophical and empirical analysis of critical scientific realism. Theory & Psychology, 28, 737–756.
18.
ChirkovV.RyanR. M.WillnessC. (2005). Cultural context and psychological needs in Canada and Brazil: Testing a self-determination approach to internalization of cultural practices, identity and well-being. Journal of Cross-Cultural Psychology, 36(4), 425–443.
19.
CianiK. D.SheldonK. M.HilpertJ. C.EasterM. A. (2011). Antecedents and trajectories of achievement goals: A self-determination theory perspective. British Journal of Educational Psychology, 81, 223–243.
20.
CohenJ. (1994). Earth is round (p < .05). American Psychologist, 49(12), 997–1003.
21.
CrandallC. S.ShermanJ. M. (2016). On the scientific superiority of conceptual replications for scientific progress. Journal of Experimental Social Psychology, 66, 93–99.
22.
CronbachL. J. (1957). The two disciplines of scientific psychology. American Psychologist, 12(11), 671–684.
23.
DanzigerK. (1985). The methodological imperative in psychology. Philosophy of Social Sciences, 15(1), 1–13.
24.
DanzigerK. (1987). Statistical method and the historical development of research practice in American psychology. In KrugerL.GigerenzerG.MorganM. S. (Eds.), The probabilistic revolution (Vol. 2, pp. 35–47). Cambridge MA: MIT Press.
25.
DanzigerK. (1990). Constructing the subject: Historical origin of psychological research. Cambridge, UK: Cambridge University Press.
26.
DanzigerK. (1992). The project of experimental social psychology: Historical perspectives. Science in Context, 5(2), 309–328.
27.
DanzigerK. (2000). Making social psychology experimental: A conceptual history, 1920–1970. Journal of the History of the Behavioral Sciences, 36(4), 329–347.
28.
DanzigerK.DzinasK. (1997). How psychology got its variables. Canadian Psychology, 38(1), 43–48.
29.
DienerE.EmmonsR. A.LarsenR. J.GriffinS. (1985). The satisfaction with life scale. Journal of Personality Assessment, 49, 71–75.
30.
DudaJ. L.ChiL.-K.NewtonM. (1995). Task and ego orientation and intrinsic motivation in sport. International Journal of Sport Psychology, 26, 40–63.
31.
DyrlundA. K. (2009). An examination of the integrative relationship among the factors of achievement goal theory and self-determination theory: Addressing existing problems and missing links (Unpublished PhD thesis). Tallahassee, Florida State University.
32.
ElliotA. J.HullemanC. S. (2017). Achievement goals. In ElliotA. J.DweckD. S.YeagerD. S. (Eds.), Handbook of competence and motivation (2nd ed., pp. 43–60). New York, NY: The Guilford Press.
33.
ElliotA. J.MurayamaK. (2008). On the measurement of achievement goals: Critique, illustration, and application. Journal of Educational Psychology, 100(3), 613–628.
34.
ElmsA. C. (1975). The crisis of confidence in social psychology. American Psychologist, 30, 967–976.
35.
FeestU. (2005). Operationism in psychology: What the debate is about, what the debate should be about. Journal of the History of the Behavioral Sciences, 42(2), 131–149.
36.
FergusonC. J. (2015). “Everybody knows psychology is not a real science”: Public perception of psychology and how we can improve our relationship with policymakers, the scientific community, and the general public. American Psychologist, 70(6), 527–542.
37.
FisherR. A.Sir. (1970). Statistical methods for research workers. Edinburgh, UK: Oliver and Boyd.
38.
FunderD. C. (2009). Naive and obvious questions. Perspectives on Psychological Science, 4(4), 340–344.
39.
GigerenzerG. (1987). The probabilistic revolution in psychology—An overview. In KrugerL.GigerenzerG.MorganM. S. (Eds.), The probabilistic revolution (Vol. 2, pp. 7–9). Cambridge, MA: MIT Press.
40.
GigerenzerG. (1993). The superego, the ego, and the id of statistical reasoning. In KerenG.LewisC. (Eds.), A handbook for data analysis in the behavioral sciences: Methodological issues (pp. 311–339). Hillsdale, NJ: Lawrence Erlbaum Associates.
41.
GilbertD. T.FiskeS. T.LindzeyG. (Eds.). (1996). The handbook of social psychology (4th ed., Vol. 1). Boston, MA: McGraw Hill.
42.
GilbertD. T.KingG.PettigrewS.WilsonT. D. (2016). Comment on “Estimating the reproducibility of psychological science”. Science, 351(6277), 1037-b.
43.
GraceR. C. (2001). On the failure of operationalism. Theory & Psychology, 11, 5–33.
44.
GreenC. D. (1992). Of immortal mythological beasts: Operationism in psychology. Theory & Psychology, 2, 291–320.
45.
HalfpennyP. (2001). Positivism in the twentieth century. In RitzerG.SmartB. (Eds.), Handbook of social theory (pp. 371–385). London, UK: Sage.
46.
HalfpennyP. (2015). Positivism and sociology: Explaining social life. London, UK: Routledge. (Original work published 1982)
47.
HalpinP. F.StamH. J. (2006). Inductive inference or inductive behavior: Fisher and Neyman-Pearson approaches to statistical testing in psychological research (1940–1960). The American Journal of Psychology, 119(4), 625–653.
48.
HammersleyM. (2012). What’s wrong with quantitative research? In CooperB.GlaesserJ.GommR.HammersleyM. (Eds.), Challenging the qualitative-quantitative divide: Explorations in case-focused causal analysis (pp. 27–56). London, UK: Continuum.
49.
HempelC. G. (1942). The function of general laws in history. Journal of Philosophy, 39(2), 35–48.
50.
HempelC. G. (1966). Philosophy of natural science. Englewood Cliffs, NJ: Prentice-Hall.
51.
HempelC. G.OppenheimP. (1948). Studies in the logic of explanation. Philosophy of Science, 15(2), 135–175. doi:10.1086/286983
52.
JohnI. D. (1992). Statistics as rhetoric in psychology. Australian Psychologist, 20(3), 144–149.
53.
JuarreroA. (1999). Dynamics in action: Intentional behavior as a complex system. Cambridge, MA: A Bradford Books.
54.
KochS. (1992). Psychology’s Bridgman vs Bridgman’s Bridgman: An essay in reconstruction. Theory & Psychology, 2, 261–290.
55.
KrugerL.GigerenzerG.MorganM. S. (Eds.). (1987). The probabilistic revolution. Cambridge, MA: MIT Press.
56.
LambdinC. (2012). Significance tests as sorcery: Science is empirical—significance tests are not. Theory & Psychology, 22, 67–90.
57.
LamiellJ. T. (2013). Statisticism in personality psychologists’ use of trait constructs: What is it? How was it contracted? Is there a cure?New Ideas in Psychology, 31, 65–71.
58.
LangfeldH. S. (1945). Symposium on operationism. The Psychological Review, 52(5), 241–294.
59.
LeaheyT. H. (1980). The myth of operationalism. The Journal of Mind and Behavior, 1(2), 127–143.
60.
LilienfeldS. O. (2012). Public skepticism of psychology: Why many people perceive the study of human behavior as unscientific. American Psychologist, 67(2), 111–129.
61.
LykkenD. T. (1968). Statistical significance in psychological research. Psychological Bulletin, 70(3), 151–159.
62.
MandlerG.KessenW. (1964). The language of psychology. New York, NY: Wiley.
63.
ManicasP. T.SecordP. F. (1983). Implications for psychology of the new philosophy of science. American Psychologist, 38(4), 399–413.
64.
MeehlP. E. (2006). When shall we use our heads instead of the formula. In WallerN. G.YonceL. J.GroveW. M.FaustD.LenzenwegerM. F. (Eds.), A Paul Meehl reader: Essays on the practice of scientific psychology (pp. 263–270). Mahwah, NJ: Lawrence Erlbaum.
65.
MichellJ. (2003). The quantitative imperative: Positivism, naive realism and the place of qualitative methods in psychology. Theory & Psychology, 13, 5–31.
66.
MillJ. S. (1965). On the logic of moral sciences. Indianapolis, IN: The Bobbs-Merril Company. (Original work published 1843)
67.
MolenaarP. (2004). A manifesto on psychology as idiographic science: Bringing the person back into scientific psychology, this time forever. Measurement: Interdisciplinary Research and Perspectives, 2(4), 210–218.
MulaikS. A. (1987). Toward a conception of causality applicable to experimentation and causal modeling. Child Development, 58(1), 18–32.
70.
NeckersonR. S. (2000). Null hypothesis significance testing: A review of an old and continuing controversy. Psychological Methods, 5(2), 241–301.
71.
NtoumanisN. (2001). Empirical links between achievement goal theory and self-determination theory in sport. Journal of Sports Sciences, 19, 397–409.
72.
Open Science Collaboration, (2015). Estimating the reproducibility of psychological science. Science, 349(6251), aac4716-aac4716. doi:10.1126/science.aac4716
73.
PancerS. M. (1997). Social psychology: The crisis continues. In FoxD.PrilleltenskyI. (Eds.), Critical psychology: An introduction. London, UK: Sage.
74.
PatnoeS. (Ed.). (1988). A narrative history of experimental social psychology: The Lewin tradition. New York, NY: Springer-Verlag.
75.
PearsonK. (1957). The grammar of science. New York, NY: Meridian Books. (Original work published 1892)
76.
PetrieH. G. (1971). A dogma of operationalism in the social sciences. Philosophy of Social Science, 1(2), 145–160.
77.
PolkinghorneD. (1983). Methodology for the human sciences: Systems of inquiry. Albany: State University of New York Press.
78.
RayC. (2000). Logical positivism. In Newton-SmithW. H. (Ed.), A companion to the philosophy of science (pp. 243–251). Malden, MA: Blackwell.
79.
ReichenbachH. (1958). The rise of scientific philosophy. Berkeley: University of California Press.
80.
RobinsonW. S. (1950). Ecological correlations and the behavior of individuals. American Sociological Review, 15(3), 351–357.
81.
RodriguesA.LevineR. V. (Eds.). (1999). Reflections on 100 years of experimental social psychology. New York, NY: Basic Books.
82.
RorerL. G. (1991). Some myths of science in psychology. In MeehlP. E.CicchettiD.GroveW. M. (Eds.), Thinking clearly about psychology: Essays in honor of Paul E. Meehl. Minneapolis: University of Minnesota Press.
83.
RosnowR. L. (1981). Paradigms in transition: The methodology of social inquiry. New York, NY: Oxford University Press.
84.
RozeboomW. W. (1960). The fallacy of the null-hypothesis significance test. Psychological Bulletin, 57(5), 416–428.
85.
RyanR. M.DeciE. L. (2017). Self-determination theory: Basic psychological needs in motivation, development, and wellness. New York, NY: The Guilford Press.
86.
SalmonW. C. (2000). Logical empiricism. In Newton-SmithW. H. (Ed.), A companion to the philosophy of science (pp. 233–242). Malden, MA: Blackwell.
87.
SayerA. (1992). Methods in social science: A realist approach (2nd ed.). London, UK: Routledge.
88.
SchallerM. (2016). The empirical benefits of conceptual rigor: Systematic articulation of conceptual hypotheses can reduce the risk of non-replicable results (and facilitate novel discoveries too). Journal of Experimental Social Psychology, 66, 107–115.
89.
SenkoC.HullemanC. S.HarackiewiczJ. M. (2011). Achievement goal theory at the crossroads: Old controversies, current challenges, and new directions. Educational Psychologist, 46(1), 26–47.
90.
SmithL. D. (1986). Behaviorism and logical positivism: A reassessment of the alliance. Stanford, CA: Stanford University Press.
91.
SpadishW. R.CookT. D.CampbellD. T. (2001). Experimental and quasi-experimental designs for generalized causal inference. Boston, MA: Houghton Mifflin Company.
92.
StamH. J. (2006). Pythagoreanism, meaning and the appeal to number. New Ideas in Psychology, 24, 240–251.
93.
StandageM.DudaJ. L.NtoumanisN. (2003). A model of contextual motivation in physical education: Using constructs from self-determination and achievement goal theories to predict physical activity intentions. Journal of Educational Psychology, 95(1), 97–110.
94.
ThompsonS. K. (2012). Sampling (3rd ed.). New York, NY: John Wiley & Sons.
95.
TolmanC. W. (Ed.) (1992). Positivism in psychology: Historical and contemporary problems. New York, NY: Springer-Verlag.
96.
ToomelaA. (2008). Variables in psychology: A critique of quantitative psychology. Integrative Psychological and Behavioral Science, 42, 245–265.
97.
ToomelaA. (2010, July). Quantitative methods in psychology: Inevitable and useless. Frontiers in psychology, 1. doi: 10.3389/fpsyg.2010.00029
98.
TsangE. W. K.KwanK.-M. (1999). Replication and theory development in organizational science: A critical realist perspective. Academy of Management Review, 24(4), 759–780.
99.
VallerandR. J.FortierM. S.GuayF. (1997). Self-determination and persistence in a real-life setting: Toward a motivational model of high school dropout. Journal of Personality and Social Psychology, 72, 1161–1176.
100.
ValsinerJ. (1986a). Where is the individual subject in scientific psychology? In ValsinerJ. (Ed.), The individual subject and scientific psychology (pp. 1–14). New York, NY: Plenum Press.
101.
ValsinerJ. (1986b). Between groups and individuals: Psychologists’ and laypersons’ interpretations of correlational findings. In ValsinerJ. (Ed.), The individual subject and scientific psychology (pp. 113–151). New York, NY: Plenum Press.
102.
VansteenkisteM.DuriezB.SimonsJ.SoenensB. (2006). Materialistic values and well-being among business students: Further evidence for their detrimental effect. Journal of Applied Social Psychology, 36(12), 2892–2908.
103.
WatsonD.TellegenA.BartolK. M. (1988). Development and validation of brief measures of positive and negative affect: The PANAS scales. Journal of Personality and Social Psychology, 54, 1063–1070.
104.
ZnanieckiF. (1934). The method of sociology. New York, NY: Rinehart & Company.
