Crediting or blaming theories or auxiliary assumptions for empirical victories or defeats

Abstract

There is no direct way for researchers to test theories. One reason is that theories contain nonobservational terms that refer to unobservable entities. Consequently, researchers add auxiliary assumptions to aid in traversing the distance between theories and empirical hypotheses. The results may confirm the empirical hypothesis, an empirical victory, or the results may disconfirm the empirical hypothesis, an empirical defeat. Either way, it is not clear whether to make an attribution to the theory, the auxiliary assumptions, or both. The present goal is to review techniques researchers have employed, or could employ, that aid in assessing the weight of the evidence with respect to crediting or blaming theories or auxiliary assumptions for empirical victories or defeats.

Keywords

Auxiliary assumption empirical defeat empirical victory theory weight of evidence

Get full access to this article

View all access options for this article.

References

Ajzen

(1988). Attitudes, personality, and behavior. Dorsey.

Ajzen

Fishbein

(1980). Understanding attitudes and predicting social behavior. Prentice-Hall.

Allport

G. W.

(1935). Attitudes. In Murchison

(Ed.), Handbook of social psychology (pp. 798–844). Clark University Press.

Bargh

J. A.

Chen

Burrows

(1996). Automaticity of social behavior: Effects of trait construct and stereotype activation on action. Journal of Personality and Social Psychology, 71(2), 230–244. https://doi.org/10.1037/0022-3514.71.2.230

Baron

R. M.

Kenny

D. A.

(1986). The moderator-mediator variable distinction in social psychological research: Conceptual, strategic, and statistical considerations. Journal of Personality and Social Psychology, 51(6), 1173–1182. https://doi.org/10.1037//0022-3514.51.6.1173

Becker

(1973). The denial of death. Free Press.

Butterfield

(1957). The origins of modern science 1300–1800. The Free Press.

Cohen

(1988). Statistical power analysis for the behavioral sciences (2nd ed.). Erlbaum.

Cronbach

L. J.

Meehl

P. E.

(1955). Construct validity in psychological tests. Psychological Bulletin, 52, 281–302. http://doi.org/10.1037/h0040957

10.

Davidson

A. R.

Jaccard

J. J.

(1975). Population psychology: A new look at an old problem. Journal of Personality and Social Psychology, 31(6), 1073–1082. https://doi.org/10.1037/h0076946

11.

Doyen

Klein

Pichon

C.-L.

Cleeremans

(2012). Behavioral priming: It’s all in the mind, but whose mind? PLOS ONE, 7(1), Article e29081. https://doi.org/10.1371/journal.pone.0029081

12.

Duhem

(1954). The aim and structure of physical theory ( Wiener

, Trans.). Atheneum. (Original work published 1914)

13.

Fanelli

(2012). Negative results are disappearing from most disciplines and countries. Scientometrics, 90(3), 891–904. https://doi.org/10.1007/s11192-011-0494-7

14.

Fiedler

McCaughey

Prager

(2021). Quo vadis, methodology? The key role of manipulation checks for validity control and quality of science. Perspectives on Psychological Science, 16(4), 816–826. https://doi.org/10.1177/1745691620970602

15.

Fishbein

(1980). Theory of reasoned action: Some applications and implications. In Howe

Page

(Eds.), Nebraska symposium on motivation (Vol. 1979, pp. 65–116). University of Nebraska Press.

16.

Fishbein

Ajzen

(1975). Belief, attitude, intention and behavior: An introduction to theory and research. Addison-Wesley.

17.

Fishbein

Ajzen

(2010). Predicting and changing behavior: The reasoned action approach. Psychology Press (Taylor & Francis).

18.

Franco

Malhotra

Simonovits

(2014). Publication bias in the social sciences: Unlocking the file drawer. Science, 345(6203), 1502–1505. https://doi.org/10.1126/science.1255484

19.

Greenberg

Arndt

Simon

Pyszczynski

Solomon

(2000). Proximal and distal defenses in response to reminders of one’s mortality: Evidence of a temporal sequence. Personality and Social Psychology Bulletin, 26(1), 91–99. https://doi.org/10.1177/0146167200261009

20.

Greenberg

Solomon

Veeder

Lyon

Pyszczynski

Rosenblatt

Kirkland

(1990). Evidence for terror management theory II: The effects of mortality salience on reactions to those who threaten or bolster the cultural worldview. Journal of Personality and Social Psychology, 58(2), 308–318. https://doi.org/10.1037/0022-3514.58.2.308

21.

Greenberg

Pyszczynski

Solomon

Simon

Breus

(1994). Role of consciousness and accessibility of death-related thoughts in mortality salience effects. Journal of Personality and Social Psychology, 67(4), 627–637. https://doi.org/10.1037//0022-3514.67.4.627

22.

Grice

J. W.

Cohn

Ramsey

R. R.

Chaney

J. M.

(2015). On muddled reasoning and mediation modeling. Basic and Applied Social Psychology, 37(4), 214–225. https://doi.org/10.1080/01973533.2015.1049350

23.

Hempel

C. G.

(1945). Studies in the logic of confirmation (I.). Mind, 54(213), 1–26. http://www.jstor.org/stable/2250886

24.

Holmberg

M. J.

Andersen

L. W.

(2022). Collider bias. Journal of the American Medical Association, 327(13), 1282–1283. https://doi.org/10.1001/jama.2022.1820

25.

Johnston

V. S.

(1999). Why we feel: The science of human emotions. Perseus Books.

26.

Joober

Schmitz

Annable

Boksa

(2012). Publication bias: What are the challenges and can they be overcome? Journal of Psychiatry & Neuroscience, 37(3), 149–152. https://doi.org/10.1503/jpn.120065

27.

Katzko

M. W.

(2006). A study of the logic of empirical arguments in psychological research: “The automaticity of social behavior” as a case study. Review of General Psychology, 10(3), 210–228. https://doi.org/10.1037/1089-2680.10.3.210

28.

Kellen

D. A.

(2019). Model hierarchy for psychological science. Computional Brain & Behavior, 2(3–4), 160–165. https://doi.org/10.1007/s42113-019-00037-y

29.

Kellen

Davis-Stober

C. P.

Dunn

J. C.

Kalish

M. L.

(2021). The problem of coordination and the pursuit of structural constraints in psychology. Perspectives on Psychological Science, 16(4), 767–778. https://doi.org/10.1177/1745691620974771

30.

Kline

R. B.

(1998). Principles and practice of structural equation modeling. The Guilford Press.

31.

Kline

R. B.

(2015) The mediation myth. Basic and Applied Social Psychology, 37(4), 202–213. https://doi.org/10.1080/01973533.2015.1049349

32.

Kraus

S. J.

(1995). Attitudes and the prediction of behavior: A meta-analysis of the empirical literature. Personality and Social Psychology Bulletin, 21(1), 58–75. https://doi.org/10.1177/0146167295211007

33.

Lakatos

(1978). The methodology of scientific research programmes. Cambridge University Press.

34.

Trafimow

Wang

(2020). User-friendly computer programs so econometricians can run the a priori procedure. Frontiers in Management and Business, 1(1), 2–6. https://doi.org/10.25082/FMB.2020.01.002

35.

MacLin

M. K.

(2020). Experimental design in psychology: A case approach (9th ed.). Routledge.

36.

Maraun

M. D.

(2012). Validity and measurement. Measurement: Interdisciplinary Research and Perspectives, 10(1–2), 80–83. https://doi.org/10.1080/15366367.2012.682523

37.

Meehl

P. E.

(1990a). Appraising and amending theories: The strategy of Lakatosian defense and two principles that warrant using it. Psychological Inquiry, 1(2), 108–141. https://doi.org/10.1207/s15327965pli0102_1

38.

Meehl

P. E.

(1990b). Why summaries of research on psychological theories are often uninterpretable. Psychological Reports, 66(1), 195–244. https://doi.org/10.2466/pr0.1990.66.1.195

39.

Morris

S. D.

Grice

J. W.

Cox

R. A.

(2017). Scale imposition as quantitative alchemy: Studies on the transitivity of neuroticism ratings. Basic and Applied Social Psychology, 39(1), 1–18. https://doi.org/10.1080/01973533.2016.1256288

40.

Nosek

B. A.

Errington

T. M.

(2020). What is replication? PLOS Biology, 18(3), Article e3000691. https://doi.org/10.1371/journal.pbio.3000691

41.

Pearl

Mackenzie

(2018). The book of why: The new science of cause and effect. Basic Books.

42.

Platt

J. R.

(1964). Strong inference. Science, 146(3642), 347–353. https://doi.org/10.1126/sciene.146.3642.347

43.

Pyszczynski

Greenberg

Solomon

(1999). A dual-process model of defense against conscious and unconscious death-related thoughts: An extension of terror management theory. Psychological Review, 106(4), 835–845. https://doi.org/10.1037/0033-295x.106.4.835

44.

Regenwetter

Robinson

M. M.

(2017). The construct-behavior gap in behavioral decision research: A challenge beyond replicability. Psychological Review, 124(5), 533–550. http://doi.org/10.1037/rev0000067

45.

Rotello

C. M.

Heit

Dubé

(2015). When more data steer us wrong: Replications with the wrong dependent measure perpetuate erroneous conclusions. Psychonomic Bulletin & Review, 22(4), 944–954. https://doi.org/10.3758/s13423-014-0759-2

46.

Rozeboom

W. W.

(2005). Meehl on metatheory. Journal of Clinical Psychology, 61(10), 1317–1354. https://doi.org/10.1002/jclp.20184

47.

Sanford

D. H.

(1989). If P then Q: Conditionals and the foundations of reasoning. Routledge.

48.

Slaney

(2017). Validating psychological constructs: Historical, philosophical, and practical dimensions. Palgrave Macmillan.

49.

Sniehotta

F. F.

Presseau

Araújo-Soares

(2014). Time to retire the theory of planned behaviour. Health Psychology Review, 8(1), 1–7. https://doi.org/10.1080/17437199.2013.869710

50.

Spirtes

Glymour

Scheines

(2000). Causation, prediction, and search. MIT Press.

51.

St Quinton

Morris

Trafimow

(2021). Untangling the theory of planned behavior’s auxiliary assumptions and theoretical assumptions: Implications for predictive and intervention studies. New Ideas in Psychology, 60, Article 100818. https://doi.org/10.1016/j.newideapsych.2020.100818

52.

St Quinton

Trafimow

. (2022). The unappreciated relevance of auxiliary assumptions for evaluating theory-based interventions in health psychology. Theory & Psychology, 32(6), 915–930. https://doi.org/10.1177/09593543221113263

53.

Stephan

W. G.

Stephan

C. W.

(2000). An integrated threat theory of prejudice. In Oskamp

(Ed.), Reducing prejudice and discrimination (pp. 23–45). Lawrence Erlbaum Associates.

54.

Tate

C. U.

(2015). On the overuse and misuse of mediation analysis: It may be a matter of timing. Basic and Applied Social Psychology, 37(4), 235–246. https://doi.org/10.1080/01973533.2015.1062380

55.

Thoemmes

(2015). Reversing arrows in mediation models does not distinguish plausible models. Basic and Applied Social Psychology, 37(4), 226–234. https://doi.org/10.1080/01973533.2015.1049351

56.

Trafimow

(2009). The theory of reasoned action: A case study of falsification in psychology. Theory & Psychology, 19(4), 501–518. https://doi.org/10.1177/0959354309336319

57.

Trafimow

(2015). On retiring the TRA/TPB without retiring the lessons learned: A commentary on Sniehotta, Presseau and Araújo-Soares. Health Psychology Review, 9(2), 168–171. https://doi.org/10.1080/17437199.2014.884932

58.

Trafimow

(2019a). A frequentist alternative to significance testing, p-values, and confidence intervals. Econometrics, 7(2), Article 26. https://www.mdpi.com/2225-1146/7/2/26

59.

Trafimow

(2019b). A taxonomy of model assumptions on which P is based and implications for added benefit in the sciences. International Journal of Social Research Methodology, 22(6), 571–583. https://doi.org/10.1080/13645579.2019.1610592

60.

Trafimow

(2019c). Why successful replications across contexts and operationalizations might not be good for theory building or testing. Journal for the Theory of Social Behaviour, 49(3), 359–368. https://doi.org/10.1111/jtsb.12211

61.

Trafimow

Bromgard

I. K.

Finlay

K. A.

Ketelaar

(2005). The role of affect in determining the attributional weight of immoral behaviors. Personality and Social Psychology Bulletin, 31(7), 935–948. https://doi.org/10.1177/0146167204272179

62.

Trafimow

Hughes

J. H.

(2012). Testing the death thought suppression and rebound hypothesis: Death thought accessibility following mortality salience decreases during a delay. Social Psychology and Personality Science, 3(5), 622–629. https://doi.org/10.1177/1948550611432938

63.

Wasserstein

R. L.

Schirm

A. L.

Lazar

N. A.

(2019). Statistical inference in the 21st century: A world beyond p < 0.05. The American Statistician, 73(Supp. 1), 1–19. https://doi.org/10.1080/00031305.2019.1583913

64.

Whewell

(1840). Philosophy of the inductive sciences. Parker.

65.

Wicker

A. W.

(1969). Attitudes versus actions: The relationship of verbal and overt behavioral responses to attitude objects. Journal of Social Issues, 25(4), 41–78. https://doi.org/10.1111/j.1540-4560.1969.tb00619.x