Restricted accessResearch articleFirst published online 2025
Thinking Styles (And How We Measure Them) Matter: A Four-Component Model of Thinking Styles Tested with a Balanced Version of the 4-Component Thinking Styles Questionnaire
The study addresses limitations of the 4-Component Thinking Styles Questionnaire (4-CTSQ) measuring actively open-minded thinking (AOT), close-minded thinking (CMT), preference for effortful thinking (PET), and preference for intuitive thinking (PIT). The aim was to validate the 4-CTSQ in a non-U.S./Canadian population, to explore the nomological networks of thinking styles, and to test whether the 4-CTSQ predicts unfounded beliefs over and beyond analytic thinking. The secondary aim was to address the issue of acquiescence linked with the one-directional wording of the items and to develop a balanced version of the 4-CTSQ (4-CTSQ-B). In two studies (N1 = 1,233, N2 = 712), 4-factor models had an acceptable model fit, and both the 4-CTSQ and the 4-CTSQ-B predicted unfounded beliefs. Conceptual and psychometric issues with AOT and CMT were identified and possible solutions were discussed. The 4-CTSQ, and somewhat more so the 4-CTSQ-B, appear to be good scales sensitive to distinct thinking styles.
AlaybekB.WangY.DalalR. S.DubrowS.BoemermanL. S. G. (2022). The relations of reflective and intuitive thinking styles with task performance: A meta-analysis. Personnel Psychology, 75(2), 295–319. https://doi.org/10.1111/peps.12443
Ballová MikuškováE. (2021). The analytic cognitive style and conspiracy mentality as predictors of conspiracy beliefs. Studia Psychologica, 63(2), 190–203. https://doi.org/10.31577/sp.2021.02.819
BaronJ.IslerO.YılmazO. (2023). Actively open-minded thinking and the political effects of its absence. In OttatiV.SternC. (Eds.), Divided. Open-mindedness and dogmatism in a polarized world (pp. 162–182). Oxford University Press. https://doi.org/10.1093/oso/9780197655467.003.0009
7.
BaronJ.ScottS.FincherK.MetzS. E. (2015). Why does the cognitive reflection test (sometimes) predict utilitarian moral judgment (and other things)?Journal of Applied Research in Memory and Cognition, 4(3), 265–284. https://doi.org/10.1016/j.jarmac.2014.09.003
8.
BašnákováJ.ČavojováV.ŠrolJ. (2021). Does concrete help people to reason scientifically?: Adaptation of scientific reasoning scale. Science and Education, 30(4), 809–826. https://doi.org/10.1007/s11191-021-00207-0
BayrakF.DogruyolB.AlperS.YilmazO. (2023). Multidimensional intuitive–analytic thinking style and its relation to moral concerns, epistemically suspect beliefs, and ideology. Judgment and Decision Making, 18, e42. https://doi.org/10.1017/jdm.2023.45
11.
BentlerP. M.JacksonD. N.MessickS. (1971). Identification of content and style: A two-dimensional interpretation of acquiescence. Psychological Bulletin, 76(3), 186–204.
12.
BerggrenM.AkramiN.BerghR.EkehammarB. (2019). Motivated social cognition and authoritarianism. Journal of Individual Differences, 40(4), 204–212. https://doi.org/10.1027/1614-0001/a000293
13.
BertinP.NeraK.HamerK.Uhl-HaedickeI.DelouvéeS. (2021). Stand out of my sunlight: The mediating role of climate change conspiracy beliefs in the relationship between national collective narcissism and acceptance of climate science. Group Processes and Intergroup Relations, 24(5), 738–758. https://doi.org/10.1177/1368430221992114
14.
BeyebachM.NeippM. C.Solanes-PucholÁ.Martín-del-RíoB. (2021). Bibliometric differences between weird and non-weird countries in the outcome research on solution-focused brief therapy. Frontiers in Psychology, 12, 754885. https://doi.org/10.3389/fpsyg.2021.754885
15.
Bonafé-PontesA.Costa BastosR.PilatiR. (2025). Actively open-minded thinking about evidence (AOT-E)scale: Adaptation and evidence of validity in a Brazilian sample. Judgement and Decision Making, 20, e3. https://doi.org/10.1017/jdm.2024.37
16.
BruderM.HaffkeP.NeaveN.NouripanahN.ImhoffR. (2013). Measuring individual differences in generic beliefs in conspiracy theories across cultures: Conspiracy mentality questionnaire. Frontiers in Psychology, 4, 225. https://doi.org/10.3389/fpsyg.2013.00225
17.
BuričR.KonrádováĽ. (2021). Mindware instantiation as a predictor of logical intuitions in the cognitive reflection test. Studia Psychologica, 63(2), 114–128. https://doi.org/10.31577/sp.2021.02.822
18.
BuričR.ŠrolJ. (2020). Individual differences in logical intuitions on reasoning problems presented under two-response paradigm. Journal of Cognitive Psychology, 32(4), 460–477. https://doi.org/10.1080/20445911.2020.1766472
CacioppoJ. T.PettyR. E.Feng KaoC. (1984). The efficient assessment of need for cognition. Journal of Personality Assessment, 48(3), 306–307. https://doi.org/10.1207/s15327752jpa4803_13
21.
ČavojováV.ŠrolJ.Ballová MikuškováE. (2022). How scientific reasoning correlates with health-related beliefs and behaviors during the COVID-19 pandemic?Journal of Health Psychology, 27(3), 534–547. https://doi.org/10.1177/1359105320962266
22.
ČavojováV.ŠrolJ.JurkovičM. (2020). Why should we try to think like scientists? Scientific reasoning and susceptibility to epistemically suspect beliefs and cognitive biases. Applied Cognitive Psychology, 34(1), 85–95. https://doi.org/10.1002/acp.3595
23.
DannerD.LechnerC. M.SotoC. J.JohnO. P. (2021). Modelling the incremental value of personality facets: The domains-incremental facets-acquiescence bifactor showmodel. European Journal of Personality, 35(1), 67–84. https://doi.org/10.1002/per.22
24.
De NeysW.PennycookG. (2019). Logic, fast and slow: Advances in dual-process theorizing. Current Directions in Psychological Science, 28(5), 503–509. https://doi.org/10.1177/0963721419855658
25.
DenninA.FurmanK.PretzJ. E.RoyM. M. (2022). The relationship of types of intuition to thinking styles, beliefs, and cognitions. Journal of Behavioral Decision Making, 35(5). https://doi.org/10.1002/bdm.2283
26.
DijksterhuisA.van KnippenbergA.KruglanskiA. W.SchaperC. (1996). Motivated social cognition: Need for closure effects on memory and judgment. Journal of Experimental Social Psychology, 32(3), 254–270. https://doi.org/10.1006/jesp.1996.0012
27.
DrummondC.FischhoffB. (2017). Development and validation of the scientific reasoning scale. Journal of Behavioral Decision Making, 30(1), 26–38. https://doi.org/10.1002/bdm.1906
28.
EpsteinS.PaciniR.Denes-RajV.HeierH. (1996). Individual differences in intuitive-experiential and analytical-rational thinking styles. Journal of Personality and Social Psychology, 71(2), 390–405. https://doi.org/10.1037//0022-3514.71.2.390
FaulF.ErdfelderE.BuchnerA.LangA. G. (2009). Statistical power analyses using G*Power 3.1: Tests for correlation and regression analyses. Behavior Research Methods, 41(4), 1149–1160. https://doi.org/10.3758/BRM.41.4.1149
GeorgiouN.DelfabbroP.BalzanR. (2021). Conspiracy theory beliefs, scientific reasoning and the analytical thinking paradox. Applied Cognitive Psychology, 35(6), 1523–1534. https://doi.org/10.1002/acp.3885
35.
GeorgiouN.DelfabbroP.BalzanR. (2023). The effectiveness of a scientific reasoning intervention for conspiracy theory beliefs. Applied Cognitive Psychology, 37(2), 369–382. https://doi.org/10.1002/acp.4039
HalamaP. (2019). Construction and psychometric properties of the epistemologically unfounded beliefs scale. In PiterováI.VýrostJ. (Eds.), Sociálne procesy a osobnosť 2018. [Social Processes and Personality 2018] Zborník príspevkov z medzinárodnej konferencie [Proceedings of the International Conference] 17. - 19. september 2018, Stará Lesná. (pp. 124–133). Spoločenskovedný ústav CSPV SAV.
38.
HaranU.RitovI.MellersB. A. (2013). The role of actively open-minded thinking in information acquisition, accuracy, and calibration. Judgment and Decision Making, 8(3), 188–201. https://doi.org/10.1017/S1930297500005921
39.
HartmanR. O.DieckmannN. F.SprengerA. M.StastnyB. J.DeMarreeK. G. (2017). Modeling attitudes toward science: Development and validation of the credibility of science scale. Basic and Applied Social Psychology, 39(6), 358–371. https://doi.org/10.1080/01973533.2017.1372284
40.
HendriksT.WarrenM. A.Schotanus-DijkstraM.HassankhanA.GraafsmaT.BohlmeijerE.de JongJ. (2019). How WEIRD are positive psychology interventions? A bibliometric analysis of randomized controlled trials on the science of well-being. Journal of Positive Psychology, 14(4), 489–501. https://doi.org/10.1080/17439760.2018.1484941
41.
KahnemanD. (2011). Thinking, fast and slow. Macmillan.
42.
NewtonC.FeeneyJ.PennycookG. (2024). On the disposition to think analytically: Four distinct intuitive-analytic thinking styles. Personality and Social Psychology Bulletin, 50(6), 906–923. https://doi.org/10.1177/01461672231154886
43.
OttatiV.PriceE. D.WilsonC.SumaktoyoN. (2015). When self-perceptions of expertise increase closed-minded cognition: The earned dogmatism effect. Journal of Experimental Social Psychology, 61, 131–138. https://doi.org/10.1016/j.jesp.2015.08.003
44.
OttatiV.WilsonC.PriceD.DistefanoY.BryantF. B. (2023). Situation-specific open-minded cognition. In OttatiV.SternC. (Eds.), Divided. Open-mindedness and dogmatism in a polarized world (pp. 123–143). Oxford University Press. https://doi.org/10.1093/oso/9780197655467.003.0007
45.
PaciniR.EpsteinS. (1999). The relation of rational and experiential information processing styles to personality, basic beliefs, and the ratio-bias phenomenon. Journal of Personality and Social Psychology, 76(6), 972–987. https://doi.org/10.1037//0022-3514.76.6.972
46.
PennycookG.BagoB.McPhetresJ. (2023). Science beliefs, political ideology, and cognitive sophistication. Journal of Experimental Psychology: General, 152(1), 80–97. https://doi.org/10.1037/xge0001267
47.
PennycookG.CheyneJ. A.KoehlerD. J.FugelsangJ. A. (2016). Is the cognitive reflection test a measure of both reflection and intuition?Behavior Research Methods, 48(1), 341–348. https://doi.org/10.3758/s13428-015-0576-1
48.
PennycookG.CheyneJ. A.KoehlerD. J.FugelsangJ. A. (2020). On the belief that beliefs should change according to evidence: Implications for conspiratorial, moral, paranormal, political, religious, and science beliefs. Judgment and Decision Making, 15(4), 476–498. https://doi.org/10.1017/S1930297500007439
49.
PennycookG.FugelsangJ. A.KoehlerD. J. (2015). Everyday consequences of analytic thinking. Current Directions in Psychological Science, 24(6), 425–432. https://doi.org/10.1177/0963721415604610
50.
PhillipsW. J.FletcherJ. M.MarksA. D. G.HineD. W. (2016). Thinking styles and decision making: A meta-analysis. Psychological Bulletin, 142(3), 260–290. https://doi.org/10.1037/bul0000027
51.
PretzJ. E.BrookingsJ. B.CarlsonL. A.HumbertT. K.RoyM.JonesM.MemmertD. (2014). Development and validation of a new measure of intuition: The types of intuition scale. Journal of Behavioral Decision Making, 27(5), 454–467. https://doi.org/10.1002/bdm.1820
52.
PriceE.OttatiV.WilsonC.KimS. (2015). Open-minded cognition. Personality and Social Psychology Bulletin, 41(11), 1488–1504. https://doi.org/10.1177/0146167215600528
RevillaM. A.SarisW. E.KrosnickJ. A. (2014). Choosing the number of categories in agree–disagree scales. Sociological Methods & Research, 43(1), 73–97.
55.
RizeqJ.FloraD. B.ToplakM. E. (2021). An examination of the underlying dimensional structure of three domains of contaminated mindware: Paranormal beliefs, conspiracy beliefs, and anti-science attitudes. Thinking and Reasoning, 27(2), 187–211. https://doi.org/10.1080/13546783.2020.1759688
56.
RoetsA.Van HielA. (2007). Separating ability from need: Clarifying the dimensional structure of the need for closure scale. Personality and Social Psychology Bulletin, 33(2), 266–280. https://doi.org/10.1177/0146167206294744
57.
RosseelY. (2012). Lavaan: An R package for structural equation modeling. Journal of Statistical Software, 48(2), 1–36.
58.
SáW. C.KelleyC. N.HoC.StanovichK. E. (2005). Thinking about personal theories: Individual differences in the coordination of theory and evidence. Personality and Individual Differences, 38(5), 1149–1161. https://doi.org/10.1016/j.paid.2004.07.012
59.
SinclairA. H.StanleyM. L.SeliP. (2020). Closed-minded cognition: Right-wing authoritarianism is negatively related to belief updating following prediction error. Psychonomic Bulletin & Review, 27(6), 1348–1361. https://doi.org/10.3758/s13423-020-01767-y
60.
SirotaM.DewberryC.JuanchichM.ValušL.MarshallA. C. (2021). Measuring cognitive reflection without Maths: Development and validation of the verbal cognitive reflection test. Journal of Behavioral Decision Making, 34(3), 322–343. https://doi.org/10.1002/bdm.2213
61.
SotoC. J.JohnO. P. (2019). Optimizing the length, width, and balance of a personality scale: How do internal characteristics affect external validity?Psychological Assessment, 31(4), 444–459.
62.
ŠrolJ. (2022). Individual differences in epistemically suspect beliefs: The role of analytic thinking and susceptibility to cognitive biases. Thinking & Reasoning, 28(1), 125–162. https://doi.org/10.1080/13546783.2021.1938220
63.
ŠrolJ.MikuškováE. B.ČavojováV. (2021). When we are worried, what are we thinking? Anxiety, lack of control, and conspiracy beliefs amidst the COVID-19 pandemic. Applied Cognitive Psychology, 35(3), 720–729. https://doi.org/10.1002/acp.3798
64.
StanovichK. E. (2009). What intelligence tests miss. The psychology of rational thought. Yale University Press.
StanovichK. E.ToplakM. E.WestR. F. (2008). The development of rational thought: A taxonomy of heuristics and biases. Advances in Child Development and Behavior, 36, 251–285. https://doi.org/10.1016/S0065-2407(08)00006-2
67.
StanovichK. E.WestR. F. (2000). Individual differences in reasoning: Implications for the rationality debate?The Behavioral and Brain Sciences, 23(5), 665–726. https://doi.org/10.1017/S0140525X00003435
68.
Svedholm-HäkkinenA. M.LindemanM. (2018). Actively open-minded thinking: Development of a shortened scale and disentangling attitudes towards knowledge and people. Thinking & Reasoning, 24(1), 21–40. https://doi.org/10.1080/13546783.2017.1378723
69.
The jamovi project. (2024). jamovi (Version 2.5) [Computer Software].
70.
ToplakM. E.WestR. F.StanovichK. E. (2011). The cognitive reflection test as a predictor of performance on heuristics-and-biases tasks. Memory & Cognition, 39(7), 1275–1289. https://doi.org/10.3758/s13421-011-0104-1
71.
ToplakM. E.WestR. F.StanovichK. E. (2013). Assessing miserly information processing: An expansion of the cognitive reflection test. Thinking & Reasoning, 20(2), 147–168. https://doi.org/10.1080/13546783.2013.844729
72.
WebsterD. M.KruglanskiA. W. (1994). Individual differences in need for cognitive closure. Journal of Personality and Social Psychology, 67(6), 1049–1062. https://doi.org/10.1037/0022-3514.67.6.1049
73.
WestR. F.ToplakM. E.StanovichK. E. (2008). Heuristics and biases as measures of critical thinking: Associations with cognitive ability and thinking dispositions. Journal of Educational Psychology, 100(4), 930–941. https://doi.org/10.1037/a0012842
74.
WhitmarshL. (2011). Scepticism and uncertainty about climate change: Dimensions, determinants and change over time. Global Environmental Change, 21(2), 690–700.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
