The author investigates scenario generation and analogical reasoning as potential sources of bias in new product forecasting. In a series of studies, scenarios and analogies are shown to have persistent effects on judgment, despite subsequent use of corrective analytic techniques (e.g., counterfactual reasoning, counterscenarios, counteranalogies, decomposition, accountability). These findings demonstrate the robustness of nonanalytic processes on judgment and the need to be aware of their seductive effects.
Get full access to this article
View all access options for this article.
References
1.
AlbaJoseph W., and Wesley HutchinsonJ. (1987), “Dimensions of Consumer Expertise,”Journal of Consumer Research, 13(March), 411–54.
2.
AndersonCraig A., LepperMark R., and RossLee (1980), “Perseverance of Social Theories: The Role of Explanation in the Persistence of Discredited Information,”Journal of Personality and Social Psychology, 30(6), 1037–49.
3.
AndersonCraig A., and SechlerElizabeth S. (1986), “Effects of Explanation and Counterexplanation on the Development and Use of Social Theories,”Journal of Personality and Social Psychology, 50(1), 24–34.
4.
ArmstrongJ. Scott, BrodieRoderick J., and McIntyreShelby H. (1987), “Forecasting Methods for Marketing: Review of Empirical Research,”International Journal of Forecasting, 3(4), 355–76.
5.
BouldingWilliam, MorganRuskin, and StaelinRichard (1997), “Pulling the Plug to Stop the New Product Drain,”Journal of Marketing Research, 34(February), 164–76.
6.
ByramStephanie J. (1997), “Cognitive and Motivational Factors Influencing Time Prediction,”Journal of Experimental Psychology: Applied, 3(3), 216–39.
7.
CarrollJohn S. (1978), “The Effect of Imagining an Event on Expectations for the Event: An Interpretation in Terms of the Availability Heuristic,”Journal of Experimental Social Psychology, 14(1), 88–96.
8.
ChapmanRandall G. (1997), BRANDMAPS: The Competitive Marketing Strategy Game, 4th ed.Upper Saddle River, NJ: Prentice Hall.
9.
ConnollyTerry, and DeanDoug (1997), “Decomposed Versus Holistic Estimates of Effort Required for Software Writing Tasks,”Management Science, 43(7), 1029–46.
10.
DalrympleDouglas J. (1987), “Sales Forecasting Practices,”International Journal of Forecasting, 3(4), 379–91.
11.
EinhornHillel J., and HogarthRobin M. (1987), “Decision Making: Going Forward in Reverse,”Harvard Business Review, 65(January-February), 66–70.
12.
FischhoffBaruch (2001), “Learning from Experience: Coping with Hindsight Bias and Ambiguity,” in Principles of Forecasting: A Handbook for Researchers and Practitioners, Scott ArmstrongJ., ed. Boston: Kluwer Academic Publishers, 543–54.
13.
GentnerDedre, and MarkmanArthur B. (1997), “Structure Mapping in Analogy and Similarity,”American Psychologist, 52(1), 45–56.
14.
GilovichThomas (1981), “Seeing the Past in the Present: The Effect of Associations to Familiar Events on Judgments and Decisions,”Journal of Personality and Social Psychology, 40(5), 797–808.
15.
Gregan-PaxtonJennifer, and JohnDeborah Roedder (1997), “Consumer Learning By Analogy: A Model of Internal Knowledge Transfer,”Journal of Consumer Research, 24(December), 266–84.
16.
GregoryW. Larry, CialdiniRobert B., and CarpenterKathleen M. (1982), “Self-Relevant Scenarios as Mediators of Likelihood Estimates and Compliance: Does Imagining Make It So?”Journal of Personality and Social Psychology, 43(1), 89–99.
17.
GriffinDale W., DunningDavid, and RossLee (1990), “The Role of Construal Processes in Overconfident Predictions About the Self and Others,”Journal of Personality and Social Psychology, 59(6), 1128–39.
18.
HamelGary, and PrahaladC.K. (1994), Competing for the Future.Boston: Harvard Business School.
19.
HaugtvedtCurtis P., and WegenerDuane T. (1994), “Message Order Effects in Persuasion: An Attitude Strength Perspective,”Journal of Consumer Research, 21(1), 205–18.
20.
HirtEdward R., and MarkmanKeith D. (1995), “Multiple Explanation: A Consider-an-Alternative Strategy for Debiasing Judgments,”Journal of Personality and Social Psychology, 69(6), 1069–86.
21.
HochStephen J. (1984), “Availability and Interference in Predictive Judgment,”Journal of Experimental Psychology: Learning, Memory, and Cognition, 10(4), 649–62.
22.
HolyoakKeith J., and SimonDan (1999), “Bidirectional Reasoning in Decision Making by Constraint Satisfaction,”Journal of Experimental Psychology: General, 128(1), 3–31.
23.
HolyoakKeith J., and ThagardPaul (1995a), “The Construction of Similarity,” in Mental Leaps: Analogy in Creative Thought.Cambridge, MA: MIT Press, 101–37.
24.
HolyoakKeith J., and ThagardPaul (1995b), “The Analogical Scientist,” in Mental Leaps: Analogy in Creative Thought.Cambridge, MA: MIT Press, 185–209.
25.
HolyoakKeith J., and ThagardPaul (1997), “The Analogical Mind,”American Psychologist, 52(1), 35–44.
26.
KahnemanDaniel, and TverskyAmos (1982), “The Simulation Heuristic,” in Judgment Under Uncertainty: Heuristics and Biases, KahnemanDaniel, SlovicPaul, and TverskyAmos, eds. New York: Cambridge University Press, 201–208.
27.
KeppelGeoffrey (1991), Design and Analysis: A Researcher's Handbook, 3d ed.Upper Saddle River, NJ: Prentice Hall.
28.
KoehlerDerek J. (1991), “Explanation, Imagination, and Confidence in Judgment,”Psychological Bulletin, 110(3), 499–519.
29.
KoehlerDerek J. (1994), “Hypothesis Generation and Confidence in Judgment,”Journal of Experimental Psychology: Learning, Memory, and Cognition, 20(2), 461–69.
30.
KuhnDeanna, and LaoJoseph (1996), “Effects of Evidence on Attitudes: Is Polarization the Norm?”Psychological Science, 7(2), 115–20.
31.
KuhnKristine M., and SniezekJanet A. (1996), “Confidence and Uncertainty in Judgmental Forecasting: Differential Effects of Scenario Presentation,”Journal of Behavioral Decision Making, 9(4), 231–47.
32.
LernerJennifer S., and TetlockPhilip E. (1999), “Accounting for the Effects of Accountability,”Psychological Bulletin, 125(2), 255–75.
33.
MacGregorDonald G. (2001), “Decomposition for Judgmental Forecasting and Estimation,” in Principles of Forecasting: A Handbook for Researchers and Practitioners, Scott ArmstrongJ., ed. Boston: Kluwer Academic Publishers, 107–123.
34.
MacGregorDonald G., and LichtensteinSarah (1991), “Problem Structuring Aids for Quantitative Estimation,”Journal of Behavioral Decision Making, 4(2), 101–16.
35.
MahajanJayashree (1992), “The Overconfidence Effect in Marketing Management Predictions,”Journal of Marketing Research, 29(August), 329–42.
36.
MarkmanArthur B. (1997), “Constraints on Analogical Inference,”Cognitive Science, 21(4), 373–418.
37.
MillarMurray G., and TesserAbraham (1986), “Thought-Induced Attitude Change: The Effects of Schema Structure and Commitment,”Journal of Personality and Social Psychology, 51(2), 259–69.
38.
PaichMark, and StermanJohn D. (1993), “Boom, Bust, and Failures to Learn in Experimental Markets,”Management Science, 39(December), 1439–58.
39.
PenningtonNancy, and HastieReid (1992), “Explaining the Evidence: Tests of the Story Model for Juror Decision Making,”Journal of Personality and Social Psychology, 62(2), 189–206.
40.
ReadStephen J., and CesaIan L. (1991), “This Reminds Me of the Time When…: Expectation Failures in Reminding and Explanation,”Journal of Experimental Social Psychology, 27(1), 1–25.
41.
ReevesLauretta M., and WeisbergRobert W. (1994), “The Role of Content and Abstract Information in Analogical Transfer,”Psychological Bulletin, 115(3), 381–400.
42.
RinglandGill, ToddKeith, and SchwartzPeter (1998), Scenario Planning: Managing for the Future.New York: John Wiley & Sons.
43.
RossLee, LepperMark R., StrackFritz, and SteinmetzJulia (1977), “Social Explanation and Social Expectation: Effects of Real and Hypothetical Explanations on Subjective Likelihood,”Journal of Personality and Social Psychology, 35(11), 817–29.
SanbonmatsuDavid M., AkimotoSharon A., and BiggsEarlene (1993), “Overestimating Causality: Attributional Effects of Confirmatory Processing,”Journal of Personality and Social Psychology, 65(5), 892–903.
46.
SchnaarsSteven P., and TopolMartin T. (1987), “The Use of Multiple Scenarios in Sales Forecasting: An Empirical Test,”International Journal of Forecasting, 3(4), 405–19.
47.
SchoemakerPaul J.H. (1993), “Multiple Scenario Development: Its Conceptual and Behavioral Foundation,”Strategic Management Journal, 14(3), 193–213.
48.
SieckWinston R., QuinnClark N., and SchoolerJonathan W. (1999), “Justification Effects on the Judgment of Analogy,”Memory and Cognition, 27(5), 844–55.
49.
Siegel-JacobsKaren, and Frank YatesJ. (1996), “Effects of Procedural and Outcome Accountability on Judgment Quality,”Organizational Behavior and Human Decision Processes, 65(1), 1–17.
50.
SimonsonItamar, and NyePeter (1992), “The Effect of Accountability on Susceptibility to Decision Errors,”Organizational Behavior and Human Decision Processes, 51(3), 416–46.
51.
SlomanSteven A. (1996), “The Empirical Case for Two Systems of Reasoning,”Psychological Bulletin, 119(1), 3–22.
52.
SpellmanBarbara A., and HolyoakKeith J. (1992), “If Saddam Is Hitler Then Who Is George Bush? Analogical Mapping Between Systems of Social Roles,”Journal of Personality and Social Psychology, 62(6), 913–33.
53.
SpellmanBarbara A., and HolyoakKeith J. (1996), “Pragmatics in Analogical Mapping,”Cognitive Psychology, 31(3), 307–46.
54.
TetlockPhilip E. (1983), “Accountability and Complexity of Thought,”Journal of Personality and Social Psychology, 45(1), 74–83.
55.
TetlockPhilip E. (1985), “Accountability: A Social Check on the Fundamental Attribution Error,”Social Psychology Quarterly, 48(3), 227–36.
56.
TetlockPhilip E. (2000), “Cognitive Biases and Organizational Correctives: Do Both Disease and Cure Depend on the Politics of the Beholder?”Administrative Science Quarterly, 45(2), 293–326.
57.
TetlockPhilip E., and BoettgerRichard (1989), “Accountability: A Social Magnifier of the Dilution Effect,”Journal of Personality and Social Psychology, 57(3), 388–98.
58.
TetlockPhilip E., and KimJae Il (1987), “Accountability and Judgment Processes in a Personality Prediction Task,”Journal of Personality and Social Psychology, 52(4), 700–709.
59.
TverskyAmos, and KahnemanDaniel (1983), “Extensional Versus Intuitive Reasoning: The Conjunction Fallacy in Probability Judgment,”Psychological Review, 90(4), 293–315.
60.
WackPierre (1985), “Scenarios: Uncharted Waters Ahead,”Harvard Business Review, 63(September-October), 73–89.
61.
ZaltmanGerald (1997), “Rethinking Market Research: Putting People Back In,”Journal of Marketing Research, 34(November), 424–37.
