Judgment-based estimations often are used in marketing decision making and as inputs to decision calculus models. An evaluation of different approaches to integrating individual judgments is performed in the context of a marketing situation where the “true” values being estimated are known. Experts identified by a simple external measure of expertise are found likely to provide better estimates, followed by groups participating in a Delphi process. Experts identified by self-rated confidence and interpersonal group consensus are not found likely to provide better estimates than the average of the initial judgments of the members of a group.
Get full access to this article
View all access options for this article.
References
1.
BasuShankar and SchroederRoger G. (1977), “Incorporating Judgments in Sales Forecasts: Application of the Delphi Method at American Hoist & Derrick,” Interfaces, 7 (May), 18–27.
2.
BeachLee R. and MitchellTerence R. (1978), “A Contingency Model for the Selection of Decision Strategies,” Academy of Management Review, 3 (July), 439–49.
3.
BestRoger J. (1974), “An Experiment in Delphi Estimation in Marketing Decision Making,” Journal of Marketing Research, 11 (November), 447–68.
4.
CamererColin (1980), “The Validity and Utility of Expert Judgment,” Research Paper, Graduate School of Business, University of Chicago.
5.
ChakravartiDipankar, MitchellAndrew, and StaelinRichard (1979), “Judgment Based Marketing Decision Models: An Experimental Investigation of the Decision Calculus Approach,” Management Science, 25 (March), 251–63.
6.
ChakravartiDipankar, MitchellAndrew, and StaelinRichard (1981), “Judgment Based Marketing Decision Models: Problems and Possible Solutions,” Journal of Marketing, 45 (Fall), 13–23.
7.
ColemanDenis R. (1972a), “The Stanford Graduate School of Business Data Management and Analysis System: Part I—The Data Management System,” Technical Report, Graduate School of Business, Stanford University.
8.
ColemanDenis R. (1972b), “Non Parametric Statistical Package,” Technical Report, Graduate School of Business, Stanford University.
9.
DalkeyNorman (1969), The Delphi Method: An Experimental Study of Group Opinion.Santa Monica, CA: The Rand Corporation, RM-5888-PR.
10.
DalkeyNorman and HelmerOlaf (1963), “An Experimental Application of the Delphi Method to the Use of Experts,” Management Science, 9 (April), 458–67.
11.
DawesRobyn M. (1971), “A Case Study of Graduate Admissions: Application of Three Principles of Human Decision Making,” American Psychologist, 26 (February), 180–8.
12.
DawesRobyn M. and CorriganBernard (1974), “Linear Models in Decision Making,” Psychological Bulletin, 81 (February), 95–106.
13.
DayGeorge S. (1977), “Diagnosing the Product Portfolio,” Journal of Marketing, 41 (April), 29–38.
14.
EinhornHillel J. and HogarthRobin M. (1975), “Unit Weighting Schemes for Decision Making,” Organizational Behavior and Human Performance, 13 (April), 171–92.
15.
EinhornHillel J. and HogarthRobin M. (1978), “Confidence in Judgment: Persistence of the Illusion of Validity,” Psychological Review, 85 (5), 395–416.
16.
EinhornHillel J. Robin M. Hogarth, and KlempnerEric (1977), “Quality of Group Judgment,” Psychological Bulletin, 84 (1), 158–72.
17.
FudgeWilliam K. and LodishLeonard M. (1977), “Evaluation of the Effectiveness of a Salesman's Planning System by Field Experimentation,” Interfaces, 8 (November), 97–106.
18.
GoldbergLewis R. (1970), “Man Versus Model of Man: A Rationale, Plus Some Evidence for a Method of Improving on Clinical Inferences,” Psychological Bulletin, 73 (June), 422–32.
19.
GustafsonDavid H., ShuklaRamesh K., DelbecqAndre, and WalsterG. William (1973), “A Comparative Study of Differences in Subjective Likelihood Estimates Made by Individuals, Interacting Groups, Delphi Groups and Nominal Groups,” Organizational Behavior and Human Performance, 9 (April), 280–91.
20.
HarmanAlvin J. and PressS. James (1975), Collecting and Analyzing Expert Group Judgment Data.Santa Monica, CA: The Rand Corporation, P-5467.
21.
HogarthRobin M. (1978), “A Note on Aggregating Opinions,” Organization Behavior and Human Performance, 21 (February), 40–6.
22.
HogarthRobin M. and MakridakisSpyros (1981a), “The Value of Decision Making in a Complex Environment: An Experimental Approach,” Management Science, 27 (January), 93–107.
23.
HogarthRobin M. (1981b), “Forecasting and Planning: An Evaluation,” Management Science, 27 (February), 115–38.
24.
JolsonMarvin A. and RossowGerald L. (1971), “The Delphi Process in Marketing Decision Making,” Journal of Marketing Research, 8 (November), 443–8.
25.
KahnemanDaniel and TverskyAmos (1973), “On the Psychology of Prediction,” Psychological Review, 80 (July), 237–51.
26.
LarréchéJean-Claude (1979), “Integrative Complexity and the Use of Marketing Models,” in The Implementation of Management Science, DoktorR., SchulzR. L., and SlevinD. P., eds. New York: North-Holland.
27.
LarréchéJean-Claude and SrinivasanV. (1981), “STRATPORT: A Decision Support System for Strategic Planning,” Journal of Marketing, 45 (Fall), 39–52.
28.
LinstoneHarold A. and TuroffMurray, eds. (1975), The Delphi Method: Techniques and Applications.New York: Addison-Wesley.
29.
LittleJohn D. C. (1970), “Models and Managers: The Concept of a Decision Calculus,” Management Science, 16 (April), 446–85.
30.
LittleJohn D. C. and LodishLeonard M. (1981), “Commentary on Judgment Based Marketing Decision Models,” Journal of Marketing, 45 (Fall), 24–9.
31.
MakridakisSpyros and HibonMichéle (1979), “Accuracy of Forecasting: An Empirical Investigation,” Journal of the Royal Statistical Society, A, 142 (2), 97–125.
32.
McIntyreShelby H. (1980), “The Leverage Impact of Judgment Based Marketing Models,” in Market Measurement and Analysis, Proceedings of the First ORSA/TIMS Special Interest Conference, MontgomeryD. B. and WittinkD. R., eds. Cambridge, MA: Marketing Science Institute, 551–67.
33.
McIntyreShelby H. (1982), “An Experimental Study of the Impact of Judgment Based Marketing Models,” Management Science, 28 (January), 17–33.
34.
McIntyreShelby H. and CurrimImran S. (1982), “Evaluating Judgment Based Marketing Models: Multiple Measures, Comparisons and Findings,” in Marketing Planning Models, TIMS Studies in the Management Sciences, ZoltnersA., ed. New York: North-Holland, 185–207.
35.
MilkovichGeorge T., AnnoniAnthony J., and MahoneyThomas A. (1972), “The Use of the Delphi Procedures in Manpower Forecasting,” Management Science, 19 (December), 381–8.
36.
MontgomeryDavid B. and SilkAlvin J. (1972), “Estimating Dynamic Effects of Market Communications Expenditures,” Management Science, 18 (June), 485–501.
37.
SackmanHarold (1975), Delphi Critique: Expert Opinion, Forecasting, and Group Process.Lexington, MA: Lexington Books.
38.
SchroderHarold M., DriverMichael J., and StreufertSiegfried (1967), Human Information Processing.New York: Holt, Rinehart and Winston.
39.
SiegelSidney (1956), Nonparametric Statistics for the Behavioral Sciences.New York: McGraw-Hill Book Company.
40.
WinklerRobert L. (1967), “The Assessment of Prior Distributions in Bayesian Analysis,” Journal of the American Statistical Association, 62 (September), 776–81.
