Test-retest correlations often are reported as measures of the reliability of copy testing procedures with little or no attention to the conditions under which such an interpretation is meaningful. Some checks are suggested for assessing the consistency of test-retest data with certain requirements which should be met if a test-retest correlation is to serve as reliability index. Ambiguities and shortcomings of many available reliability estimates are discussed.
Get full access to this article
View all access options for this article.
References
1.
“A Synopsis of Advertising Testing Services and Procedures.” Los Angeles: Audience Studies, Inc., no date.
2.
Action Speaks Louder Than Words.Los Angeles: Tele Research, Inc., 1971.
3.
AppelValentine. “The Reliability and Decay of Advertising Measurements,” paper presented at the Marketing Conference of the National Industrial Conference Board, October 28, 1966.
AppelValentine. and BlumMilton L.. “Ad Recognition and Respondent Set,” Journal of Advertising Research, 1 (June 1961), 13–21.
6.
AshtonWinifred. The Logit Transformation.London: Griffin, 1972.
7.
AxelrodJoel N.Choosing the Best Advertising Alternative.New York: Association of National Advertisers, Inc., 1971.
8.
BultezAlain, DerbaixChristian, and SilkAlvin J.. “Developing and Testing Advertising Alternatives: Is the Magic Number One or Could it be Four?” Paper presented at the Fifth Annual Meeting of the European Academy for Advanced Research in Marketing, Fontainebleau, France, April 1976.
9.
CampbellDonald T. and FiskeDonald W.. “Convergent and Discriminant Validation by the Multitrait-Multimethod Matrix,” Psychological Bulletin, 56 (March 1959), 81–105.
10.
CampbellDonald T. and StanleyJulian C.. Experimental and Quasi-Experimental Designs in Research.Chicago: Rand-McNally, 1963.
11.
ClancyKevin J. and KweskinDavid M.. “TV Commercial Recall Correlates,” Journal of Advertising Research, 11 (April 1971), 18–20.
12.
ClancyKevin J. and OstlundLyman E.. “Commercial Effectiveness Measures,” Journal of Advertising Research, 16 (February 1976), 29–36.
13.
ColemanJames S. “The Mathematical Study of Change,” inBlalockHubert M.Jr. and BlalockAnn B., eds., Methodology in Social Research.New York: McGraw-Hill Book Company, 429–78.
14.
CronbachLee J., GleserGoldine C., NandaHarinder, and RajaratnamNageswari. The Dependability of Behavioral Measurements.New York: John Wiley and Sons, Inc., 1972.
15.
GrossIrwin. “Should the Advertiser Spend More on Creating Advertising?” Proceedings, 13th Annual Conference, Advertising Research Foundation, New York, 1967, 78–83.
16.
GrossIrwin. “The Creative Aspects of Advertising,” Sloan Management Review, 14 (Fall 1972), 83–109.
17.
GuilfordJ. P.Psychometric Methods, 2nd ed. New York: McGraw-Hill Book Company, 1954.
18.
HeelerRoger M. and RayMichael L.. “Measure Validation in Marketing,” Journal of Marketing Research, 9 (November 1972), 361–70.
19.
HeiseDavid R. “Separating Reliability and Stability in Test-Retest Correlation,” American Sociological Review, 34 (February 1969), 93–101.
20.
HellerHarry E. “The Ostrich and the Copy Researcher: A Comparative Analysis,” paper presented at the December 2, 1971 meeting of the Advertising Effectiveness Research Group, New York Chapter, American Marketing Association.
21.
JenssenWard J. “Sales Effects of TV, Radio and Print Advertising,” Journal of Advertising Research, 6 (June 1966), 2–7.
22.
KahnFran and LightLarry. “Copytesting—Communication vs. Persuasion,” inSchlingerMary Jane, ed., Advances in Consumer Research, Vol. 2, Proceedings, November 1974 Conference of the Association for Consumer Research, 595–605.
23.
LeavittClark, WaddellCharles, and WellsWilliam. “Improving Day-After Recall Techniques,” Journal of Advertising Research, 10 (June 1970), 13–7.
24.
LordFrederick M. and NovickMelvin R.. Statistical Theories of Mental Test Scores.Reading, Massachusetts: Addison-Wesley, 1968.
25.
LucasDarrell B. “The ABC's of ARF's PARM,” Journal of Marketing, 25 (July 1960), 9–20.
26.
MaloneyJohn C. “Portfolio Tests—Are They Here to Stay?” Journal of Marketing, 25 (July 1961), 32–7.
27.
MorrisonDonald G. “Reliability of Tests: A Technique Using the ‘Regression to the Mean’ Fallacy,” Journal of Marketing Research, 10 (February 1973), 91–3.
28.
PlummerJoseph T. “Evaluating TV Commercial Tests,” Journal of Advertising Research, 12 (October 1972), 21–8.
29.
SilkAlvin J. “A Note on the Use of Tests for the Stability of Variances in Reliability Studies,” Working Paper 76–53, Euopean Institute for Advanced Studies in Management, Brussels, December 1976.
30.
SilkAlvin J. and BultezAlain. “Product Category Variability in the Reliability of Copy Tests,” Working Paper 76–48, European Institute for Advanced Studies in Management, Brussels, October 1976. Forthcoming in Journal of Advertising Research.
31.
SnedecorGeorge W. and CochranWilliam G.. Statistical Methods, 6th ed. Ames, Iowa: Iowa State University Press, 1967.
32.
WalkerHelen M. and LevJoseph. Statistical Inference.New York: Holt, Rinehart and Winston, 1953.
33.
WeissTibor and AppelValentine. “Sense and Nonsense in Attitude-Change Copy Testing,” Proceedings, 19th Annual Conference, Advertising Research Foundation, 1973, 54–9.
