Recently, several methodological critiques have pointed out that most experiments in verbal learning fail to present statistical evidence that their results could be replicated using a different sample of language materials. Consequently, many of the studies have little scientific point because their conclusions have to be restricted to the specific language items used in the experiment. All these critiques are summarized, the various solutions to the problem are evaluated, and procedures to arrive at the simplest solution are described. This solution should present no difficulties to anyone who has had a course in analysis of variance.
References
1.
AndersonB.The short-term retention of active and passive sentences. Unpublished doctoral dissertation. Johns Hopkins University, 1963.
2.
CarverR. P.Evidence for the invalidity of the Miller-Coleman readability scale. Journal of Reading Behavior, 1972, 4, 42–47.
3.
ClarkH. H.The language-as-fixed-effect fallacy: A critique of language statistics in psychological research. Journal of Verbal Learning and Verbal Behavior, 1973, 12, 335–359.
4.
ColemanE. B.Improving comprehensibility by shortening sentences. Journal of Applied Psychology, 1962, 45, 131–134.
5.
ColemanE. B.Generalizing to a language population. Psychological Reports, 1964, 14, 219–226. (a).
6.
ColemanE. B.The association hierarchy as a measure of extra-experimental transfer. Journal of Psychology, 1964, 57, 403–417. (b).
7.
ColemanE. B.Learning of prose written in four grammatical transformations. Journal of Applied Psychology, 1966, 49, 332–341.
8.
ColemanE. B.Generalization variables and restricted hypotheses. Journal of Reading Behavior, 1973, 5, 226–236.
9.
MillerG. R.ColemanE. B.The measurement of reading speed and the obligation to generalize to a population of reading materials. Journal of Reading Behavior, 1972, 4, 48–56.
10.
MorganB. W.Imagery rating of 1,000 frequently used words. Journal of Educational Psychology, (in press).
11.
RothkopfE. Z.Learning from written material: An exploration of the control of inspection behavior by test-like events. American Educational Research Journal, 1966, 3, 241–249.
12.
SatterthwaiteF. E.An approximate distribution of estimates of variance components. Biometrics, 1946, 2, 110–114.
13.
SiegelS.Nonparametric statistics. New York: McGraw-Hill, 1956.
14.
SmithW. L.The effect of transformed syntactic structures on reading. In BraunCarl (Ed.), Language, Reading, and the Communication Process. Newark, Delaware: International Reading Association, 1971.
15.
SmithW. L.The controlled instrument procedure for studying the effect of syntactic sophistication on reading: The second study. Journal of Reading Behavior, 1973, 5, 242–251.
16.
WilcoxonF.Critical Values and Probability Levels for the Wilcoxon Rank Sum Test and the Wilcoxon Signed Rank Test. Pearl River, New York & Tallahassee, Florida: American Cyanamid Company & Florida State University, 1963.
17.
WinerB. J.Statistical principles in experimental design. New York: McGraw-Hill, 1971.
