Emrick's model is a latent class or state model for mastery testing that entails a simple rule for separating masters from nonmasters with respect to a homogeneous domain of items. His method for estimating the model parameters has only restricted applicability inasmuch as it assumes a mixing pa rameter equal to .50 and an a priori known ratio of the two latent success probabilities. The maximum likelihood method is also available but yields an in tractable system of estimation equations which can only be solved iteratively. The emphasis in this pa per is on estimates to be computed by hand but nonetheless accurate enough for most practical situ ations. It is shown how the method of moments can be used to obtain such "quick and easy" estimates. In addition, an endpoint method is discussed that assumes that the parameters can be estimated from the tails of the sample distribution. A monte carlo experiment demonstrated that for a great variety of parameter values, test lengths, and sample sizes, the method of moments yields excellent results and is uniformly much better than the endpoint meth od.
Get full access to this article
View all access options for this article.
References
1.
Bergan, J.R., Cancelli, A.A., & Luiten, J.W.Mastery assessment with latent class and quasi-independence models representing homogeneous item domains. Journal of Educational Statistics , 1980, 5,65-82.
2.
Besel, R.Using group performance to interpret individual responses to criterion-referenced tests. Paper presented at the annual meeting of the American Educational Research Association, New Or-leans, April 1973. (ERIC Document Reproduction Service No. ED 076 650.)
3.
Blischke, W.R.Moment estimators for the parameters of a mixture of two binomial distributions . Annals of Mathematical Statistics, 1962, 33, 444-454.
4.
Blischke, W.R.Mixtures of discrete distributions. In Proceedings of the International Symposium on Discrete Distributions, Montreal, 1963, 351-372.
5.
Blischke, W.R.Estimating the parameters of mixtures of binomial distributions. Journal of the American Statistical Association, 1964, 59, 510-528.
6.
Davis, C.E., Hickman, J., & Novick, M.R.A primer on decision analysis for individually prescribed instruction (ACT Technical Bulletin No. 17. Iowa City IA: The American College Testing Program, 1973.
7.
Dayton, C.M., & Macready, G.B.A probabilistic model for validation of behavioral hierarchies. Psychometrika, 1976, 41, 189-204.
8.
Dayton, C.M., & Macready, G.B.Model3G and Model5: Programs for the analysis of dichotomous, hierarchic structures. Applied Psychological Measurement, 1977,1, 412.
9.
Dayton, C.M., & Macready, G.B.A scaling model with response errors and intrinsically unscalable respondents. Psychometrika, 1980 , 45, 343-356.
10.
Emrick, J.A.An evaluation model for mastery testing. Journal of Educational Measurement, 1971, 8, 321-326.
11.
Emrick, J.A., & Adams, E.N.An evaluation model for individualized instruction (Report RC 2674. Yorktown Heights NY: IBM, Thomas J. Watson Research Center, October 1969.
12.
Ferguson, T.S.Mathematical statistics: A decision theoretic approach. New York: Academic Press, 1967.
13.
Fricke, R.Zum Problem von Cut-off Formeln bei lehrzielorientierten Tests. Unterrichtswissenschaften, 1974, 3, 43-56.
14.
Goodman, L.A.Exploratory latent structure analysis using both identifiable and unidentifiable models. Biometrika, 1974, 61, 215-231.
15.
Goodman, L.A.A new model for scaling response patterns: An application of the quasi-independence concept. Journal of the American Statistical Association, 1975, 70, 755-768.
16.
Goodman, L.A.On the estimation of parameters in latent structure analysis. Psychometrika, 1979, 44, 123-128.
17.
Hambleton, R.K., Swaminathan, H., Algina, R., & Coulson, D.B.Criterion-referenced testing and measurement: A review of technical issues and developments. Review of Educational Research, 1978, 48, 1-47.
18.
Harris, C.W., & Pearlman, A.P.An index for a domain of completion or short answer items. Journal of Educational Statistics, 1978, 3, 285-303.
19.
Houang, R.T., & Harris, C.W.Sampling variance of parameter estimates for a domain referenced latent class model. Paper presented at the annual meeting of the American Educational Research Association, Boston, April 1980.
20.
Johnson, N.L., & Kotz, S.Distributions in statistics: Discrete distributions. Boston : Houghton Mifflin Company, 1969 .
21.
Knapp, T.R.The reliability of a dichotomous test item: A 'correlationless' approach. Journal of Educational Measurement, 1977,14,237-252.
22.
Lord, F.M., & Novick, M.R.Statistical theories of mental test scores. Reading MA : Addison-Wesley, 1968.
23.
Macready, G.B., & Dayton, C.M.The use of probabilistic models in the assessment of mastery. Journal of Educational Statistics, 1977, 2, 99-120.
24.
Macready, G.B., & Dayton, C.M.The nature and use of state mastery models. Applied Psychological Measurement, 1980, 4, 493-516. (a)
25.
Macready, G.B., & Dayton, C.M.A two-stage conditional estimation procedure for unrestricted latent class models. Journal of Educational Statistics, 1980, 5, 129-156. (b)
26.
Meskauskas, J.A.Evaluation models for criterion-referenced testing: Views regarding mastery and standard-setting. Review of Educational Research, 1976, 46, 133-158.
27.
Molenaar, W.Overzicht van ontmengingsmethoden voor twee normale verdelingen. Statistica Neerlandica, 1965, 19, 249-263.
28.
Muench, H.Probability distributions of protection test results. Journal of the American Statistical Association, 1936, 31, 677-689.
29.
Muench, H.Discrete frequency distributions arising from mixtures of several single probability values. Journal of the American Statistical Association, 1938, 33, 390-398.
Pearson, K.On certain types of compound frequency distributions in which the components can be individually described by binomial series. Biometrika , 1915,11,139-144.
32.
Rao, C.R.The utilization of multiple measurements in problems of biological classification . Journal of the Royal Statistical Society, Series B, 1948, 10, 159-203.
33.
Rao, C.R.Linear statistical inference and its applications. New York: Wiley, 1973.
34.
Reulecke, W.A.Ein Modell für die kriteriumorientierte Testauswertung. Zeitschrift für Empirische Pädagogik, 1977, 1, 49-72. (a)
35.
Reulecke, W.A.A statistical analysis of deterministic theories. In H. Spada & W. F. Kempf (Eds.), Structural models of thinking and learning. Bern, Switzerland: Huber, 1977. (b)
36.
Rider, R.R.Estimating the parameters of mixed Poisson, binomial and Weibull distributions by the method of moments. Bulletin de l'Institute Internationale Statistique, 1961, 38, 1-8.
37.
van derLinden, W.J.Forgetting, guessing, and mastery : The Macready and Dayton models revisited and compared with a latent trait approach. Journal of Educational Statistics, 1978, 3, 305-318.
38.
van der Linden, W.J.Decision models for use with criterion-referenced tests. Applied Psychological Measurement, 1980, 4, 469-492.
39.
van der Linden, W.J.Criterion-referenced measurement : Its main applications, problems, and findings . In W. J. van der Linden (Ed.), Aspects of criterion-referenced measurement. Evaluation in Education: An International Review Series, in press.
40.
van der Linden, W.J.The use of moment estimators for mixtures of two binomials with one known success parameter. Submitted for publication, 1981.
41.
Walsh, J.E.Approximate probability values for observed number of successes from statistically independent binomial events with unequal probabilities. Sankhyá , Series A, 1953,15, 281-290.
42.
Walsh, J.E.Definition and use of generalized percentage points. Sankhyá , Series A, 1959, 21, 281-288.
43.
Walsh, J.E.Corrections to two papers concerned with binomial events. Sankhyá, Series A, 1963, 25, 247.
44.
Werts, E.W., Linn, R.L., & Jöreskog, K.A con-generic model for platonic true scores. Educational and Psychological Measurement, 1973, 33, 311-318.
45.
Wilcox, R.R.New methods for studying equivalence. In C. W. Harris, A. P. Pearlman, & R. R. Wilcox, Achievement test items: Methods for study (CSE Monograph No. 6. Los Angeles: University of California, Center for the Study of Evaluation, 1977. (a)
46.
Wilcox, R.R.New methods for studying stability. In C. W. Harris, A. P. Pearlman, & R. R. Wilcox, Achievement test items: Methods for study (CSE Monograph No. 6. Los Angeles: University of California, Center for the Study of Evaluation, 1977. (b)
47.
Wilcox, R.R.Achievement tests and latent structure models. British Journal of Mathematical and Statistical Psychology, 1979, 32, 61-71. (a)
48.
Wilcox, R.R.An alternative interpretation of three stability models. Educational and Psychological Measurement, 1979, 39, 311-316. (b)
49.
Wilcox, R.R., & Harris, C.W.On Emrick's "An evaluation model for mastery testing." Journal of Educational Measurement, 1977,14, 215-218.
