The Value and Practicality of Deliberate Sampling for Heterogeneity: A Critical Multiplist Perspective

Abstract

This paper contains a description of the use of critical multiplism to evaluate the advantages and disadvantages of random sampling and deliberate sampling for heterogeneity, according to the ability of each type of sampling to (1) aid in establishing causal relationships; and (2) to generate accurate descriptions of population parameters. It is necessary to evaluate alternatives to random sampling because it is often not feasible to apply this methodology. Deliberate sampling for heterogeneity can itself be seen as an application of critical multiplism. A model is suggested for utilizing deliberate sampling for heterogeneity when the population parameters are unknown. The model, along with critical multiplism, is applied in a study of the psychosocial rehabilitation workforce. The data suggests that deliberate sampling for heterogeneity may be more useful for generating theories and hypotheses than for generating accurate estimates of population parameters.

Get full access to this article

View all access options for this article.

References

Chen, H. T. (1990). Theory driven evaluations. Newbury Park, CA: Sage Publications.

Cook, T .D. & Campbell, D .T. (1979). Quasi-experimentation: Design and analysis issues for field settings. Boston, MA: Houghton Mifflin Company.

Cook, T .D. (1993). A quasi-sampling theory of the generalization of causal relationships. In L. B. Sechrest & A. G. Scott (Eds.), Understanding causes and generalizing about them. (pp. 39-83). New Directions for Program Evaluation, no. 57. San Francisco, CA: Jossey-Bass.

Cronbach, L .J. (1982). Designing evaluations of educational and social programs. San Francisco: Jossey-Bass.

Henry, G. T. (1990). Practical sampling. Newbury Park, CA: Sage.

Houts, A. C. , Cook, T. D. & Shadish, W. R. (1986). The Person -situation debate: A critical multiplist perspective. Journal of Personality, 54(11), 52-101.

Mark, M .M. (1986). Validity typologies and the logic and practice of quasi-experimentation. In W. M. M. Trochim (Ed.). Advances in quasi-experimental design and analysis. (pp. 47-67). New Directions for Program Evaluation, no. 31. San Francisco, CA: Jossey-Bass.

Mosher, L. & Burti, L. (1992). Relationships in rehabilitation: When technology fails. Psychosocial Rehabilitation Journal, 15 (4), pp. 11-19.

Shadish, W .R. (1986). Planned critical multiplism: Some elaborations. Behavioral Assessment, 8, 75-103.

10.

Shadish, W. R. , Cook, T. D. & Houts, A. C. (1986). Quasi-experimentation in a critical multiplist mode. In W. M. M. Trochim (Ed.). Advances in quasi-experimental design and analysis. (pp. 29-47).

11.

Shadish, W .R. (1993). Critical multiplism: A research strategy and its attendant tactics. In L. B. Sechrest (Ed.). Program evaluation: A pluralistic enterprise. (pp.17-59 New Directions for Program Evaluation, no.60. San Francisco, CA: Jossey-Bass.

12.

New Directions for Program Evaluation, no. 31. San Francisco, CA: Jossey-Bass.

13.

St. Pierre, R. G. & Cook, T. D. , Sampling strategy in the design of program evaluations . (1984). Evaluation studies review annual, 9, Newbury Park, CA: Sage. 459-484

14.

Wright, G .N. & Terrian, L. J. (1987). Rehabilitation job satisfaction inventory. Rehabilitation Counseling Bulletin, pp. 159-176.