The purpose of this article is to demonstrate application of a new framework, the validation framework (VF), to assist researchers in evaluating mixed research studies. Based on an earlier work by Dellinger and Leech, a description of the VF is delineated. Using the VF, three studies from education, health care, and counseling fields are evaluated. The three mixed research studies differed in design and implementation. Elements of the VF were examined and evaluated for each study, and a picture of the quality of each study was captured textually. In presenting the VF and its potential for practical application in evaluating mixed research studies, pragmatic researchers can use this tool to increase the quality of their evaluations of mixed research studies.
Cherryholmes, C.H. ( 1988). Construct validity and the discourses of research. American Journal of Education, 96, 421-457.
2.
Cohen, L., Manion, L., & Morrison, K. ( 2007). Research methods in education (6th ed.). New York: Routledge.
3.
Cook, T.D., & Campbell, D.T. (1979). Quasi-experimentation: Design and analysis issues for field settings. Boston: Houghton Mifflin.
4.
Cooper, H. ( 1998). Synthesizing research (3rd ed.). Thousand Oaks, CA: SAGE.
5.
Creswell, J.W. ( 2007). Qualitative inquiry and research design: Choosing among the five traditions (2nd ed.). Thousand Oaks, CA: SAGE.
6.
Creswell, J.W. ( 2008). Educational research: Planning, conducting, and evaluating quantitative and qualitative research (3rd ed.). Columbus, OH: Pearson.
7.
Creswell, J.W., Fetters, M.D., & Ivankova, N.V. (2004). Designing a mixed methods study in primary care. Annals of Family Medicine, 2(1), 7-12.
8.
Creswell, J.W., & Plano Clark, V.L. (2007). Designing and conducting mixed methods research. Thousand Oaks, CA: SAGE.
9.
Dellinger, A.B. ( 2005). Validity and the review of literature. Research in the Schools, 12(2), 41-54.
10.
Dellinger, A.B., & Leech, N.L. ( 2007). Towards a unified validation framework in mixed methods research. Journal of Mixed Methods Research, 1(4), 309-332.
11.
Edwards, L.M., & Lopez, S.J. ( 2006). Perceived family support, acculturation, and life satisfaction in Mexican American youth: A mixed-methods exploration. Journal of Counseling Psychology, 53, 279-287.
12.
Gliner, J. A., Morgan, G. A., & Leech, N. L. (2009). Research methods in applied settings: An integrated approach to design and analysis (2nd ed.). New York: Taylor & Francis.
13.
Guba, E.G., & Lincoln, Y.S. ( 2005). Paradigmatic controversies, contradictions, and emerging confluences. In N. K. Denzin & Y. S. Lincoln (Eds.), The SAGE handbook of qualitative research (3rd ed., pp. 191-215). Thousand Oaks, CA: SAGE.
14.
Howe, K.R. ( 1988). Against the quantitative-qualitative incompatibility thesis or dogmas die hard. Educational Researcher, 17(8), 10-16.
15.
Johnson, R.B., & Christensen, L. (2008) Educational research: Quantitative, qualitative and mixed approaches (3rd ed.). Thousand Oaks, CA: SAGE.
16.
Johnson, R.B., & Onwuegbuzie, A.J. (2004). Mixed methods research: A research paradigm whose time has come. Educational Researcher , 33(7), 14-26.
17.
Leech, N.L., & Onwuegbuzie, A.J. (2007). Mixed methods in counseling research: Trends in the literature. Manuscript submitted for publication.
18.
Maxwell, J.A. ( 1992). Understanding and validity in qualitative research. Harvard Educational Review, 62, 279-300.
19.
Messick, S. ( 1989). Validity. In R. L. Linn (Ed.), Educational measurement (3rd ed., pp. 13-103). New York: Macmillan .
20.
Messick, S. ( 1995). Validity of psychological assessment: Validation of inferences from persons’ responses and performances as scientific inquiry into score meaning. American Psychologist, 50, 741-749.
21.
Morgan, D.L. ( 2007). Paradigms lost and pragmatism regained: Methodological implications of combining qualitative and quantitative methods. Journal of Mixed Methods Research, 1(1), 48-76.
22.
Newman, I., & Benz, C.R. ( 1998). Qualitative-quantitative research methodology: Exploring the interactive continuum. Carbondale: Southern Illinois University Press.
23.
Onwuegbuzie, A.J., Jiao, Q.G., & Collins, K.M.T. (2007). Mixed methods research: A new direction for the study of stress and coping. In. G. Gates (Vol. Ed.), Emerging thought and research on students, teacher, and administrator stress and coping: Vol. 4. Research on stress and coping in education (pp. 215-243). Greenway, CT: Information Age Publishing .
24.
Onwuegbuzie, A.J., & Johnson, R.B. ( 2006). The validity issue in mixed research. Research in the Schools, 13(1), 48-63.
25.
Onwuegbuzie, A.J., & Leech, N.L. ( 2005a). On becoming a pragmatic researcher: The importance of combining quantitative and qualitative research methodologies. International Journal of Social Research Methodology: Theory and Practice , 8, 375-387.
26.
Onwuegbuzie, A.J., & Leech, N.L. ( 2005b). Taking the ‘‘Q’’ out of research: Teaching research methodology courses without the divide between quantitative and qualitative paradigms. Quality and Quantity: International Journal of Methodology, 39, 267-296.
27.
Perry, J.C., DeWine, D.B., Duffy, R.D., & Vance, K.S. ( 2007). The academic self-efficacy of urban youth: A mixed-methods study of a school-to-work program. Journal of Career Development , 34, 103-126.
28.
Powell, H., Mihalas, S., Onwuegbuzie, A.J., Suldo, S., & Daley, C.E. ( 2008). Mixed methods research in school psychology: A mixed methods investigation of trends in the literature. Psychology in the Schools, 45, 291-309.
29.
Rossman, G.B., & Wilson, B.L. ( 1985). Numbers and words: Combining quantitative and qualitative methods in a single large-scale evaluation study. Evaluation Review, 9, 627-643.
30.
Sussman, A.L., Williams, R.L., Leverence, R., Gloyd, P.W., & Crabtree, B.F. (2006) The art of complexity of primary care clinicians’ preventive counseling decisions: Obesity as a case study. Annals of Family Medicine, 4, 327-333.
31.
Tashakkori, A., & Teddlie, C. ( 1998). Mixed methodology: Combining qualitative and quantitative approaches. Thousand Oaks, CA: SAGE.
32.
Tashakkori, A., & Teddlie, C. ( 2003). The past and future of mixed methods research: From data triangulation to mixed model designs. In A. Tashakkori & C. Teddlie (Eds.), Handbook of mixed methods in social and behavioral research (pp. 671-702). Thousand Oaks, CA: SAGE.
33.
Tashakkori, A., & Teddlie, C. ( 2006, April). Validity issues in mixed methods research: Calling for an integrative framework. Paper presented at the annual meeting of theAmerican Educational Research Association, San Francisco.
34.
Tashakkori, A., & Teddlie, C. ( 2008). Quality of inferences in mixed methods research. In M. Bergman (Ed.), Advances in mixed methods research: Theories and applications (pp. 101-119). London: SAGE.
35.
Whittemore, R., Chase, S.K., & Mandle, C.L. ( 2001). Validity in qualitative research. Qualitative Health Research, 11, 522-537.
