The concept of validity has been a central component in critical appraisal exercises evaluating the methodological quality of quantitative studies. Reactions by qualitative researchers have been mixed in relation to whether or not validity should be applied to qualitative research and if so, what criteria should be used to distinguish high-quality articles from others. We compared three online critical appraisal instruments’ ability to facilitate an assessment of validity. Many reviewers have used the critical appraisal skills program (CASP) tool to complete their critical appraisal exercise; however, CASP appears to be less sensitive to aspects of validity than the evaluation tool for qualitative studies (ETQS) and the Joanna Briggs Institute (JBI) tool. The ETQS provides detailed instructions on how to interpret criteria; however, it is the JBI tool, with its focus on congruity, that appears to be the most coherent.
Attree, P., & Milton, B. ( 2006). Critically appraising qualitative research for systematic reviews: Defusing the methodological cluster bomb. Evidence & Policy, 2, 109-126.
2.
Brody, H. ( 1992). Philosophic approaches. In B. Crabtree & W. Miller (Eds.), Doing qualitative research (pp. 174-185). Newbury Park, CA: Sage.
3.
Burke Johnson, R. ( 1998). Examining the validity structure of qualitative research . Education, 118, 282-292.
4.
Campbell, D.T. ( 1979). Degrees of freedom and the case study. In T. D. Cook & C. S. Reichardt (Eds.), Qualitative and quantitative methods in evaluation research (pp. 49-67). Beverly Hills, CA: Sage.
5.
Cohen, D.J., & Crabtree, B.F. (2008). Evaluative criteria for qualitative research in health care: Controversies and recommendations. Annals of Family Medicine, 6, 331-339. doi:10.1370/afm.818
6.
Creswell, J.W., & Miller, D.L. ( 2000). Determining validity in qualitative inquiry. Theory and Practice, 39, 124-130.
7.
Denzin, N.K. ( 1978). The research act: A theoretical orientation to sociological methods (2nd ed.). New York: McGraw-Hill.
8.
Dixon-Woods, M., Booth, A., & Sutton, A.J. ( 2007). Synthesizing qualitative research: A review of published reports. Qualitative Research, 7, 375-422. doi:10.1177/1468794107078517
9.
Eisner, E. ( 1991). The enlightened eye: Qualitative inquiry and the enhancement of educational practices. New York: Macmillan.
10.
Giacomini, M.K., & Cook, D.J. ( 2000). User’s guide to the medical literature XXIII: Qualitative research in health care. a. Are the results of the study valid?Journal of the American Medical Association, 284, 357-362. doi:10.1001/ jama.284.3.357
11.
Guba, E., & Lincoln, Y. ( 1989). Fourth generation evaluation. Newbury Park, CA: Sage.
12.
Hannes K., & the Cochrane Qualitative Research Methods Group. (2009). Chapter 6: Critical appraisal of qualitative research. Retrieved from http://www.joannabriggs.edu.au/cqrmg/documents/Cochrane_Guidance/Chapter6_Guidance_Critical_Appraisal.pdf
13.
Hannes, K., & Macaitis, K. ( 2010). Update on a review of published qualitative evidence syntheses: Moving toward more systematic and transparent approaches. Manuscript submitted for publication.
14.
Harden, A. ( 2008, June-July). Critical appraisal and qualitative research: Exploring sensitivity analyses. Paper presented at the Research Methods Festival of the National Centre for Research Methods , Oxford, United Kingdom.
15.
Health Care Practice Research & Development Unit. ( 2009). Evaluation tool for qualitative research. Retrieved from http://www.fhsc.salford.ac.uk/hcprdu/qualitative.htm
16.
Higgins, J.P.T., Altman, D.G., the Cochrane Statistical Methods Group, & the Cochrane Bias Methods Group. (2008). Assessing risk of bias in included studies. In J. P. T Higgins & S. Green (Eds.), Cochrane handbook for systematic reviews of interventions (Version 5.0.1) . Retrieved from http://www.cochrane-handbook.org
17.
Joanna Briggs Institute. (2007). SUMARI: The Joanna Briggs Institute system for the unified management, assessment and review of information. Adelaide, Australia: Author. Retrieved from http://www.joannabriggs.edu.au/services/sumari.php
18.
Lincoln, Y., & Guba, E. ( 1985). Naturalistic inquiry. Beverly Hills, CA: Sage.
19.
Maxwell, J.A. ( 1992). Understanding and validity in qualitative research. Harvard Educational Review, 62, 279-300.
20.
Mays, N., & Pope, C. ( 1995). Rigour in qualitative research. British Medical Journal, 311, 109-112.
21.
Miles, M.B., & Huberman, A.M. (1994). Qualitative data analysis: An expanded sourcebook (2nd ed.). Newbury Park, CA: Sage.
22.
Morse, J.M., Barett, M., Mayan, M., Olson, K., & Spiers, J. ( 2002). Verification strategies for establishing reliability and validity in qualitative research. International Journal of Qualitative Methods, 1(2), 1-19. Retrieved from http:// www .ualberta.ca/~iiqm/ backissues/1_2Final/pdf/morseetal .pdf
23.
Public Health Resource Unit, Critical Appraisal Skills Program. (2009). Critical appraisal tool for qualitative studies. Retrieved from http://www.phru.nhs.uk/Doc_Links/Qualitative%20Appraisal%20Tool.pdf
24.
Sandelowski, M. ( 1986). The problem of rigor in qualitative research. Advances in Nursing Science, 8, 27-37.
25.
Seale, C. ( 1999). Quality in qualitative research. Qualitative Inquiry, 5, 465-478. doi:10.1177/107780049900500402
26.
Smith, J.K. ( 1984). The problem of criteria for judging interpretive inquiry . Educational Evaluation and Policy Analysis, 6, 379-391. doi:10.3102/01623737006004379
27.
Stige, B., Malterud, K., & Midtgarden, T. (2009). Toward an agenda for evaluation of qualitative research. Qualitative Health Research, 19, 1504-1516. doi:10.1177/ 1049732309348501
28.
Whittemore, R., Chase, S.K., & Mandle, C.L. ( 2001). Validity in qualitative research. Qualitative Health Research, 11, 522-537. doi:10.1177/104973201129119299
29.
Wilson, T.D. ( 2002, July). Philosophical foundations and research relevance: Issues for information research. Paper presented at the Fourth International Conference on Conceptions of Library and Information Science, Seattle, Washington.
30.
Winter, G.A. ( 2000, March). Comparative discussion of the notion of "validity" in qualitative and quantitative research. The Qualitative Report, 4(3/4). Retrieved from http://www.nova.edu/ssss/QR/QR4-3/winter.html
31.
Yin, R.K. ( 1994). Case study research: Design and methods. Newbury Park, CA: Sage.
