Combining diverse methods in a single study raises a problem: What should be done when the findings of one method of investigation conflict with those of another? The authors illustrate this problem using an example in which three study phases—quantitative, qualitative, and intervention—are applied. The findings from the quantitative phase did not fit those from the qualitative phase; there were discrepancies within the qualitative phase itself, and the findings from the single-case evaluations of the intervention using standardized scales did not fit the findings derived from self-made scales. The authors explain these inconsistencies by way of the complementary approach: Conflicting findings should be integrated, and consistency is restored by admitting complexity in the phenomenon under investigation.
Achenbach, T.M. (1991a). Manual for the Child Behavior Checklist/4-18 and 1991 profile. Burlington: University of Vermont, Department of Psychiatry.
2.
Achenbach, T.M. (1991b). Manual for the Youth Self-Report Form and 1991 profile. Burlington: University of Vermont, Department of Psychiatry.
3.
Achenbach, T.M., Howell, C.T., McConaughy, S.H., & Stanger, C. (1995). Six-year predictors of problems in a national sample of children and youth: I. Cross-informant syndromes. Journal of the American Academy of Child & Adolescent Psychiatry, 34, 336-347.
4.
Beck, A.T. (1967). Depression: Clinical experimental and theoretical aspects. New York: Harper & Row.
5.
Ben-David, A., & Lavee, Y. (1994). Migration and marital distress: The case of Soviet immigrants. Journal of Divorce and Remarriage, 21, 133-146.
6.
Bloom, M., Fischer, J., & Orme, J.G. (2006). Evaluating practice: Guidelines for the accountable professional (5th ed.). Boston : Allyn & Bacon.
7.
Bogdan, R.C., & Biklen, S.K. (2006). Qualitative research for education: An introduction to theories and methods (5th ed.). Boston: Pearson Education Group.
8.
Brannen, J. (2005). Mixing methods: The entry of qualitative and quantitative approaches into the research process. International Journal of Social Research Methodology, 8, 173-184.
9.
Bryman, A. (2007). Barriers to integrating quantitative and qualitative research. Journal of Mixed Methods Research, 1(1), 8-22.
10.
Burns, B. J., & Goldman, S. K. (Eds.). (1999). Systems of care: Promising practices in children's mental health, 1998 series: Vol. IV. Promising practices in wraparound for children with serious emotional disturbance and their families. Washington, DC: Center for Effective Collaboration and Practice, American Institute for Research .
11.
Christ, T.W. (2007). A recursive approach to mixed methods research in a longitudinal study of postsecondary education disability support services . Journal of Mixed Methods Research, 1(3), 226-241.
12.
Creswell, J.W. (2002). Educational research: Planning, conducting, and evaluating quantitative and qualitative research. Upper Saddle River, NJ: Merrill Prentice Hall.
13.
Creswell, J.W., & Plano Clark, V.L. (2007). Designing and conducting mixed methods research. Thousand Oaks, CA: Sage.
14.
Creswell, J.W., & Tashakkori, A. (2007). Developing publishable mixed methods manuscripts. Journal of Mixed Methods Research , 1(2), 107-111.
15.
Denzin, N.K., & Lincoln, Y.S. (2000). Introduction: The discipline and practice of qualitative research. In N. K. Denzin & Y. S. Lincoln (Eds.), Handbook of qualitative research (pp. 1-28). Thousand Oaks, CA: Sage.
16.
Deren, S., Oliver, V.D., Finlinson, A., Robles, R., Andia, J., Colon, H.M., et al. (2003). Integrating qualitative and quantitative methods: Comparing HIV-related risk behaviors among Puerto Rican drug users in Puerto Rico and New York. Substance Use and Misuse, 38, 1-24.
17.
Diener, E., Emmons, R.A., Larsen, R.J., & Griffin, S. (1985). The Satisfaction With Life Scale. Journal of Personality Assessment, 4, 71-75.
18.
Epstein, L. (1996). The trouble with the researcher-practitioner idea . Social Work Research, 20, 113-117.
19.
Erzberger, C., & Kelle, U. (2003). Making inferences in mixed methods: The rules of integration. In A. Tashakkori & C. Teddlie (Eds.), Handbook of mixed methods in social & behavioral sciences (pp. 457-490). Thousand Oaks, CA: Sage.
20.
Glasser, B.G., & Strauss, A.L. (1967). The discovery of grounded theory: Strategies for qualitative research. New York: Aldine.
21.
Goetz, J.P., & LeCompte, M.D. (1984). Ethnography and qualitative design in educational research. San Diego, CA: Academic Press.
22.
Gray-Little, B., Williams, V.S.L., & Hancock, T.D. (1997). An item response theory analysis of the Rosenberg Self-Esteem Scale. Personality and Social Psychology Bulletin , 23, 443-451.
23.
Greene, J.C. (2007). Mixed methods in social inquiry: Research methods for the social sciences. San Francisco, CA: Jossey-Bass.
24.
Hall, B., & Howard, K. (2008). A synergistic approach: Conducting mixed methods research with typological and systemic design considerations. Journal of Mixed Methods Research, 2(3), 248-269.
25.
Hanson, W.E., Creswell, J.W., Plano Clark, V.L., Petska, K.P., & Creswell, J.D. (2005). Mixed methods research designs in counseling psychology. Journal of Counseling Psychology , 52, 224-235.
Hyde, K.L., Burchard, J.D., & Woodworth, K. (1996). Wrapping services in an urban setting. Journal of Child and Family Studies, 5, 67-82.
28.
Lancy, D.F. (1993). Qualitative research in education: An introduction to the major traditions. New York: Longman.
29.
Mele, A.R. (2001). Self-deception unmasked. Princeton, NJ: Princeton University Press.
30.
Miller, I.W., Epstein, N.B., Bishop, D.S., & Keitner, G.I. (1985). The McMaster Family Assessment Device: Reliability and validity. Journal of Marital and Family Therapy, 1, 345-356.
31.
Moon, S., Dilon, D., & Sprenkle, D. (1990). Family therapy and qualitative research. Journal of Marital and Family Therapy, 16, 373-375.
32.
Morgan, D.L. (1998). Practical strategies for combining qualitative and quantitative methods: Applications to health research. Qualitative Health Research, 8, 362-376.
33.
Morgan, D.L. (2007). Paradigms lost and pragmatism regained: Methodological implications of combining qualitative and quantitative methods. Journal of Mixed Methods Research, 1(1), 48-76.
34.
Morse, J.M., Barrett, M., Mayan, M., Olson, K., & Spiers, J. (2002). Verification strategies for establishing reliability and validity in qualitative research. International Journal of Qualitative Methods, 1, 1-19.
35.
O'Cathain, A., Murphy, E., & Nicholl, J. (2007). Integration and publications as indicators of ``yield'' from mixed methods studies. Journal of Mixed Methods Research, 1(2), 147-163.
36.
Olley, B.O. (2006). Social and health behaviors in youth of the streets of Ibadan, Nigeria. Child Abuse & Neglect, 30, 271-282.
37.
Rao, V., & Woolcock, M. (2003). Integrating qualitative and quantitative approaches in program evaluation. In F. J. Bourguignon & L. P. da Silva (Eds.), Evaluating the poverty and distributional impact of economic policies (pp. 165-190). New York: Oxford University Press.
38.
Richardson, L. (2000). Evaluating ethnography. Qualitative Inquiry, 6, 253-255.
39.
Ridenour, T.A., Daley, J.G., & Reich, W. (1999). Factor analyses of the Family Assessment Device . Family Process, 38, 497-510.
40.
Roer-Strier, D. (1997). In the mind of the beholder: Evaluation of coping styles of immigrant parents. International Migration, 35, 271-286.
41.
Rosenau, P.M. (1992). Post-modernism and the social sciences. Princeton, NJ: Princeton University Press.
42.
Rosenberg, M. (1979). Conceiving the self. New York : Basic Books.
43.
Rossman, G.B., & Rallis, S.F. (2003). Learning in the field: An introduction to qualitative research. New-bury Park, CA: Sage .
44.
Sale, J.E.M., Lohfeld, L.H., & Brazil, K. (2002). Revisiting the quantitative-qualitative debate: Implications for mixed-methods research. Quality & Quantity , 36, 43-53.
45.
Sargeant, A., Hilton, T., & Wymer, W. (2006). Bequest motives and barriers to giving: The case of direct mail donors. Nonprofit Management and Leadership , 17, 49-66.
46.
Savaya, R., & Cohen, O. (1998). A qualitative cum quantitative approach to construct definition in a minority population: Reasons for divorce among Israeli Arab women. Journal of Sociology and Social Welfare, 25, 157-179.
47.
Shaffer, P. (2002). Poverty naturalized: Implications for gender. Feminist Economics, 8, 55-76.
48.
Slonim-Nevo, V., Auslander, W.F., Ozawa, M.N., & Jung, K.G. (1996). The long-term impact of AIDS preventive interventions for delinquent and abused adolescents. Adolescence, 31, 409-422.
49.
Slonim-Nevo, V., Mirsky, J., Aurbach, J., Horowitz, T., & Vitzum, E. (2006). Stories of success and failure among immigrant adolescents at risk: Developing a model of family intervention in the community . Beer Sheva: Israeli Ministry of Science.
50.
Slonim-Nevo, V., & Sheraga, Y. (1997). Social and psychological adjustment of Soviet-born and Israeli-born adolescents: The effect of the family. Israeli Journal of Psychiatry, 34, 128-138.
51.
Smith, J., & Deemer, D. (2000). The problem of criteria in the age of relativism . In N. K. Denzin & Y. S. Lincoln (Eds.), Handbook of qualitative research (pp. 877-896). Thousand Oaks, CA: Sage.
52.
Sosulski, M.R., & Lawrence, C. (2008). Mixing methods for full-strength results. Journal of Mixed Methods Research, 2(2), 121-148.
53.
Tashakkori, A., Barefoot, J., & Mehryar, A.H. (1989). What does the Beck Depression Inventory measure in college students? Evidence from a non-Western culture. Journal of Clinical Psychology, 45, 595-602.
54.
Tashakkori, A., & Creswell, J.W. (2007). The new era of mixed methods . Journal of Mixed Methods Research, 11(1), 3-7.
55.
Tashakkori, A., & Teddlie, C. (1998). Mixed methodology: Combining qualitative and quantitative approaches. Thousand Oaks, CA: Sage.
56.
Teddlie, C., & Tashakkori, A. (2008). Foundations of mixed methods research: Integrating quantitative and qualitative techniques in the social and behavioral sciences. Thousand Oaks, CA: Sage.
57.
Teddlie, C., & Yu, F. (2007). Mixed methods sampling: A typology with examples . Journal of Mixed Methods Research, 1(1), 77-100.
58.
Thyer, B.A. (1989). First principles of practice research. British Journal of Social Work, 19, 309-323.
59.
Tobin, G.A., & Begley, C.M. (2004). Methodological issues in nursing research: Methodological rigor within a qualitative framework. Journal of Advanced Nursing, 48, 388-396.
60.
Vitale, D.C., Armenakis, A.A., & Field, H.S. (2008). Integrating qualitative and quantitative methods for organizational diagnosis: Possible priming effects? Journal of Mixed Methods Research, 2(1), 87-105.
61.
Wakefield, J.C., & Kirl, S.A. (1996). Unscientific thinking about scientific practice: Evaluating the scientist-practitioner model. Social Work Research , 20, 83-95.
62.
Winch, P. (1958). The idea of a social science. London: Routledge Kegan Paul.
63.
Witkin, S.L. (1996). If empirical practice is the answer, then what is the question? Social Work Research, 20, 69-75.
64.
Wright, P.D. (2008). Interactions between perceived behavioral control and personal-normative motives. Journal of Mixed Methods Research , 2(1), 63-86.
65.
Young, A., & Chang, D.F. (2002). Adjustment disorder: Intergenerational conflict in a Chinese immigrant family: Clinical case history. Culture, Medicine and Psychiatry, 26, 509-525.
66.
Zeira, A., & Rosen, A. (2000). Unraveling ``tacit knowledge'': What social workers do and why they do it. Social Service Review, 74, 103-123.
