We suggest and illustrate from our experiences of integration in a public health context in Indonesia, a reframing of integration for mixed methods research that focuses on context, outcomes, objects, and integrative mechanisms. Through describing the tools and conceptualizations that helped us integrate, we argue for expanding the scope of integration to include social process methods (which we describe) and for rethinking the desired outcomes of integration. The article contributes to the field of mixed methods research by proposing: (a) a new framing of integration that supports greater precision as well as an expanded scope over what and how integration could be implemented, (b) a set of theoretical and conceptual models to support integration, and (c) a new and fully integrated data collection instrument.
AlaviM.ArchibaldM.McMasterR.LopezV.ClearyM. (2018). Aligning theory and methodology in mixed methods research: Before design theoretical placement. International Journal of Social Research Methodology, 21, 527-540. doi:10.1080/13645579.2018.1435016
2.
AllwoodC. (2012). The distinction between qualitative and quantitative research methods is problematic. Quality & Quantity, 46, 1417-1429. doi:10.1007/s11135-011-9455-8
3.
ArcherM. (1995). Realist social theory: The morphogenetic approach. Cambridge, England: Cambridge University Press.
4.
ArgyrisC.SchönD. A. (1989). Participatory action research and action science compared: A commentary. American Behavioral Scientist, 32, 612-623. doi:10.1177/0002764289032005008
5.
BabuB. V.BabuG. R. (2014). Coverage of, and compliance with, mass drug administration under the programme to eliminate lymphatic filariasis in India: A systematic review. Transactions of the Royal Society of Tropical Medicine & Hygiene, 108, 538-549. doi:10.1093/trstmh/tru057
6.
BarrettL. F. (2014). The conceptual act theory: A précis. Emotion Review, 6, 292-297. doi:10.1177/1754073914534479
7.
BarsalouL. W. (2008). Grounded cognition. Annual Review of Psychology, 59, 617-645.
8.
BarthesR. (1975). An introduction to the structural-analysis of narrative. New Literary History, 6, 237-272.
9.
BazeleyP. (2009). Editorial: Integrating data analyses in mixed methods research. Journal of Mixed Methods Research, 3(3), 203-207. doi:10.1177/1558689809334443
BazeleyP.KempL. (2012). Mosaics, triangles, and DNA: Metaphors for integrated analysis in mixed methods research. Journal of Mixed Methods Research, 6(1), 55-72. doi:10.1177/1558689811419514
12.
BleiD. M. (2012). Probabilistic topic models. Communications of the ACM, 55, 77-84. doi:10.1145/2133806.2133826
13.
BricksonS. L. (2005). Organizational identity orientation: Forging a link between organizational identity and organizations’ relations with stakeholders. Administrative Science Quarterly, 50, 576-609. doi:10.2189/asqu.50.4.576
14.
BrunerJ. S. (1990). Acts of meaning. Cambridge, MA: Harvard University Press.
15.
BrymanA. (2007). Barriers to integrating quantitative and qualitative research. Journal of Mixed Methods Research, 1(1), 8-22. doi:10.1177/2345678906290531
16.
BrymanA. (2008). Why do researchers integrate/combine/mesh/blend/mix/merge/fuse quantitative and qualitative research? In BergmanM. (Ed.), Advances in mixed methods research (pp. 86-100). Thousand Oaks, CA: Sage.
17.
BurchP.HeinrichC. J. (2016). Mixed methods for policy research and program evaluation. Thousand Oaks, CA: Sage.
18.
CaracelliV. J.GreeneJ. C. (1993). Data analysis strategies for mixed-method evaluation designs. Educational Evaluation and Policy Analysis, 15, 195-207. doi:10.2307/1164421
19.
CastroF. G.CoeK. (2016). Traditions and alcohol use: A mixed-methods analysis. Cultural Diversity & Ethnic Minority Psychology, 13, 269-284. doi:10.1037/1099-9809.13.4.269
20.
CastroF. G.KellisonJ. G.BoydS. J.KopakA. (2010). A methodology for conducting integrative mixed methods research and data analyses. Journal of Mixed Methods Research, 4(4), 342-360. doi:10.1177/1558689810382916
21.
ChenH. T. (2006). A theory-driven evaluation perspective on mixed methods research. Research in the Schools, 13, 75–83.
22.
ChristensB.FaustV.GaddisJ.Tran InzeoP.SarmientoC.SparksS. (2016). Action research. In JasonL. A.GlenwickD. S. (Eds.), Handbook of methodological approaches to community-based research: Qualitative, quantitative, and mixed methods (pp. 243-251). Oxford, England: Oxford University Press.
23.
ClandininD. J.ConnellyF. M. (2000). Narrative inquiry: Experience and story in qualitative research (1st ed.). Thousand Oaks, CA: Jossey-Bass.
24.
CreamerE. G. (2018). An introduction to fully integrated mixed methods research. Thousand Oaks, CA: Sage.
25.
CzarniawskaB. (2002). Narrative, interviews and organizations. In GubriumJ. F.HolsteinJ. A. (Eds.), Handbook of interview research (pp. 733-749). London, England: Sage.
26.
ErcikanK.RothW.-M. (2006). What good is polarizing research into qualitative and quantitative?Educational Researcher, 35(5), 14-23. doi:10.3102/0013189X035005014
27.
FettersM. D.CurryL. A.CreswellJ. W. (2013). Achieving integration in mixed methods designs: Principles and practices. Health Services Research, 48, 2134-2156. doi:10.1111/1475-6773.12117
28.
FettersM. D.FreshwaterD. (2015). The 1 + 1 = 3 integration challenge. Journal of Mixed Methods Research, 9(2), 115-117. doi:10.1177/1558689815581222
29.
FettersM. D.Molina-AzorinJ. F. (2017). The Journal of Mixed Methods Research starts a new decade: The mixed methods research integration trilogy and its dimensions. Journal of Mixed Methods Research, 11, 291-307. doi.org/10.1177/1558689817714066
30.
FieldingN. (2010). Mixed methods research in the real world. International Journal of Social Research Methodology, 13, 127-138. doi:10.1080/13645570902996186
31.
FieldingN. (2012). Triangulation and mixed methods designs: Data integration with new research technologies. Journal of Mixed Methods Research, 6(2), 124-136. doi:10.1177/1558689812437101
32.
FranzA.WorrellM.VögeleC. (2013). Integrating mixed method data in psychological research: Combining Q methodology and questionnaires in a study investigating cultural and psychological influences on adolescent sexual behavior. Journal of Mixed Methods Research, 7(4), 370-389. doi:10.1177/1558689813483368
33.
GorardS. (2004). Sceptical or clerical? Theory as a barrier to the combination of research methods. Journal of Educational Enquiry, 5(1), 1-21.
34.
GreeneJ. C. (2006). Toward a methodology of mixed methods social inquiry. Research in the Schools, 13, 93-99.
35.
GreeneJ. C.CaracelliV. J.GrahamW. F. (1989). Toward a conceptual framework for mixed-method evaluation designs. Educational Evaluation and Policy Analysis, 11, 255-274. doi:10.2307/1163620
36.
GreenoJ. G. (1994). Gibson’s affordances. Psychological Review, 101, 336-342. doi:10.1037/0033-295X.101.2.336
37.
GyapongJ. O.KumaraswamiV.BiswasG.OttesenE. A. (2005). Treatment strategies underpinning the global programme to eliminate lymphatic filariasis. Expert Opinion on Pharmacotherapy, 6, 179-200. doi:10.1517/14656566.6.2.179
38.
GyapongJ. O.Twum-DansoN. A. (2006). Global elimination of lymphatic filariasis: Fact or fantasy?Tropical Medicine & International Health, 11, 125-128. doi:10.1111/j.1365-3156.2005.01542.x
39.
HallB.HowardK. (2008). A synergistic approach: Conducting mixed methods research with typological and systemic design considerations. Journal of Mixed Methods Research, 2(3), 248-269. doi:10.1177/1558689808314622
40.
HendersonR. H.SundaresanT. (1982). Cluster sampling to assess immunization coverage: A review of experience with a simplified sampling method. Bulletin of the World Health Organization, 60, 253-260.
41.
HeronJ. (1996). Quality as primacy of the practical. Qualitative Inquiry, 2, 41-56. doi:10.1177/107780049600200107
42.
Hesse-BiberS. (2016). Doing interdisciplinary mixed methods health care research: Working the boundaries, tensions, and synergistic potential of team-based research. Qualitative Health Research, 26, 649-658. doi:10.1177/1049732316634304
43.
HeyvaertM.HannesK.MaesB.OnghenaP. (2013). Critical appraisal of mixed methods studies. Journal of Mixed Methods Research, 7(4), 302-327. doi:10.1177/1558689813479449
44.
HooperP. J.ChuB. K.MikhailovA.OttesenE. A.BradleyM. (2014). Assessing progress in reducing the at-risk population after 13 years of the global programme to eliminate lymphatic filariasis. PLoS Neglected Tropical Diseases, 8, e3333. doi:10.1371/journal.pntd.0003333
JangE. E.McDougallD. E.PollonD.HerbertM.RussellP. (2008). Integrative mixed methods data analytic strategies in research on school success in challenging circumstances. Journal of Mixed Methods Research, 2(3), 221-247. doi:10.1177/1558689808315323
47.
JohnsonR. B.OnwuegbuzieA. J.TurnerL. A. (2007). Toward a definition of mixed methods research. Journal of Mixed Methods Research, 1(2), 112-133. doi:10.1177/1558689806298224
48.
JonesN. A.RossH.LynamT.PerezP. (2014). Eliciting mental models: A comparison of interview procedures in the context of natural resource management. Ecology and Society, 19(1), 13. doi:10.5751/ES-06248-190113
49.
KimbleC.GrenierC.Goglio-PrimardK. (2010). Innovation and knowledge sharing across professional boundaries: Political interplay between boundary objects and brokers. International Journal of Information Management, 30, 437-444. doi:10.1016/j.ijinfomgt.2010.02.002
50.
KisokaW. J.SimonsenP. E.MalecelaM. N.TersbølB. P.MushiD. L.MeyrowitschD. W. (2014). Factors influencing drug uptake during mass drug administration for control of lymphatic filariasis in rural and urban Tanzania. PLoS ONE, 9, e109316. doi:10.1371/journal.pone.0109316
51.
KrentelA.DamayantiR.TitaleyC. R.SuharnoN.BradleyM.LynamT. (2016). Improving coverage and compliance in mass drug administration for the elimination of LF in two “endgame” districts in Indonesia using micronarrative surveys. PLoS Neglected Tropical Diseases, 10, e0005027. doi:10.1371/journal.pntd.0005027
LeavyP. (2017). Research design: Quantitative, qualitative, mixed methods, arts-based, and community-based participatory research approaches. New York, NY: Guilford Press.
54.
LewinK. (1946). Action research and minority problems. Journal of Social Issues, 2, 34-46. doi:10.1111/j.1540-4560.1946.tb02295.x
55.
LoftusE. F. (1996). Memory distortion and false memory creation. Bulletin of the American Academy of Psychiatry and the Law, 24, 281-295.
56.
LynamT.MathevetR.EtienneM.Stone-JovicichS.LeitchA.JonesN.PerezP. (2012). Waypoints on a journey of discovery: Mental models in human-environment interactions. Ecology and Society, 17(3), 23. doi:10.5751/ES-05118-170323
57.
MandlerJ. M. (1984). Stories, scripts, and scenes: Aspects of schema theory. Hillsdale, NJ: Lawrence Erlbaum.
58.
MayneR.GreenD.GuijtI.WalshM.EnglishR.CairneyP. (2018). Using evidence to influence policy: Oxfam’s experience. Palgrave Communications, 4(1), 122. doi:10.1057/s41599-018-0176-7
59.
McCruddenM. T.McTigueE. M. (2018). Implementing integration in an explanatory sequential mixed methods study of belief bias about climate change with high school students. Journal of Mixed Methods Research, 13(3), 381-400. doi:10.1177/1558689818762576
60.
MertensD. M. (2016). Advancing social change in South Africa through transformative research. South African Review of Sociology, 47, 5-17. doi:10.1080/21528586.2015.1131622
MoatK. A.LavisJ. N.AbelsonJ. (2013). How contexts and issues influence the use of policy relevant research syntheses: A critical interpretive synthesis. Milbank Quarterly, 91, 604-648.
63.
Moran-EllisJ.AlexanderV. D.CroninA.DickinsonM.FieldingJ.SleneyJ.ThomasH. (2006). Triangulation and integration: Processes, claims and implications. Qualitative Research, 6, 45-59. doi:10.1177/1468794106058870
64.
MoscoviciS. (1984). The phenomenon of social representations. In FarrR. M.MoscoviciS. (Eds.), Social representations (pp. 3-69). Cambridge, England: Cambridge University Press.
65.
MoultonS.SandfortJ. R. (2017). The strategic action field framework for policy implementation research: The strategic action field framework. Policy Studies Journal, 45, 144-169. doi:10.1111/psj.12147
66.
NastasiB. K.HitchcockJ.SarkarS.BurkholderG.VarjasK.JayasenaA. (2007). Mixed methods in intervention research: Theory to adaptation. Journal of Mixed Methods Research, 1(2), 164-182. doi:10.1177/1558689806298181
67.
NjomoD. W.MukokoD. A.NyamongoN. K.KaranjaJ. (2014). Increasing coverage in mass drug administration for lymphatic filariasis elimination in an urban setting: A study of Malindi town, Kenya. PLoS ONE, 9, e83413. doi:10.1371/journal.pone.0083413
68.
O’CathainA.MurphyE.NichollJ. (2007). Integration and publications as indicators of “yield” from mixed methods studies. Journal of Mixed Methods Research, 1(2), 147-163. doi:10.1177/1558689806299094
69.
O’CathainA.MurphyE.NichollJ. (2010). Three techniques for integrating data in mixed methods studies. British Medical Journal, 341, 1147-1150.
70.
O’ConnorC. (2017). Embodiment and the construction of social knowledge: Towards an integration of embodiment and social representations theory. Journal for the Theory of Social Behaviour, 47, 2-24. doi:10.1111/jtsb.12110
71.
OnwuegbuzieA. J.JohnsonR. B.CollinsK. M. (2009). Call for mixed analysis: A philosophical framework for combining qualitative and quantitative approaches. International Journal of Multiple Research Approaches, 3, 114-139. doi:10.5172/mra.3.2.114
72.
OnwuegbuzieA. J.SlateJ. R.LeechN. L.CollinsK. M. (2009). Mixed data analysis: Advanced integration techniques. International Journal of Multiple Research Approaches, 3, 13-33. doi:10.5172/mra.455.3.1.13
73.
OttesenE. A.HooperP. J.BradleyM.BiswasG. (2008). The global programme to eliminate lymphatic filariasis: Health impact after 8 years. PLoS Neglected Tropical Diseases, 2(10), e317. doi:10.1371/journal.pntd.0000317
74.
PattersonR. E.PierceB. J.BellH. H.KleinG. (2010). Implicit learning, tacit knowledge, expertise development, and naturalistic decision making. Journal of Cognitive Engineering and Decision Making, 4, 289-303. doi:10.1177/155534341000400403
75.
Plano ClarkV. L. (2019). Meaningful integration within mixed methods studies: Identifying why, what, when, and how. Contemporary Educational Psychology, 57, 106-111. doi:10.1016/j.cedpsych.2019.01.007
76.
RobertsM. E.StewartB. M.TingleyD.LucasC.Leder-LuisJ.GadarianS. K.RandD. G. (2014). Structural topic models for open-ended survey responses. American Journal of Political Science, 58, 1064-1082. doi:10.1111/ajps.12103
77.
SandelowskiM. (2011). When a cigar is not just a cigar: Alternative takes on data and data analysis. Research in Nursing & Health, 34, 342-352. doi:10.1002/nur.20437
78.
SandelowskiM. (2014). Unmixing mixed-methods research. Research in Nursing & Health, 37, 3-8. doi:10.1002/nur.21570
79.
ShoveE. (2010). Beyond the ABC: Climate change policy and theories of social change. Environment and Planning A: Economy and Space, 42, 1273-1285. doi:10.1068/a42282
80.
SligoJ. L.NairnK. M.McGeeR. O. (2018). Rethinking integration in mixed methods research using data from different eras: Lessons from a project about teenage vocational behaviour. International Journal of Social Research Methodology, 21, 63-75. doi:10.1080/13645579.2017.1321868
81.
SmithE.SeminG. (2004). Socially situated cognition: Cognition in its social context. Advances in Experimental Social Psychology, 36, 53-117.
82.
StarS. L.GriesemerJ. R. (1989). Institutional ecology, “translations” and boundary objects: Amateurs and professionals in Berkeley’s museum of vertebrate zoology, 1907-39. Social Studies of Science, 19, 387-420.
83.
SweetmanD.BadieeM.CreswellJ. W. (2010). Use of the transformative framework in mixed methods studies. Qualitative Inquiry, 16, 441-454. doi:10.1177/1077800410364610
84.
TitaleyC. R.DamayantiR.SoeharnoN.Mu’asyarohA.BradleyM.LynamT.KrentelA. (2018). Assessing knowledge about lymphatic filariasis and the implementation of mass drug administration amongst drug deliverers in three districts/cities of Indonesia. Parasites & Vectors, 11(1), 315. doi:10.1186/s13071-018-2881-x
85.
ValsinerJ. (2000). Data as representations: Contextualizing qualitative and quantitative research strategies. Social Science Information, 39, 99-113. doi:10.1177/053901800039001006
86.
VoglS. (2019). Integrating and consolidating data in mixed methods data analysis: Examples from focus group data with children. Journal of Mixed Methods Research, 13(4), 536-554. doi:10.1177/1558689818796364
87.
WagnerW. (2015). Representation in action. In AndreouliE.GaskellG.SammutG.ValsinerJ. (Eds.), The Cambridge handbook of social representations (pp. 12-28). Cambridge, England: Cambridge University Press.
88.
WagnerW.HayesN. (2005). Everyday discourse and common sense: The theory of social representations. Houndmills, England: Palgrave Macmillan.
89.
WoolleyC. M. (2009). Meeting the mixed methods challenge of integration in a sociological study of structure and agency. Journal of Mixed Methods Research, 3(1), 7-25. doi:10.1177/1558689808325774
90.
YinR. K. (2006). Mixed methods research: Are the methods genuinely integrated or merely parallel?Research in the Schools, 13, 41-47.
