A Novel Mixed Methods Approach for Integrating Not-for-Profit Service Data via Qualitative Geographic Information System to Explore Authentic Experiences of Ill-Health: A Case Study of Rural Mental Health

Abstract

Meeting the mental health needs of rural populations is challenging internationally, with few methods and scarce data available to inform site-specific planning. We developed a mixed methods approach that integrates Not-for-profit (NFP) organization data in a Geographic Information System (GIS) to explore interrelated understandings of mental health experiences in rural places. Integrating qualitative experience data from online forums with quantitative data from service search and emergency pickup locations via GIS demonstrates how NFP health service data can be ethically sourced, reused, integrated, analyzed, and ground-truthed to explore how mental health is experienced in rural places. This article contributes to the mixed methods literature an ethical approach that utilizes NFP health service datasets to inform research in contexts of data scarcity.

Keywords

mixed methods not-for-profit organization qualitative GIS mental health rural

Get full access to this article

View all access options for this article.

References

Australian Bureau of Statistics . (2011). Australian population grid 2011. https://www.abs.gov.au/ausstats/abs@.nsf/mf/1270.0.55.007

Australian Bureau of Statistics . (2015). National health survey 2014-15. https://www.abs.gov.au/AUSSTATS/abs@.nsf/DetailsPage/4364.0.55.0012014-15

Australian Bureau of Statistics . (2016). Census of population and housing. https://www.abs.gov.au/statistics/people/aboriginal-and-torres-strait-islander-peoples/census-population-and-housing-counts-aboriginal-and-torres-strait-islander-australians/latest-release

Australian Bureau of Statistics . (2018). The Australian statistical geography standard (ASGS) remoteness structure. https://www.abs.gov.au/websitedbs/d3310114.nsf/home/australian+statistical+geography+standard+(asgs

Bain

S. F.

Munoz

S.-A.

(2020). 9 Rural mental health and global ethical perspectives. Mental Health and Wellbeing in Rural Regions: International Perspectives, 150.

Barbieri

Jorm

(2019). Travel times to hospitals in Australia. Scientific Data, 6, 248. https://doi.org/10.1038/s41597-019-0266-4

Bauer

Spiessl

Kagerbauer

(2013). Cyber-support: An analysis of online self-help forums (online self-help forums in bipolar disorder). Nordic Journal of Psychiatry, 67(3), 185–190. https://doi.org/10.3109/08039488.2012.700734

Boslaugh

(2007). Encyclopedia of epidemiology. Sage Publications.

Byrne

Roper

Happell

Reid-Searl

(2019). The stigma of identifying as having a lived experience runs before me: Challenges for lived experience roles. Journal of Mental Health, 28(3), 260–266. https://doi.org/10.1080/09638237.2016.1244715

10.

Carbon

Champieux

McMurry

J. A.

Winfree

Wyatt

L. R.

Haendel

M. A.

(2019). An analysis and metric of reusable data licensing practices for biomedical resources. Plos One, 14(3), Article e0213090. https://doi.org/10.1371/journal.pone.0213090

11.

Citrin

Mehanni

Acharya

Wong

Nirola

Sherchan

Gauchan

Karki

K. B.

Singh

D. R.

Shamasunder

Schwarz

Dangal

Dhungana

S. K.

Maru

Mahar

Thapa

Raut

Maru

(2017). Power, potential, and pitfalls in global health academic partnerships: Review and reflections on an approach in Nepal. Global Health Action, 10(1), 1367161. https://doi.org/10.1080/16549716.2017.1367161

12.

Cope

Elwood

(2009). Qualitative GIS: A mixed methods approach. Sage.

13.

Cresswell-Smith

Macintyre

A. K.

Wahlbeck

(2021). Untapped potential? Action by non-governmental organisations on the social determinants of mental health in high-income countries: An integrative review. Voluntary Sector Review.

14.

Creswell

J. W.

(1994). Research design. Sage.

15.

Creswell

J. W.

Plano Clark

V. L.

(2017). Designing and conducting mixed methods research. Sage publications.

16.

de Las Casas

Gyateng

Pritchard

(2013). The power of data: Is the charity sector ready to plug in.

17.

DeLyser

Herbert

Aitken

Crang

McDowell

(2009). The SAGE handbook of qualitative geography. Sage.

18.

D’Ignazio

Klein

L. F.

(2016). Feminist data visualization. Workshop on visualization for the digital humanities (VIS4DH). IEEE,

19.

D'Ignazio

Klein

L. F.

(2020). Data feminism. Mit Press.

20.

Elwood

(2008). Volunteered geographic information: Future research directions motivated by critical, participatory, and feminist GIS. GeoJournal, 72(3), 173–183. https://doi.org/10.1007/s10708-008-9186-0

21.

Elwood

(2010). Mixed methods: Thinking, doing, and asking in multiple ways (Vol. 1). Sage.

22.

Fernandez

Gillespie

J. A.

Smith-Merry

Feng

Astell-Burt

Maas

Salvador-Carulla

(2017). Integrated mental health atlas of the Western Sydney local health district: Gaps and recommendations. Australian Health Review, 41(1), 38–44. https://doi.org/10.1071/AH15154

23.

Fetters

M. D.

Curry

L. A.

Creswell

J. W.

(2013). Achieving integration in mixed methods designs—Principles and practices. Health Services Research, 48(6 Pt 2), 2134–2156. https://doi.org/10.1111/1475-6773.12117

24.

Fetters

M. D.

Freshwater

(2015). The 1 + 1= 3 integration challenge. Journal of Mixed Methods Research, 9(2), 115–117. https://doi.org/10.1177/1558689815581222

25.

Fielding

Cisneros-Puebla

C. A.

(2009). CAQDAS-GIS convergence: Toward a new integrated mixed method research practice? Journal of Mixed Methods Research, 3(4), 349–370. https://doi.org/10.1177/1558689809344973

26.

Ford

Boyd

Bowles

Havard

Aldridge

Curcin

Greiver

Harron

Katikireddi

Rodgers

Sperrin

2019). Our data, our society, our health: A vision for inclusive and transparent health data science in the United Kingdom and beyond. Learning Health Systems, 3(3), Article e10191. https://doi.org/10.1002/lrh2.10191

27.

Gardiner

F. W.

Coleman

Teoh

Harwood

Coffee

N. T.

Gale

Bishop

Laverty

(2019). Aeromedical retrievals of people for mental health care and the low level of clinical support in rural and remote Australia. Medical Journal of Australia, 211(8), 351–356. https://doi.org/10.5694/mja2.50272

28.

General Data Protection Regulation . (2018). Guide to general data protection regulation. https://www.gov.uk/government/publications/guide-to-the-general-data-protection-regulation

29.

Gooding

(2017). The role of NGOs’ service delivery experience in developing relevant research agendas: Experience and challenges among NGOs in Malawi. Health Research Policy and Systems, 15(1), 1–14. https://doi.org/10.1186/s12961-017-0199-3

30.

Guetterman

T. C.

Fetters

M. D.

Creswell

J. W.

(2015). Integrating quantitative and qualitative results in health science mixed methods research through joint displays. The Annals of Family Medicine, 13(6), 554–561. https://doi.org/10.1370/afm.1865

31.

Harris

L. M.

(2015). Deconstructing the map after 25 years: Furthering engagements with social theory. Cartographica: The International Journal for Geographic Information and Geovisualization, 50(1), 50–53. https://doi.org/10.3138/carto.50.1.10

32.

Hawthorne

T. L.

Solís

Terry

Price

Atchison

C. L.

(2015). Critical reflection mapping as a hybrid methodology for examining sociospatial perceptions of new research sites. Annals of the Association of American Geographers, 105(1), 22–47. https://doi.org/10.1080/00045608.2014.960041

33.

Henderson

Dawson

Fuller

O'Kane

Gerace

Oster

Cochrane

E. M.

(2018). Regional responses to the challenge of delivering integrated care to older people with mental health problems in rural Australia. Aging & Mental Health, 22(8), 1025–1031. https://doi.org/10.1080/13607863.2017.1320702

34.

Hickie

I. B.

Davenport

T. A.

Burns

J. M.

Milton

A. C.

Ospina-Pinillos

Whittle

Ricci

C. S.

McLoughlin

L. T.

Mendoza

Cross

S. P.

Piper

S. E.

Iorfino

LaMonica

H. M.

(2019). Project Synergy: Co‐designing technology‐enabled solutions for Australian mental health services reform. Medical Journal of Australia, 211(Suppl 7), S3–S39. https://doi.org/10.5694/mja2.50349

35.

Hou

Wang

(2017). Hacking with NPOs: Collaborative analytics and broker roles in civic data hackathons. Proceedings of the ACM on Human-Computer Interaction, 1(CSCW), 1–16. https://doi.org/10.1145/3134688

36.

Ivankova

Creswell

Stick

(2006). Using mixed-methods sequential explanatory design: From theory to practice. Field Methods, 18(1), 3–20. https://doi.org/10.1177/1525822x05282260

37.

Ivankova

Kawamura

(2010). Ev designs in the social, behavioral and health sciences. In A. Tashakkori & C. Teddlie (Eds.), The Sage handbook of mixed methods in social and behavioral research (2nd ed., pp. 581-611). London, England: SAGE.

38.

Jung

J. K.

Elwood

(2010). Extending the qualitative capabilities of GIS: Computer‐aided qualitative GIS. Transactions in GIS, 14(1), 63–87. https://doi.org/10.1111/j.1467-9671.2009.01182.x

39.

Kamstra

Cook

Kennedy

M. D.

Brennan-Horley

(2019). Qualitative GIS to relate perceptions with behaviors among Fishers on risky, rocky coasts. The Professional Geographer, 71(3), 491–506. https://doi.org/10.1080/00330124.2018.1559656

40.

Knigge

Cope

(2006). Grounded visualization: Integrating the analysis of qualitative and quantitative data through grounded theory and visualization. Environment and Planning A, 38(11), 2021–2037. https://doi.org/10.1068/a37327

41.

Kwan

M.-P.

(2002). Feminist visualization: Re-Envisioning GIS as a method in feminist geographic research. Annals of the Association of American Geographers, 92(4), 645–661. https://doi.org/10.1111/1467-8306.00309

42.

Kwan

M.-P.

Ding

(2008). Geo-Narrative: Extending geographic information systems for narrative analysis in qualitative and mixed-method research. The Professional Geographer, 60(4), 443–465. https://doi.org/10.1080/00330120802211752

43.

Kwan

M.-P.

Knigge

(2006). Doing qualitative research using GIS: An oxymoronic endeavor? Environment and Planning A, 38(11), 1999–2002. https://doi.org/10.1068/a38462

44.

Lupton

(2014). The commodification of patient opinion: The digital patient experience economy in the age of big data. Sociology of Health & Illness, 36(6), 856–869. https://doi.org/10.1111/1467-9566.12109

45.

Mamykina

Smaldone

Bakken

(2015). Adopting the sensemaking perspective for chronic disease self-management. Journal of Biomedical Informatics, 56, 406–417. https://doi.org/10.1016/j.jbi.2015.06.006

46.

Masefield

S. C.

Megaw

Barlow

White

P. C.

Altink

Grugel

(2020). Repurposing NGO data for better research outcomes: A scoping review of the use and secondary analysis of NGO data in health policy and systems research. Health Research Policy and Systems, 18(1), 1–22. https://doi.org/10.1186/s12961-020-00577-x

47.

Maxwell

J. A.

(2016). Expanding the history and range of mixed methods research. Journal of Mixed Methods Research, 10(1), 12–27. https://doi.org/10.1177/1558689815571132

48.

Mennis

Mason

M. J.

Cao

(2013). Qualitative GIS and the visualization of narrative activity space data. International Journal of Geographical Information Science, 27(2), 267–291. https://doi.org/10.1080/13658816.2012.678362

49.

Moessner

Feldhege

Wolf

Bauer

(2018). Analyzing big data in social media: Text and network analyses of an eating disorder forum. International Journal of Eating Disorders, 51(7), 656–667. https://doi.org/10.1002/eat.22878

50.

Nimrod

(2013). Online depression communities: Members' interests and perceived benefits. Health Communication, 28(5), 425-434. https://doi.org/10.1080/10410236.2012.691068

51.

O'Cathain

Murphy

Nicholl

(2007). Integration and publications as indicators of" yield" from mixed methods studies. Journal of Mixed Methods Research, 1(2), 147–163. https://doi.org/10.1177/1558689806299094

52.

O’Sullivan

(2006). Geographical information science: Critical GIS. Progress in human geography, 30(6), 783–791. https://doi.org/10.1177/0309132506071528

53.

Parliament of Australia . (2018). Senate Inquiry into Accessibility and quality of mental health services in rural and remote Australia. https://www.aph.gov.au/Parliamentary_Business/Committees/Senate/Community_Affairs/MentalHealthServices/Report

54.

Pavlovskaya

M. E.

(2002). Mapping urban change and changing GIS: Other views of economic restructuring. Gender, Place and Culture: A Journal of Feminist Geography, 9(3), 281–289. https://doi.org/10.1080/0966369022000003897

55.

Pickles

(1995). Ground truth: The social implications of geographic information systems. Guilford Press.

56.

Pierce

C. S.

Scherra

(2012). The challenges of data collection in rural dwelling samples. Online Journal of Rural Nursing and Health Care, 4(2), 25–30.

57.

Plano Clark

V. L.

(2010). The adoption and practice of mixed methods: US trends in federally funded health-related research. Qualitative Inquiry, 16(6), 428–440. https://doi.org/10.1177/1077800410364609

58.

Poorthuis

Zook

(2015). Small stories in big data: Gaining insights from large spatial point pattern datasets. Cityscape, 17(1), 151–160. http://www.jstor.org/stable/26326929

59.

Productivity Commission . (2020). Mental health (95). https://www.pc.gov.au/inquiries/completed/mental-health/report

60.

Saunders

Mulgan

(2017). Governing with collective intelligence. Nesta.

61.

Schuurman

(2000). Trouble in the heartland: GIS and its critics in the 1990s. Progress in human geography, 24(4), 569-590. https://doi.org/10.1191/030913200100189111

62.

Schuurman

(2006). Formalization matters: Critical GIS and ontology research. Annals of the Association of American Geographers, 96(4), 726–739. https://doi.org/10.1111/j.1467-8306.2006.00513.x

63.

Schuurman

Kwan

M.-P.

(2004). Guest editorial: Taking a walk on the social side of GIS. Cartographica: The International Journal for Geographic Information and Geovisualization, 39(1), 1–3. https://doi.org/10.3138/k3j7-6171-j4k0-868j

64.

Schuurman

Leszczynski

(2006). Ontology‐based metadata. Transactions in GIS, 10(5), 709–726. https://doi.org/10.1111/j.1467-9671.2006.01024.x

65.

Sheppard

(2005). Knowledge production through critical GIS: Genealogy and prospects. Cartographica: The International Journal for Geographic Information and Geovisualization, 40(4), 5–21. https://doi.org/10.3138/gh27-1847-qp71-7tp7

66.

Stake

R. E.

(1995). The art of case study research. SAGE.

67.

Sui

Goodchild

(2011). The convergence of GIS and social media: Challenges for GIScience. International Journal of Geographical Information Science, 25(11), 1737–1748. https://doi.org/10.1080/13658816.2011.604636

68.

Susha

Grönlund

Å.

Van Tulder

(2019). Data driven social partnerships: Exploring an emergent trend in search of research challenges and questions. Government Information Quarterly, 36(1), 112–128. https://doi.org/10.1016/j.giq.2018.11.002

69.

Susha

Janssen

Verhulst

(2017). Data collaboratives as a new frontier of cross-sector partnerships in the age of open data: Taxonomy development. https://doi.org/10.24251/hicss.2017.325

70.

Teddlie

(2007). Mixed methods sampling: A typology with examples. Journal of Mixed Methods Research, 1(1), 77–100. https://doi.org/10.1177/1558689806292430

71.

Tripp

Gage

Williams

(2020). Addressing the data analytics gap: A community-university partnership to enhance analytics capabilities in the non-profit sector. Collaborations: A Journal of Community-Based Research and Practice, 3(1). https://doi.org/10.33596/coll.58

72.

Tucker

Goodings

(2018). Medicated bodies: Mental distress, social media and affect. new Media & Society, 20(2), 549–563. https://doi.org/10.1177/1461444816664347

73.

Tucker

I. M.

Goodings

(2017). Digital atmospheres: Affective practices of care in elefriends. Sociology of Health & Illness, 39(4), 629–642. https://doi.org/10.1111/1467-9566.12545

74.

Urban Institute . (2020). In search of “good” rural data. https://www.urban.org/research/publication/search-good-rural-data

75.

Van Dijck

Poell

(2016). Understanding the promises and premises of online health platforms. Big Data & Society, 3(1), 2053951716654173. https://doi.org/10.1177/2053951716654173

76.

van Spijker

B. A.

Salinas-Perez

J. A.

Mendoza

Bell

Bagheri

Furst

M. A.

Reynolds

Rock

Harvey

Rosen

Salvador-Carulla

(2019). Service availability and capacity in rural mental health in Australia: Analysing gaps using an Integrated Mental Health Atlas. Australian & New Zealand Journal of Psychiatry, 53(10), 1000–1012. https://doi.org/10.1177/0004867419857809

77.

Verhulst

Young

(2017). The potential of social media—Intelligence to improve people’s lives: Social media data for good. The GovLab Report, September.

78.

Victoria State Government . (2020). Productivity commission mental health inquiry. https://www.pc.gov.au/inquiries/completed/mental-health#report

79.

Voida

Harmon

Al-Ani

(2011). Homebrew databases: Complexities of everyday information management in nonprofit organizations. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems.

80.

Watkins

D. C.

(2022). Secondary data in mixed methods research. SAGE PUBN. https://books.google.com.au/books?id=btG-zgEACAAJ

81.

Williams

(2020). Data action: Using data for public good. MIT Press.

82.

Yin

R. K.

(2014). Case study research: Design and methods (5th ed., Vol. 5). SAGE.

83.

Zook

Barocas

Boyd

Crawford

Keller

Gangadharan

Goodman

Hollander

Koenig

Metcalf

Narayanan

Nelson

Pasquale

(2017). Ten simple rules for responsible big data research. PLOS Computational Biology, 13(3), Article e1005399. https://doi.org/10.1371/journal.pcbi.1005399