Usability and Usefulness of a Mobile Heath App for HIV Prevention among Adolescents in Indonesia

Abstract

Background

Mobile health apps could help reduce human immunodeficiency virus (HIV) transmission in adolescents. A multidisciplinary group developed the HIV Info Corner app to provide information about HIV transmission, risk behaviors, and prevention.

Objectives

This research aimed to evaluate the usability of the HIV Info Corner app and its usefulness as perceived by potential users.

Methods

15 adolescents engaged in meetings and performed 5 tasks. Usability was evaluated using the System Usability Scale (SUS) and the Nielsen Severity Scale. Usefulness was evaluated using the Intrinsic Motivation Inventory (IMI).

Results

10 usability problems were found; 8 were considered minor problems and 2 classified as major.

Conclusion

Users considered the information in the HIV Data Corner app relevant, satisfying their requirements.

Keywords

eHealth mobile phone mobile application adolescent HIV prevention qualitative research

Get full access to this article

View all access options for this article.

References

Abroms

L. C.

Johnson

P. R.

Heminger

C. L.

Van Alstyne

J. M.

Leavitt

L. E.

Schindler-Ruwisch

J. M.

, & Bushar

J. A.

(2015). Quit4baby: Results from a pilot test of a mobile smoking cessation program for pregnant women. JMIR MHealth and UHealth 3(1), e10. https://doi.org/10.2196/mhealth.3846.

Badawy

S. M.

, & Kuhns

L. M.

(2017). Texting and mobile phone app interventions for improving adherence to preventive behavior in adolescents: A systematic review. JMIR MHealth and UHealth 5(4), e50. https://doi.org/10.2196/mhealth.6837.

Bandura

(1994). Social cognitive theory and exercise of control over HIV infection. In DiClemente

R.J.

& Peterson

J.L.

(Eds.), Preventing AIDS: Theories and methods of behavioral interventions (pp. 25–59). SpringerUS.

Blackstock

O. J.

Patel

V. V.

, & Cunningham

C. O.

(2015). Use of technology for HIV prevention among adolescent and adult women in the United States. Current Hiv/Aids Reports 12(4), 489–499. https://doi.org/10.1007/s11904-015-0287-3.

Bolle

Romijn

Smets

E. M. A.

Loos

E. F.

Kunneman

, & van Weert

J. C. M.

(2016). Older cancer patients' user experiences with web-based health information tools: A think-aloud study. Journal of Medical Internet Research 18(7), e208. https://doi.org/10.2196/jmir.5618.

Brown

III.

Yen

P. Y.

Rojas

, & Schnall

(2013). Assessment of the health IT usability evaluation model (Health-ITUEM) for evaluating mobile health (mHealth) technology. Journal of Biomedical Informatics 46(6), 1080–1087. https://doi.org/10.1016/j.jbi.2013.08.001.

Castensøe-Seidenfaden

Husted

G. R.

Teilmann

Hommel

Olsen

B. S.

, & Kensing

(2017). Designing a self-management app for young people with type 1 diabetes: Methodological challenges, experiences, and recommendations. JMIR MHealth and UHealth 5(10), e124. https://doi.org/10.2196/mhealth.8137.

de la Vega

, & Miró

(2014). mHealth: A strategic field without a solid scientific soul. A systematic review of pain-related apps. PloS One 9(7), e101312. https://doi.org/10.1371/journal.pone.0101312.

Dumas

(2007). The great leap forward: The birth of the usability profession (1988–1993). Journal of Usability Studies 2(2), 54–60.

10.

Eckert

, & Bell

(2005). Invisible force: Farmers' mental models and how they influence learning and actions. Journal of Extension 43(3), 1–9. https://extension.unh.edu/adultlearning/invisibleforce.pdf.

11.

Ericsson

K. A.

, & Simon

H. A.

(1980). Verbal reports as data. Psychological Review 87(3), 215. https://doi.org/10.1037/0033-295X.87.3.215.

12.

Evans

Nielsen

P. E.

Szekely

D. R.

Bihm

J. W.

Murray

E. A.

Snider

, & Abroms

L. C.

(2015). Dose-response effects of the text4baby mobile health program: Randomized controlled trial. JMIR MHealth and UHealth 3(1), e12. https://doi.org/10.2196/mhealth.3909.

13.

Fisher

J. D.

, & Fisher

W. A.

(1992). Changing AIDS-risk behavior. Psychological Bulletin 111(3), 455. https://doi.org/10.1037/0033-2909.111.3.455.

14.

Free

Phillips

Watson

Galli

Felix

Edwards

Patel

, & Haines

(2013). The effectiveness of mobile-health technologies to improve health care service delivery processes: A systematic review and meta-analysis. PLoS Med 10(1), e1001363. https://doi.org/10.1371/journal.pmed.1001363.

15.

Horsky

Zhang

, & Patel

V. L.

(2005). To err is not entirely human: Complex technology and user cognition. Journal of Biomedical Informatics 38(4), 264–266. https://doi.org/10.1016/j.jbi.2005.05.002.

16.

Idele

Gillespie

Porth

Suzuki

Mahy

Kasedde

, & Luo

(2014). Epidemiology of HIV and AIDS among adolescents: Current status, inequities, and data gaps. JAIDS Journal of Acquired Immune Deficiency Syndromes 66 S144–S153. https://doi.org/10.1097/QAI.0000000000000176.

17.

Jaspers

M. W.

(2009). A comparison of usability methods for testing interactive health technologies: Methodological aspects and empirical evidence. International Journal of Medical Informatics 78(5), 340–353. https://doi.org/10.1016/j.ijmedinf.2008.10.002.

18.

Jaspers

M. W. M.

Steen

van den Bos

, & Geenen

(2004). The think aloud method: A guide to user interface design. International Journal of Medical Informatics 73(11–12), 781–795. https://doi.org/10.1016/j.ijmedinf.2004.08.003.

19.

Kumar

Nilsen

W. J.

Abernethy

Atienza

Patrick

Pavel

Riley

W. T.

Shar

Spring

, & Spruijt-Metz

(2013). Mobile health technology evaluation: The mHealth evidence workshop. American Journal of Preventive Medicine 45(2), 228–236. https://doi.org/10.1016/j.amepre.2013.03.017.

20.

Kushniruk

A. W.

Triola

M. M.

Borycki

E. M.

Stein

, & Kannry

J. L.

(2005). Technology induced error and usability: The relationship between usability problems and prescription errors when using a handheld application. International Journal of Medical Informatics 74(7–8), 519–526. https://doi.org/10.1016/j.ijmedinf.2005.01.003.

21.

Majeed-Ariss

Baildam

Campbell

Chieng

Fallon

Hall

McDonagh

J. E.

Stones

S. R.

Thomson

, & Swallow

(2015). Apps and adolescents: A systematic review of adolescents' use of mobile phone and tablet apps that support personal management of their chronic or long-term physical conditions. Journal of Medical Internet Research 17(12), e287. https://doi.org/10.2196/jmir.5043.

22.

Maloney

K. M.

Bratcher

Wilkerson

, & Sullivan

P. S.

(2020). Electronic and other new media technology interventions for HIV care and prevention: A systematic review. Journal of the International AIDS Society 23(1), e25439. https://doi.org/10.1002/jia2.25439.

23.

Ministry of Health of Republic of Indonesia. (2017). Laporan HIV/AIDS. Ministry of Health of Republic of Indonesia.

24.

Muessig

K. E.

Nekkanti

Bauermeister

Bull

, & Hightow-Weidman

L. B.

(2015). A systematic review of recent smartphone, Internet and Web 2.0 interventions to address the HIV continuum of care. Current HIV/ AIDS Reports 12(1), 173–190. https://doi.org/10.1007/s11904-014-0239-3.

25.

Muessig

K. E.

Pike

E. C.

Legrand

, & Hightow-Weidman

L. B.

(2013). Mobile phone applications for the care and prevention of HIV and other sexually transmitted diseases: A review. Journal of Medical Internet Research 15(1), e1. https://doi.org/10.2196/jmir.2301.

26.

Nielsen

(1994). Usability engineering. Morgan Kaufmann.

27.

Overdijkink

S. B.

Velu

A. V.

Rosman

A. N.

Van Beukering

M. D. M.

Kok

, & Steegers-Theunissen

R. P. M.

(2018). The usability and effectiveness of mobile health technology–based lifestyle and medical intervention apps supporting health care during pregnancy: Systematic review. JMIR MHealth and UHealth 6(4), e109. https://doi.org/10.2196/mhealth.8834.

28.

Peute

L. W. P.

de Keizer

N. F.

, & Jaspers

M. W. M.

(2015). The value of retrospective and concurrent think aloud in formative usability testing of a physician data query tool. Journal of Biomedical Informatics 55 1–10. https://doi.org/10.1016/j.jbi.2015.02.006.

29.

Peute

L. W. P.

Spithoven

P. J. M.

, & Bakker

(2008). Usability studies on interactive health information systems; Where do we stand?. EHealth Beyond the Horizon: Get IT There: Proceedings of MIE2008, the XXIst International Congress of the European Federation for Medical Informatics, 327.

30.

Plant

R. W.

, & Ryan

R. M.

(1985). Intrinsic motivation and the effects of self-consciousness, self-awareness, and ego-involvement: An investigation of internally controlling styles. Journal of Personality 53(3), 435–449.

31.

Purnama

Darmawati

, & Lindayani

(2018). The effectiveness of the skills for adolescents with a healthy sexuality (SAHS) program at reducing the risk of HIV transmission among adolescents. Indonesian Nursing Journal of Education and Clinic 3(1), 1–8. http://dx.doi.org/10.24990/injec.v3i1.170.

32.

Rook

(2013). Mental models: A robust definition. The Learning Organization.

33.

Tamrat

, & Kachnowski

(2012). Special delivery: An analysis of mHealth in maternal and newborn health programs and their outcomes around the world. Maternal and Child Health Journal 16(5), 1092–1101. https://doi.org/10.1007/s10995-011-0836-3.

34.

Tripp

Hainey

Liu

Poulton

Peek

Kim

, & Nanan

(2014). An emerging model of maternity care: Smartphone, midwife, doctor? Women and Birth 27(1), 64–67. https://doi.org/10.1016/j.wombi.2013.11.001.

35.

UNAIDS. (2018). Global Report: UNAIDS report on the global AIDS epidemic. Kementrian Kesehatan. http://www.unaids.org/sites/default/files/media_asset/UNAIDS_Global_Report_%0A2017_en_1.pdf.%0A4.

36.

United Nations International Children's Emergency Fund. (2018). Turning the tide against AIDS will require more concentrated focus on adolescents and young people. https://data.unicef.org/topic/hivaids/adolescents-young-people/.

37.

Van der Vaart

Drossaert

C. H. C.

de Heus

Taal

, & van de Laar

M. A. F. J.

(2013). Measuring actual eHealth literacy among patients with rheumatic diseases: A qualitative analysis of problems encountered using Health 1.0 and Health 2.0 applications. Journal of Medical Internet Research 15(2), e27. https://doi.org/10.2196/jmir.2428.

38.

Van Dijk

M. R.

Huijgen

N. A.

Willemsen

S. P.

Laven

J. S. E.

Steegers

E. A. P.

, & Steegers-Theunissen

R. P. M.

(2016). Impact of an mHealth platform for pregnancy on nutrition and lifestyle of the reproductive population: A survey. JMIR MHealth and UHealth 4(2), e53. https://doi.org/10.2196/mhealth.5197.

39.

Van Engen-Verheul

Peute

Kilsdonk

Peek

, & Jaspers

(2012). Usability evaluation of a guideline implementation system for cardiac rehabilitation: Think aloud study. Studies in Health Technology and Informatics 180 403–407.

40.

Weiss

B. D.

Mays

M. Z.

Martz

Castro

K. M.

DeWalt

D. A.

Pignone

M. P.

Mockbee

, & Hale

F. A.

(2005). Quick assessment of literacy in primary care: The newest vital sign. Annals of Family Medicine 3(6), 514–522. https://doi.org/10.1370/afm.405.

41.

White

B. K.

Martin

White

J. A.

Burns

S. K.

Maycock

B. R.

Giglia

R. C.

, & Scott

J. A.

(2016). Theory-based design and development of a socially connected, gamified mobile app for men about breastfeeding (Milk Man). JMIR MHealth and UHealth 4(2), e81. https://doi.org/10.2196/mhealth.5652.

42.

World Health Organization. (2011). MHealth: New horizons for health through mobile technologies.

43.

World Health Organization. (2018). HIV/AIDS data and statistics. http://www.who.int/hiv/data/en/.