Mobile health apps could help reduce human immunodeficiency virus (HIV) transmission in adolescents. A multidisciplinary group developed the HIV Info Corner app to provide information about HIV transmission, risk behaviors, and prevention.
Objectives
This research aimed to evaluate the usability of the HIV Info Corner app and its usefulness as perceived by potential users.
Methods
15 adolescents engaged in meetings and performed 5 tasks. Usability was evaluated using the System Usability Scale (SUS) and the Nielsen Severity Scale. Usefulness was evaluated using the Intrinsic Motivation Inventory (IMI).
Results
10 usability problems were found; 8 were considered minor problems and 2 classified as major.
Conclusion
Users considered the information in the HIV Data Corner app relevant, satisfying their requirements.
AbromsL. C.JohnsonP. R.HemingerC. L.Van AlstyneJ. M.LeavittL. E.Schindler-RuwischJ. M., & BusharJ. A. (2015). Quit4baby: Results from a pilot test of a mobile smoking cessation program for pregnant women. JMIR MHealth and UHealth3(1), e10. https://doi.org/10.2196/mhealth.3846.
2.
BadawyS. M., & KuhnsL. M. (2017). Texting and mobile phone app interventions for improving adherence to preventive behavior in adolescents: A systematic review. JMIR MHealth and UHealth5(4), e50. https://doi.org/10.2196/mhealth.6837.
3.
BanduraA. (1994). Social cognitive theory and exercise of control over HIV infection. In DiClementeR.J. & PetersonJ.L. (Eds.), Preventing AIDS: Theories and methods of behavioral interventions (pp. 25–59). SpringerUS.
4.
BlackstockO. J.PatelV. V., & CunninghamC. O. (2015). Use of technology for HIV prevention among adolescent and adult women in the United States. Current Hiv/Aids Reports12(4), 489–499. https://doi.org/10.1007/s11904-015-0287-3.
5.
BolleS.RomijnG.SmetsE. M. A.LoosE. F.KunnemanM., & van WeertJ. C. M. (2016). Older cancer patients' user experiences with web-based health information tools: A think-aloud study. Journal of Medical Internet Research18(7), e208. https://doi.org/10.2196/jmir.5618.
6.
BrownW.III.YenP. Y.RojasM., & SchnallR. (2013). Assessment of the health IT usability evaluation model (Health-ITUEM) for evaluating mobile health (mHealth) technology. Journal of Biomedical Informatics46(6), 1080–1087. https://doi.org/10.1016/j.jbi.2013.08.001.
7.
Castensøe-SeidenfadenP.HustedG. R.TeilmannG.HommelE.OlsenB. S., & KensingF. (2017). Designing a self-management app for young people with type 1 diabetes: Methodological challenges, experiences, and recommendations. JMIR MHealth and UHealth5(10), e124. https://doi.org/10.2196/mhealth.8137.
8.
de la VegaR., & MiróJ. (2014). mHealth: A strategic field without a solid scientific soul. A systematic review of pain-related apps. PloS One9(7), e101312. https://doi.org/10.1371/journal.pone.0101312.
9.
DumasJ. (2007). The great leap forward: The birth of the usability profession (1988–1993). Journal of Usability Studies2(2), 54–60.
EvansW.NielsenP. E.SzekelyD. R.BihmJ. W.MurrayE. A.SniderJ., & AbromsL. C. (2015). Dose-response effects of the text4baby mobile health program: Randomized controlled trial. JMIR MHealth and UHealth3(1), e12. https://doi.org/10.2196/mhealth.3909.
FreeC.PhillipsG.WatsonL.GalliL.FelixL.EdwardsP.PatelV., & HainesA. (2013). The effectiveness of mobile-health technologies to improve health care service delivery processes: A systematic review and meta-analysis. PLoS Med10(1), e1001363. https://doi.org/10.1371/journal.pmed.1001363.
15.
HorskyJ.ZhangJ., & PatelV. L. (2005). To err is not entirely human: Complex technology and user cognition. Journal of Biomedical Informatics38(4), 264–266. https://doi.org/10.1016/j.jbi.2005.05.002.
16.
IdeleP.GillespieA.PorthT.SuzukiC.MahyM.KaseddeS., & LuoC. (2014). Epidemiology of HIV and AIDS among adolescents: Current status, inequities, and data gaps. JAIDS Journal of Acquired Immune Deficiency Syndromes66S144–S153. https://doi.org/10.1097/QAI.0000000000000176.
17.
JaspersM. W. (2009). A comparison of usability methods for testing interactive health technologies: Methodological aspects and empirical evidence. International Journal of Medical Informatics78(5), 340–353. https://doi.org/10.1016/j.ijmedinf.2008.10.002.
18.
JaspersM. W. M.SteenT.van den BosC., & GeenenM. (2004). The think aloud method: A guide to user interface design. International Journal of Medical Informatics73(11–12), 781–795. https://doi.org/10.1016/j.ijmedinf.2004.08.003.
19.
KumarS.NilsenW. J.AbernethyA.AtienzaA.PatrickK.PavelM.RileyW. T.SharA.SpringB., & Spruijt-MetzD. (2013). Mobile health technology evaluation: The mHealth evidence workshop. American Journal of Preventive Medicine45(2), 228–236. https://doi.org/10.1016/j.amepre.2013.03.017.
20.
KushnirukA. W.TriolaM. M.BoryckiE. M.SteinB., & KannryJ. L. (2005). Technology induced error and usability: The relationship between usability problems and prescription errors when using a handheld application. International Journal of Medical Informatics74(7–8), 519–526. https://doi.org/10.1016/j.ijmedinf.2005.01.003.
21.
Majeed-ArissR.BaildamE.CampbellM.ChiengA.FallonD.HallA.McDonaghJ. E.StonesS. R.ThomsonW., & SwallowV. (2015). Apps and adolescents: A systematic review of adolescents' use of mobile phone and tablet apps that support personal management of their chronic or long-term physical conditions. Journal of Medical Internet Research17(12), e287. https://doi.org/10.2196/jmir.5043.
22.
MaloneyK. M.BratcherA.WilkersonR., & SullivanP. S. (2020). Electronic and other new media technology interventions for HIV care and prevention: A systematic review. Journal of the International AIDS Society23(1), e25439. https://doi.org/10.1002/jia2.25439.
23.
Ministry of Health of Republic of Indonesia. (2017). Laporan HIV/AIDS. Ministry of Health of Republic of Indonesia.
24.
MuessigK. E.NekkantiM.BauermeisterJ.BullS., & Hightow-WeidmanL. B. (2015). A systematic review of recent smartphone, Internet and Web 2.0 interventions to address the HIV continuum of care. Current HIV/ AIDS Reports12(1), 173–190. https://doi.org/10.1007/s11904-014-0239-3.
25.
MuessigK. E.PikeE. C.LegrandS., & Hightow-WeidmanL. B. (2013). Mobile phone applications for the care and prevention of HIV and other sexually transmitted diseases: A review. Journal of Medical Internet Research15(1), e1. https://doi.org/10.2196/jmir.2301.
26.
NielsenJ. (1994). Usability engineering. Morgan Kaufmann.
27.
OverdijkinkS. B.VeluA. V.RosmanA. N.Van BeukeringM. D. M.KokM., & Steegers-TheunissenR. P. M. (2018). The usability and effectiveness of mobile health technology–based lifestyle and medical intervention apps supporting health care during pregnancy: Systematic review. JMIR MHealth and UHealth6(4), e109. https://doi.org/10.2196/mhealth.8834.
28.
PeuteL. W. P.de KeizerN. F., & JaspersM. W. M. (2015). The value of retrospective and concurrent think aloud in formative usability testing of a physician data query tool. Journal of Biomedical Informatics551–10. https://doi.org/10.1016/j.jbi.2015.02.006.
29.
PeuteL. W. P.SpithovenR.WmP. J. M., & BakkerM. (2008). Usability studies on interactive health information systems; Where do we stand?. EHealth Beyond the Horizon: Get IT There: Proceedings of MIE2008, the XXIst International Congress of the European Federation for Medical Informatics, 327.
30.
PlantR. W., & RyanR. M. (1985). Intrinsic motivation and the effects of self-consciousness, self-awareness, and ego-involvement: An investigation of internally controlling styles. Journal of Personality53(3), 435–449.
31.
PurnamaH.DarmawatiI., & LindayaniL. (2018). The effectiveness of the skills for adolescents with a healthy sexuality (SAHS) program at reducing the risk of HIV transmission among adolescents. Indonesian Nursing Journal of Education and Clinic3(1), 1–8. http://dx.doi.org/10.24990/injec.v3i1.170.
32.
RookL. (2013). Mental models: A robust definition. The Learning Organization.
33.
TamratT., & KachnowskiS. (2012). Special delivery: An analysis of mHealth in maternal and newborn health programs and their outcomes around the world. Maternal and Child Health Journal16(5), 1092–1101. https://doi.org/10.1007/s10995-011-0836-3.
34.
TrippN.HaineyK.LiuA.PoultonA.PeekM.KimJ., & NananR. (2014). An emerging model of maternity care: Smartphone, midwife, doctor?Women and Birth27(1), 64–67. https://doi.org/10.1016/j.wombi.2013.11.001.
Van der VaartR.DrossaertC. H. C.de HeusM.TaalE., & van de LaarM. A. F. J. (2013). Measuring actual eHealth literacy among patients with rheumatic diseases: A qualitative analysis of problems encountered using Health 1.0 and Health 2.0 applications. Journal of Medical Internet Research15(2), e27. https://doi.org/10.2196/jmir.2428.
38.
Van DijkM. R.HuijgenN. A.WillemsenS. P.LavenJ. S. E.SteegersE. A. P., & Steegers-TheunissenR. P. M. (2016). Impact of an mHealth platform for pregnancy on nutrition and lifestyle of the reproductive population: A survey. JMIR MHealth and UHealth4(2), e53. https://doi.org/10.2196/mhealth.5197.
39.
Van Engen-VerheulM.PeuteL.KilsdonkE.PeekN., & JaspersM. (2012). Usability evaluation of a guideline implementation system for cardiac rehabilitation: Think aloud study. Studies in Health Technology and Informatics180403–407.
40.
WeissB. D.MaysM. Z.MartzW.CastroK. M.DeWaltD. A.PignoneM. P.MockbeeJ., & HaleF. A. (2005). Quick assessment of literacy in primary care: The newest vital sign. Annals of Family Medicine3(6), 514–522. https://doi.org/10.1370/afm.405.
41.
WhiteB. K.MartinA.WhiteJ. A.BurnsS. K.MaycockB. R.GigliaR. C., & ScottJ. A. (2016). Theory-based design and development of a socially connected, gamified mobile app for men about breastfeeding (Milk Man). JMIR MHealth and UHealth4(2), e81. https://doi.org/10.2196/mhealth.5652.
42.
World Health Organization. (2011). MHealth: New horizons for health through mobile technologies.
