Purpose: A user-centered design approach was used to refine the mHealth Pain Squad+ real-time pain self-management app for adolescents with cancer for its usability (defined as being easy to use, easy to understand, efficient to complete, and acceptable). Method: Three iterative usability testing cycles involving adolescent observation and interview were used to achieve this objective. During each cycle, adolescents used the app while “thinking aloud” about issues encountered. Observed difficulties and errors were recorded and a semistructured interview about the experience was conducted. Using a qualitative conventional content analysis approach, themes related to app usability were identified. Results: Participants required an average of 4.3 minutes to complete the pain assessment component of Pain Squad+. Overall, the app was acceptable. Problematic issues related to software malfunction, interface design flaws, and confusing text. Software revisions were made to address each issue. Conclusion: The multifaceted usability approach used provided insight into how a real-time app can be made acceptable to adolescents with cancer and succeeded in developing a Pain Squad+ app that is fit for future effectiveness testing.
AmeringerS. (2010). Barriers to pain management among adolescents with cancer. Pain Management Nursing, 11, 224-233.
2.
AndersonJ. K.WallaceL. M. (2015). Applying the behavioural intervention technologies model to the development of a smartphone application (app) supporting young peoples’ adherence to anaphylaxis action plan. BMJ Innovations, 1, 67-73.
3.
BaggottC.CooperB. A.MarinaN.MatthayK. K.MiaskowskiC. (2012). Symptom cluster analyses based on symptom occurrence and severity ratings among pediatric oncology patients during myelosuppressive chemotherapy. Cancer Nursing, 35, 19-28.
4.
BaggottC.DoddM.KennedyC.MarinaN.MatthayK. K.CooperB. A.MiaskowskiC. (2010). Changes in children’s reports of symptom occurrence and severity during a course of myelosuppressive chemotherapy. Journal of Pediatric Oncology Nursing, 27, 307-315.
5.
BaggottC.GibsonF.CollB.KletterR.ZeltzerP.MiaskowskiC. (2012). Initial evaluation of an electronic symptom diary for adolescents with cancer. JMIR Research Protocols, 1(2), e23.
6.
BarlowJ. H.EllardD. R. (2004). Psycho-educational interventions for children with chronic disease, parents and siblings: An overview of the research evidence base. Child: Care, Health and Development, 30, 637-645.
7.
BarlowJ.WrightC.SheasbyJ.TurnerA.HainsworthJ. (2002). Self-management approaches for people with chronic conditions: A review. Patient Education and Counseling, 48, 177-187.
8.
BowenG. A. (2008). Naturalistic inquiry and the saturation concept: A research note. Qualitative Research, 8, 137-152.
9.
BrownW.YenP.-Y.RojasM.SchnallR. (2013). Assessment of the Health IT Usability Evaluation Model (Health-ITUEM) for evaluating mobile health (mHealth) technology. Journal of Biomedical Informatics, 46, 1080-1087.
10.
CafazzoJ. A.CasselmanM.HammingN.KatzmanD. K.PalmertM. R. (2012). Design of an mHealth app for the self-management of adolescent Type 1 diabetes: A pilot study. Journal of Medical Internet Research, 14(3), e70.
11.
CeaparuI.LazarJ.BessiereK.RobinsonJ.ShneidermanB. (2010). Determining causes and severity of end-user frustration. International Journal of Human-Computer Interaction, 17, 333-356.
12.
CowieJ.McCannL.MaguireR.KearneyN.ConnaghanJ.PatersonC.. . . Di DomenicoD. (2013). Real-time management of chemotherapy toxicity using the Advanced Symptom Management System (ASyMS). Journal of Decision Systems, 22(1), 43-52.
13.
DanaherB. G.BrendryenH.SeeleyJ. R.TylerM. S.WoolleyT. (2015). From black box to toolbox: Outlining device functionality, engagement activities, and the pervasive information architecture of mHealth interventions. Internet Interventions, 2(1), 91-101.
14.
EysenbachG. (2015). The impact of the Internet on cancer outcomes. CA: A Cancer Journal for Clinicians, 53, 356-271.
15.
FortierM. A.WahiA.MaurerE. L.TanE. T.SenderL. S.KainZ. N. (2012). Attitudes regarding analgesic use and pain expression in parents of children with cancer. Journal of Pediatric Hematology/Oncology, 34, 257-262.
16.
HedénL.von EssenL.FrykholmP.LjungmanG. (2009). Low-dose oral midazolam reduces fear and distress during needle procedures in children with cancer. Pediatric Blood & Cancer, 53, 1200-1204.
17.
HirschfeldG.ZernikowB. (2013). Cut points for mild, moderate, and severe pain on the VAS for children and adolescents: What can be learned from 10 million ANOVAs?Pain, 154, 2626-2632.
18.
HsiehH. F.ShannonS. E. (2005). Three approaches to qualitative content analysis. Qualitative Health Research, 15, 1277-1288.
19.
JacobE.HesselgraveJ.SambucoG.HockenberryM. (2007). Variations in pain, sleep, and activity during hospitalization in children with cancer. Journal of Pediatric Oncology Nursing, 24, 208-219.
20.
JibbL. A.NathanP.StevensB.SetoE.CafazzoJ.StephensN.. . . StinsonJ. N. (2015). Psychological and physical interventions for the management of cancer-related pain in pediatric and young adult patients: An integrative review. Oncology Nursing Forum, 42, E339-E357.
21.
JibbL. A.StevensB. J.NathanP. C.SetoE.CafazzoJ. A.StinsonJ. N. (2014). A smartphone-based pain management app for adolescents with cancer: Establishing system requirements and a pain care algorithm based on literature review, interviews, and consensus. JMIR Research Protocols, 3(1), e15.
22.
KlassenA. F.KlaassenR.DixD.PritchardS.YanofskyR.O’DonnellM.. . . SungL. (2008). Impact of caring for a child with cancer on parents’ health-related quality of life. Journal of Clinical Oncology, 26, 5884-5889.
23.
KushnirukA. W.PatelV. L. (2004). Cognitive and usability engineering methods for the evaluation of clinical information systems. Journal of Biomedical Informatics, 37(1), 56-76.
24.
LallooC.JibbL. A.RiveraJ.AgarwalA.StinsonJ. N. (2015). “There’s a pain app for that”: Review of patient-targeted smartphone applications for pain management. Clinical Journal of Pain, 31, 557-563.
LingardL.AlbertM.LevinsonW. (2008). Grounded theory, mixed methods, and action research. British Medical Journal, 337, a567.
27.
LinkC. J.FortierM. A. (2016). The relationship between parent trait anxiety and parent-reported pain, solicitous behaviors, and quality of life impairment in children with cancer. Journal of Pediatric Hematology/Oncology, 38, 58-62.
28.
LoganD. E.ClaarR. L.ScharffL. (2008). Social desirability response bias and self-report of psychological distress in pediatric chronic pain patients. Pain, 136, 366-372.
29.
LuQ.KrullK. R.LeisenringW.OwenJ. E.KawashimaT.TsaoJ. C.. . . ZeltzerL. K. (2011). Pain in long-term adult survivors of childhood cancers and their siblings: A report from the Childhood Cancer Survivor Study. Pain, 152, 2616-2624.
30.
LyK. H.JanniE.WredeR.SedemM.DonkerT.CarlbringP.AnderssonG. (2015). Experiences of a guided smartphone-based behavioral activation therapy for depression: A qualitative study. Internet Interventions, 2(1), 60-68.
31.
MacefieldR. (2009). How to specify the participant group size for usability studies: A practitioner’s guide. Journal of Usability Studies, 5(1), 34-45.
32.
MacphersonC. F.LinderL. A.AmeringerS.EricksonJ.StegengaK.WoodsN. F. (2014). Feasibility and acceptability of an iPad application to explore symptom clusters in adolescents and young adults with cancer. Pediatric Blood & Cancer, 61, 1996-2003.
33.
MaguireR.ReamE.RichardsonA.ConnaghanJ.JohnstonB.KotronoulasG.. . . KearneyN. (2015). Development of a novel remote patient monitoring system: The Advanced Symptom Management System for Radiotherapy to improve the symptom experience of patients with lung cancer receiving radiotherapy. Cancer Nursing, 38(2), E37-E47.
34.
McCurdieT.TanevaS.CasselmanM.YeungM.McDanielC.HoW.CafazzoJ. (2012). mHealth consumer apps: The case for user-centered design. Biomedical Instrumentation & Technology, Fall(Suppl.), 49-56.
35.
MolichR. (2010). A critique of “how to specify the participant group size for usability studies: A practitioner’s guide by Macefield. Journal of Usability Studies, 5(3), 124-128.
36.
MurphyD.SawczynK. K.QuinnG. P. (2012). Using a patient-centered approach to develop a fertility preservation brochure for pediatric oncology patients: A pilot study. Journal of Pediatric & Adolescent Gynecology, 25, 114-121.
37.
PattonM. Q. (2002). Qualitative research and evaluation methods (3rd ed.). Thousand Oaks, CA: Sage.
38.
PaulhusD. L.ReidD. B. (1991). Enhancement and denial in socially desirable responding. Journal of Personality and Social Psychology, 60, 307-317.
39.
RodgersC. C.KranceR.StreetR. L.Jr.HockenberryM. J. (2013). Feasibility of a symptom management intervention for adolescents recovering from a hematopoietic stem cell transplant. Cancer Nursing, 36, 394-399.
40.
SandelowskiM. (2010). What’s in a name? Qualitative description revisited. Research in Nursing & Health, 33(1), 77-84.
41.
SchneiderT.CoulurisM.PanzeraA. D.LindenbergerJ.McDermottR.BryantC. A. (2016). Engaging teens with asthma in designing a patient-centered mobile app to aid disease self-management. Telemedicine and E-Health, 22(2), 1-6.
42.
ShepherdE.WoodgateR. L.SawatzkyJ.-A. (2010). Pain in children with central nervous system cancer: A review of the literature. Oncology Nursing Forum, 37, E318-E330.
43.
StinsonJ. N.GuptaA.DupuisF.DickB.LaverdiereC.LeMayS.. . . ChanC. Y. (2015). Usability testing of an online self-management program for adolescents with cancer. Journal of Pediatric Oncology Nursing, 32, 70-82.
44.
StinsonJ. N.JibbL. A.NguyenC.NathanP. C.MaloneyA. M.DupuisL. L.. . . OrrM. (2013). Development and testing of a multidimensional iPhone pain assessment application for adolescents with cancer. Journal of Medical Internet Research, 15(3), e51.
45.
StinsonJ. N.JibbL. A.NguyenC.NathanP. C.MaloneyA. M.DupuisL. L.. . . JohnstonD. L. (2015). Construct validity and reliability of a real-time multidimensional smartphone app to assess pain in children and adolescents with cancer. Pain, 156, 2607-2615.
46.
StinsonJ. N.McGrathP. J.HodnettE.FeldmanB. M.DuffyC. M.HuberA.. . . WhiteM. E. (2010). An internet-based self-management program with telephone support for adolescents with arthritis: A pilot randomized controlled trial. Journal of Rheumatology, 37, 1944-1952.
47.
StinsonJ. N.PetrozG. C.TaitG.FeldmanB. M.StreinerD.McGrathP. J.StevensB. J. (2006). e-Ouch: Usability testing of an electronic chronic pain diary for adolescents with arthritis. Clinical Journal of Pain, 22, 295-305.
48.
StinsonJ. N.SungL.GuptaA.WhiteM. E.JibbL. A.DettmerE.BakerN. (2012). Disease self-management needs of adolescents with cancer: Perspectives of adolescents with cancer and their parents and healthcare providers. Journal of Cancer Survivorship, 6, 278-286.
49.
StinsonJ. N.WhiteM.BreakeyV.ChongA. L.MakI.LowK. K.LowA. K. (2011). Perspectives on quality and content of information on the internet for adolescents with cancer. Pediatric Blood & Cancer, 57(1), 97-104.
50.
StinsonJ.WilsonR.GillN.YamadaJ.HoltJ. (2009). A systematic review of internet-based self-management interventions for youth with health conditions. Journal of Pediatric Psychology, 34, 495-510.
51.
SungL.KlaassenR. J.DixD.PritchardS.YanofskyR.DzolganovskiB.. . . KlassenA. (2009). Identification of paediatric cancer patients with poor quality of life. British Journal of Cancer, 100(1), 82-88.
52.
TomlinsonD.HesserT.MaloneyA. M.RossS.NaqviA.SungL. (2014). Development and initial evaluation of electronic Children’s International Mucositis Evaluation Scale (eChIMES) for children with cancer. Supportive Care in Cancer, 22, 115-119.
53.
VarniJ. W.StuckyB. D.ThissenD.DewittE. M.IrwinD. E.LaiJ.-S.. . . DewaltD. A. (2010). PROMIS Pediatric Pain Interference Scale: An item response theory analysis of the pediatric pain item bank. Journal of Pain, 11, 1109-1119.
54.
WalkerA. J.Gedaly-DuffV.MiaskowskiC.NailL. (2010). Differences in symptom occurrence, frequency, intensity, and distress in adolescents prior to and one week after the administration of chemotherapy. Journal of Pediatric Oncology Nursing, 27, 259-265.
55.
Windich-BiermeierA.SjobergI.DaleJ. C.EshelmanD.GuzzettaC. E. (2007). Effects of distraction on pain, fear, and distress during venous port access and venipuncture in children and adolescents with cancer. Journal of Pediatric Oncology Nursing, 24, 8-19.
56.
WoottenA. C.AbbottJ.-A. M.ChisholmK.AustinD. W.KleinB.McCabeM.. . . CostelloaA. J. (2014). Development, feasibility and usability of an online psychological intervention for men with prostate cancer: My road ahead. Internet Interventions, 1, 188-195.
57.
ZernikowB.HasanC.HechlerT.HuebnerB.GordonD.MichelE. (2012). Stop the Pain! A nation-wide quality improvement programme in paediatric oncology pain control. European Journal of Pain, 12, 819-833.
