Sage Journals: Discover world-class research

Abstract

Precipitated by the COVID-19 pandemic, many work systems—including those focused on research activities—have transitioned to remote operations and many may remain remote even after in-person operations no longer present a public health risk. The ability to conduct human subjects research remotely presents many benefits but also numerous challenges. This panel gathers experts in the design, adaptation, and performance of remote macroergonomics research. They will describe their remote methodologies, and evaluate past, current, and future work in this area.

Get full access to this article

View all access options for this article.

References

Abraham

Schleiden

L. J.

Albert

S. M.

(2017). Factors contributing to poor satisfaction with slep and healthcare seeking behavior in older adults. Sleep Health, 3(1), 43–48.

Albert

S. M.

Roth

Toscani

Vitiello

M. V.

Zee

(2017). Sleep health and appropriate use of OTC sleep aids in older adults-Recommendations of a Gerontological Society of America workgroup. The Gerontologist, 57(2), 163–170.

Andreasen

M. S.

Nielsen

H. V.

Schrøder

S. O.

Stage

(2007). What happened to remote usability testing? An empirical study of three methods. Conference on Human Factors in Computing Systems Proceedings, 1405–1414. https://doi.org/10.1145/1240624.1240838

Asaad

Habibullah

N. K.

Butler

C. E.

(2020). The impact of COVID19 on clinical trials. Annals of Surgery, 272(3), e222.

Barton

H. J.

Coller

R. J.

Loganathar

Singhe

Ehlenbach

M. L.

Katz

Warner

Kelly

M. M.

Werner

N. E.

(2021). Medical Device Workarounds in Providing Care for Children With Medical Complexity in the Home. Pediatrics, 147(5). https://doi.org/10.1542/peds.2020-019513

Basu

(2020). The coronavirus pandemic is a game changer for mental health care. MIT Technology Review. https://www.technologyreview.com/2020/03/20/905184/coronavirusonline-therapy-mental-health-app-teletherapy/

Beyer

Holtzblatt

(1997). Contextual Design: Defining Customer-Centered Systems. Morgan Kaufmann Publishers.

Beyer

Holtzblatt

(1999). Contextual Design. Interactions, 6(1), 32–42.

Bhatia

Landier

Hageman

Kim

Chen

Crews

K. R.

Evans

W. E.

Bostrom

Casillas

Dickens

D. S.

Maloney

K. W.

Neglia

J. P.

Ravindranath

Ritchey

A. K.

Wong

F. L.

Relling

M. V.

(2014). 6MP adherence in a multiracial cohort of children with acute lymphoblastic leukemia: a Children’s Oncology Group study. Blood, 124(15), 2345–2353. https://doi.org/10.1182/blood-2014-01-552166

10.

Bhatia

Landier

Shangguan

Hageman

Schaible

A. N.

Carter

A. R.

Hanby

C. L.

Leisenring

Yasui

Kornegay

N. M.

Mascarenhas

Ritchey

A. K.

Casillas

J. N.

Dickens

D. S.

Meza

Carroll

W. L.

Relling

M. V.

Wong

F. L.

(2012). Nonadherence to oral mercaptopurine and risk of relapse in Hispanic and non-Hispanic white children with acute lymphoblastic leukemia: a report from the children’s oncology group. JOURNAL OF CLINICAL ONCOLOGY, 30(17), 2094–2101. https://doi.org/10.1200/JCO.2011.38.9924

11.

Boustani

M. A.

Van Der Marck

M. A.

Adams

Azar

J. M.

Holden

R. J.

Vollmar

H. C.

Wang

Williams

Alder

Suarez

Khan

Zarzaur

Fowler

N. R.

Overley

Solid

C. A.

Gatmaitan

(2019). Developing the Agile Implementation Playbook for Integrating Evidence-Based Health Care Services into Clinical Practice. Academic Medicine, 94(4), 556–561. https://doi.org/10.1097/ACM.0000000000002497

12.

Butow

Palmer

Pai

Goodenough

Luckett

King

(2010). Review of adherence-related issues in adolescents and young adults with cancer. JOURNAL OF CLINICAL ONCOLOGY, 28(32), 4800–4809. https://doi.org/10.1200/JCO.2009.22.2802

13.

Campbell

N. L.

Boustani

M. A.

Limbil

Ott

Fox

Maidment

I. D.

Schubert

C. C.

Munger

Frick

Miller

Gulati

(2009). The cognitive impact of anticholinergics: a clinical review. Clinical Interventions in Aging, 4, 225–233. https://doi.org/10.2147/cia.s5358

14.

Carayon

Karsh

B.-T.

Gurses

A. P.

Holden

R. J.

Hoonakker

Schoofs Hundt

Montague

Rodriguez

Wetterneck

T. B.

(2013). Macroergonomics in Healthcare Quality and Patient Safety. Review of Human Factors and Ergonomics, 8(1), 4–54. https://doi.org/10.1177/1557234X13492976

15.

Castillo

J. C.

Hartson

H. R.

Hix

(1998). Remote usability evaluation: Can users report their own critical incidents? CHI 98 Conference Summary on Human Factors in Computing Systems, 253–254. https://doi.org/10.1145/327556.327616

16.

Dray

Siegel

(2004). Remote possibilities? International Usability Testing at a Distance. Interactions, 11(2). https://doi.org/10.7748/ns.29.21.26.s30

17.

Dul

Bruder

Buckle

Carayon

Falzon

Marras

W. S.

Wilson

J. R.

van der Doelen

(2012). A strategy for human factors/ergonomics: developing the discipline and profession. Ergonomics, 55(4), 377–395. http://dx.doi.org/10.1080/00140139.2012.661087

18.

Gray

S. L.

Anderson

M. L.

Dublin

Hanlon

J. T.

Hubbard

Walker

Crane

P. K.

Larson

E. B.

(2015). Cumulative use of strong anticholinergics and incident dementia: a prospective cohort study. JAMA Internal Medicine, 175(3), 401–407. https://doi.org/10.1001/jamainternmed.2014.7663

19.

Haines

E. R.

Lux

Smitherman

A. B.

Kessler

M. L.

Schonberg

Dopp

Stover

A. M.

Powell

B. J.

Birken

S. A.

(2021). An actionable needs assessment for adolescents and young adults with cancer: the AYA Needs Assessment & Service Bridge (NA-SB). Supportive Care in Cancer, 29(8), 4693–4704. https://doi.org/10.1007/s00520-021-06024-z

20.

Hammontree

Weiler

Nayak

(1994). Remote Usability Testing. Interactions, 1(3), 21–25. https://doi.org/10.1145/182966.182969

21.

Hill

J. R.

Harrington

A. B.

Adeoye

Campbell

N. L.

Holden

R. J.

(2021). Going remote-demonstration and evaluation of remote technology delivery and usability assessment with older adults: Survey study. JMIR MHealth and UHealth, 9(3). https://doi.org/10.2196/26702

22.

Holden

R. J.

Boustani

M. A.

Azar

(2021). Agile Innovation to transform healthcare: innovating in complex adaptive systems in an everyday process, not a light bulb event. BMJ Innovations, 7, 499–505.

23.

Holden

R. J.

Daley

C. N.

Mickelson

R. S.

Bolchini

Toscos

Cornet

V. P.

Miller

Mirro

M. J.

(2020). Patient decision-making personas: An application of a patient-centered cognitive task analysis (P-CTA). Applied Ergonomics, 87, 103107.

24.

Holden Richard

Boustani

M. A.

(2020). The value of an ‘Agile’ mindset in times of crisis. Modern Healthcare.

25.

Holden Richard

Campbell

N. L.

Abebe

Clark

D. O.

Ferguson

Bodke

Boustani

M. A.

Callahan

C. M.

(2020). Usability and feasibility of consumer-facing technology to reduce unsafe medication use by older adults. Research in Social and Administrative Pharmacy, 16(1), 54–61.

26.

International Trade Administration. (n.d.). Impact of COVID Pandemic on eCommerce. U.S. Department of Commerce. Retrieved January 27, 2022, from https://www.trade.gov/impact-covid-pandemic-ecommerce

27.

Inverso

Abadula

Morrow

LeStourgeon

Parmar

Streisand

Jaser

S. S.

(2021). Pivoting during a pandemic: lessons learned from transitioning a multisite randomized controlled trial to a remote protocol in response to COVID-19. Translational Behavioral Medicine, 11(12), 2187–2193. https://doi.org/10.1093/tbm/ibab103

28.

Kondryn

H. J.

Edmondson

C. L.

Hill

Eden

T. O. B.

(2011). Treatment non-adherence in teenage and young adult patients with cancer. The Lancet Oncology, 12(1), 100–108. https://doi.org/10.1016/S1470-2045(10)70069-3

29.

Lai

Chiu

C.-Y.

Pounds

Tracy

Mehta

Young

H.-J.

Riser

Rimmer

(2020). COVID-19 Modifications for Remote Teleassessment and Teletraining of a Complementary Alternative Medicine Intervention for People with Multiple Sclerosis: Protocol for a Randomized Controlled Trial. JMIR Research Protocols, 9(7).

30.

LaMar

(2020). Advantages of remote research and why you should incorporate this powerful tool. UX Collective. https://uxdesign.cc/advantages-of-remote-research-and-why-youshould-already-be-incorporating-this-powerful-tool-789653c28c5a

31.

Landier

(2011). Age span challenges: adherence in pediatric oncology. Seminars in Oncology Nursing, 27(2), 142–153. https://doi.org/10.1016/j.soncn.2011.02.006

32.

McGrady

M. E.

Pai

A. L. H.

(2019). A Systematic Review of Rates, Outcomes, and Predictors of Medication Non-Adherence Among Adolescents and Young Adults with Cancer. Journal of Adolescent and Young Adult Oncology, 8(5), 485–494. https://doi.org/10.1089/jayao.2018.0160

33.

McLaughlin

A. C.

DeLucia

P. R.

Drews

F. A.

Vaughn-Cooke

Kumar

Nesbitt

R. R.

Cluff

(2020). Evaluating Medical Devices Remotely: Current Methods and Potential Innovations. Human Factors, 62(7), 1041–1060. https://doi.org/10.1177/0018720820953644

34.

Messenger

J. C.

(Ed.). (2019). Telework in the 21st Century. Edward Elgar Publishing, Inc. https://doi.org/10.4337/9781789903751

35.

Onken

L. S.

Carroll

K. M.

Shoham

Cuthbert

B. N.

Riddle

(2014). Reenvisioning Clinical Science: Unifying the Discipline to Improve the Public Health. Clinical Psychological Science, 2(1), 22–34. https://doi.org/10.1177/2167702613497932

36.

Parker

Menasce Horowitz

Minkin

(2020). How the Coronavirus Outbreak Has -and Hasn’t - Change the Way Americans Work. Pew Research Center. https://www.pewresearch.org/socialtrends/2020/12/09/how-the-coronavirus-outbreak-has-and-hasntchanged-the-way-americans-work/

37.

Petrie

Hamilton

King

Pavan

(2006). Remote usability evaluations with disabled people. Conference on Human Factors in Computing Systems - Proceedings, 1133–1141. https://doi.org/10.1145/1124772.1124942

38.

Reddy

Lester

C. A.

Stone

J. A.

Holden

R. J.

Phelan

C. H.

Chui

M. A.

(2019). Applying particiatory design to a pharmacy system intervention. RESEARCH IN SOCIAL & ADMINISTRATIVE PHARMACY, 15(11), 1358–1367.

39.

Sathian

Asim

Banerjee

Pizarro

A. B.

Roy

van Teijlingen

E. R.

Borges

Nascimento

I. J.

Alhamad

H. K.

(2020). Impact of COVID-19 on clinical trials and clinical research: A systematic review. Nepal Journal of Epidemiology, 10(3), 878–887. https://doi.org/10.3126/nje.v10i3.31622

40.

Simonse

Albayrak

Starre

(2019). Patient journey method for integrated service design. Design for Health, 3(1), 82–97.

41.

U.S. Department of Health & Human Services. (2020). HHS Issues New Report Highlighting Dramatic Trends in Medicare Beneficiary Telehealth Utilization amid COVID-19. HHS.Gov. https://www.hhs.gov/about/news/2020/07/28/hhs-issues-new-reporthighlighting-dramatic-trends-in-medicare-beneficiary-telehealthutilization-amid-covid-19.html

42.

Valdez

R. S.

Holden

R. J.

Novak

L. L.

Veinot

T. C.

(2015). Technical infrastructure implications of the patient work framework. Journal of the American Medical Informatics Association, 22(e1), e213–e215. https://doi.org/10.1093/jamia/ocu031

43.

van Dorn

. (2020). COVID-19 and readjusting clinical trials. The Lancet, 396(10250), 523–524.

44.

Y. P.

Stenehjem

D. D.

Linder

L. A.

Grahmann Parsons

Mooney

Fluchel

M. N.

(2018). Adherence to Oral Medications During Maintenance Therapy Among Children and Adolescents With Acute Lymphoblastic Leukemia: A Medication Refill Analysis. Journal of Pediatric Oncology Nursing, 35(2), 86–93. https://doi.org/10.1177/1043454217741877

45.

Yamani

Long

S. K.

Itoh

(2020). Human-Automation Trust to Technologies for Naive Users Amidst and Following the COVID-19 Pandemic. Human Factors, 62(7), 1087–1094. https://doi.org/10.1177/0018720820948981

46.

Zachary

W. W.

Rogers

C. C.

McEachin

Wilson

D. M.

Cohn

W. F.

Adams

Choi

Lundy

Valdez

R. S.

(2021). A User-Centered Need Analysis of Cancer Patient Navigation — An Intersection of Collaborative Work and Collaborative Health IT. Proceedings of the International Symposium on Human Factors and Ergonomics in Health Care, 23–27. https://doi.org/10.1177/2327857921101072

Reaching People Where They Are: Remote Macroergonomics Research

Abstract

Get full access to this article

References