New smart-home devices provide the opportunity to advance psychological science and theory through novel research opportunities in home environments. These technologies extend the in vivo research and intervention capabilities afforded by other assessment techniques such as Ecological Momentary Assessment methods as well as mobile and wearable devices. Smart-home devices contain a multitude of sensors capable of continuously and unobtrusively collecting multimodal data within home contexts. These devices have some complementary strengths and limitations compared with other assessment methods. This article (a) briefly reviews data collection methods in home environments, (b) discusses the unique advantages of smart-home devices, (c) describes the extant smart-home literature, (d) explores how these devices may advance evaluation and refinement of psychological theories, (e) describes examples of psychological processes that are potential targets for smart-home assessment and intervention, (f) considers methodological challenges and barriers, (g) discusses ethical considerations, and (h) concludes with a discussion of future directions for research and the merging of passive-sensing technologies with active self-report methods. This article aims to highlight the potential utility of smart-home devices within psychological research to evaluate psychological theories related to behavior within the home context.
AdibF.MaoH.KabelacZ.KatabiD.MillerR. C. (2015). Smart homes that monitor breathing and heart rate. In BegoleB.KimJ.InkpenK.WooW. (Eds.), CHI ’15: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (pp. 837–846). doi:10.1145/2702123.2702200
2.
American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). Washington, DC: Author.
Back to basics [Editorial]. (2013). Nature Neuroscience, 16, Article 983. doi:10.1038/nn.3483
6.
BaggeC. L.LittlefieldA. K.GlennC. R. (2017). Trajectories of affective response as warning signs for suicide attempts: An examination of the 48 hours prior to a recent suicide attempt. Clinical Psychological Science, 5, 259–271.
7.
BaumeisterR. F.VohsK. D.FunderD. C. (2007). Psychology as the science of self-reports and finger movements: Whatever happened to actual behavior?Perspectives on Psychological Science, 2, 396–403.
8.
BeckA. T.KovacsM.WeissmanA. (1975). Hopelessness and suicidal behavior: An overview. Journal of the American Medical Association, 234, 1146–1149.
9.
BlossC.NebekerC.BietzM.BaeD.BigbyB.DevereauxM.. . . KlemmerS. (2016). Reimagining human research protections for 21st century science. Journal of Medical Internet Research, 18(12), Article e29. doi:10.2196/jmir.6634
10.
CarterA.LiddleJ.HallW.CheneryH. (2015). Mobile phones in research and treatment: Ethical guidelines and future directions. JMIR mHealth and uHealth, 3(4), Article e95. doi:10.2196/mhealth.4538
11.
CronbachL. J.MeehlP. E. (1955). Construct validity in psychological tests. Psychological Bulletin, 52, 281–302.
12.
DawadiP.CookD.ParseyC.Schmitter-EdgecombeM.SchneiderM. (2011). An approach to cognitive assessment in smart home. In ChawlaN.GhaniR.HuJ.KrishnapuramB.KumarM.MadiganD.Younger. . . J.(Eds.), KDD ’11: Proceedings of the 17th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining: Workshop on Data Mining for Medicine and HealthCare (pp. 56–59). doi:10.1145/2023582.2023592
13.
DawadiP.CookD. J.Schmitter-EdgecombeM. (2014). Smart home-based longitudinal functional assessment. In BrushA. J.FridayA. (Eds.), UbiComp ’14 Adjunct: Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing (pp. 1217–1224). doi:10.1145/2638728.2638813
14.
DawadiP. N.CookD. J.Schmitter-EdgecombeM. (2013). Automated cognitive health assessment using smart home monitoring of complex tasks. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 43, 1302–1313. doi:10.1109/TSMC.2013.2252338
15.
De la TorreF.ChuW.XiongX.VicenteF.DingX.CohnJ. (2015). IntraFace. In BowyerK.LeonardisA.CohnJ. (Eds.), 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (Vol. 1). doi:10.1109/FG.2015.7163082
16.
DiClementeC. C.MarinilliA. S.SinghM.BellinoL. E. (2001). The role of feedback in the process of health behavior change. American Journal of Health Behavior, 25, 217–227.
17.
FisherP. A.FrenkelT. I.NollL. K.BerryM.YockelsonM. (2016). Promoting healthy child development via a two-generation translational neuroscience framework: The filming interactions to nurture development video coaching program. Child Development Perspectives, 10, 251–256.
18.
FurrR. M. (2009). Personality psychology as a truly behavioural science. European Journal of Personality, 23, 369–401.
19.
GoslingS. D.JohnO. P.CraikK. H.RobinsR. W. (1998). Do people know how they behave? Self-reported act frequencies compared with on-line codings by observers. Journal of Personality and Social Psychology, 74, 1337–1349.
20.
GraeschA. P.MittmannA.BradburyT.RepettiR. (2006). Video ethnography and ethnoarchaeological tracking. In Pitt-CatsouphesM.KossekE. ErnstSweetS. (Eds.), Work and family handbook: Multi-disciplinary perspectives and approaches (pp. 387–409). Mahwah, NJ: Erlbaum.
21.
HansenJ. H. L.HasanT. (2015). Speaker recognition by machines and humans: A tutorial review. IEEE Signal Processing Magazine, 32(6), 74–99. doi:10.1109/MSP.2015.2462851
22.
HarariG. M.LaneN. D.WangR.CrosierB. S.CampbellA. T.GoslingS. D. (2016). Using smartphones to collect behavioral data in psychological science: Opportunities, practical considerations, and challenges. Perspectives on Psychological Science, 11, 838–854.
23.
HernandezJ.PicardR. W. (2014, October). SenseGlass: Using google glass to sense daily emotions. In BenkoH.DontchevaM.WigdorD. (Eds.), Uist’14: Adjunct Proceedings of the Adjunct Publication of the 27th Annual ACM Symposium on User Interface Software and Technology. (pp. 77–78). doi:10.1145/2658779.2658784
24.
HertwigR.Grüne-YanoffT. (2017). Nudging and boosting: Steering or empowering good decisions. Perspectives on Psychological Science, 12, 973–986.
25.
HostinarC. E.SullivanR. M.GunnarM. R. (2014). Psychobiological mechanisms underlying the social buffering of the hypothalamic–pituitary–adrenocortical axis: A review of animal models and human studies across development. Psychological Bulletin, 140, 256–282.
26.
HuY.TilkeD.AdamsT.CrandallA. S.CookD. J.Schmitter-EdgecombeM. (2016). Smart home in a box: Usability study for a large scale self-installation of smart home technologies. Journal of Reliable Intelligent Environments, 2, 93–106.
27.
InselT. R. (2017). Digital phenotyping: Technology for a new science of behavior. Journal of the American Medical Association, 318, 1215–1216.
28.
JainA. K.LiS. Z. (2011). Handbook of face recognition. New York, NY: Springer.
29.
JoinerT. (2007). Why people die by suicide. Cambridge, MA: Harvard University Press.
30.
JoynerM. J.PanethN.IoannidisJ. P. (2016). What happens when underperforming big ideas in research become entrenched?Journal of the American Medical Association, 316, 1355–1356.
31.
KapteinM.MarkopoulosP.De RuyterB.AartsE. (2015). Personalizing persuasive technologies: Explicit and implicit personalization using persuasion profiles. International Journal of Human-Computer Studies, 77, 38–51.
32.
KellermannA. L.RivaraF. P.SomesG.ReayD. T.FranciscoJ.BantonJ. G.. . . HackmanB. B. (1992). Suicide in the home in relation to gun ownership. New England Journal of Medicine, 327, 467–472.
33.
KellyP.MarshallS. J.BadlandH.KerrJ.OliverM.DohertyA. R.FosterC. (2013). An ethical framework for automated, wearable cameras in health behavior research. American Journal of Preventive Medicine, 44, 314–319.
34.
KesslerR. C.BerglundP.DemlerO.JinR.KoretzD.MerikangasK. R.. . . WangP. S. (2003). The epidemiology of major depressive disorder: Results from the National Comorbidity Survey Replication (NCS-R). Journal of the American Medical Association, 289, 3095–3105.
35.
KlasnjaP.HeklerE. B.ShiffmanS.BoruvkaA.AlmirallD.TewariA.MurphyS. A. (2015). Microrandomized trials: An experimental design for developing just-in-time adaptive interventions. Health Psychology, 34, 1220–1228.
36.
KleimanE. M.TurnerB. J.FedorS.BealeE. E.HuffmanJ. C.NockM. K. (2017). Examination of real-time fluctuations in suicidal ideation and its risk factors: Results from two ecological momentary assessment studies. Journal of Abnormal Psychology, 126, 726–738.
37.
KovalP.KuppensP. (2012). Changing emotion dynamics: Individual differences in the effect of anticipatory social stress on emotional inertia. Emotion, 12, 256–267.
38.
KovalP.KuppensP.AllenN. B.SheeberL. (2012). Getting stuck in depression: The roles of rumination and emotional inertia. Cognition & Emotion, 26, 1412–1427.
39.
KuppensP.AllenN. B.SheeberL. B. (2010). Emotional inertia and psychological maladjustment. Psychological Science, 21, 984–991.
40.
KuppensP.SheeberL. B.YapM. B.WhittleS.SimmonsJ. G.AllenN. B. (2012). Emotional inertia prospectively predicts the onset of depressive disorder in adolescence. Emotion, 12, 283–289.
41.
LabelleK. L.MihailidisA. (2006). The use of automated prompting to facilitate handwashing in persons with dementia. American Journal of Occupational Therapy, 60, 442–450.
42.
MarchioriD. R.AdriaanseM. A.De RidderD. T. (2017). Unresolved questions in nudging research: Putting the psychology back in nudging. Social & Personality Psychology Compass, 11, 1–13.
43.
MarinoM.LiY.RueschmanM. N.WinkelmanJ. W.EllenbogenJ. M.SoletJ. M.. . . BuxtonO. M. (2013). Measuring sleep: Accuracy, sensitivity, and specificity of wrist actigraphy compared to polysomnography. Sleep, 36, 1747–1755.
44.
MarteauT. M.OgilvieD.RolandM.SuhrcheM.KellyM. P. (2011) Judging nudging: Can nudging improve population health. BMJ, 342, Article d228. doi:10.1136/bmj.d228
45.
MartireL. M.KeefeF. J.SchulzR.StephensM. A. P.MogleJ. A. (2013). The impact of daily arthritis pain on spouse sleep. Pain, 154, 1725–1731. doi:10.1016/j.pain.2013.05.020
46.
McCambridgeJ.WittonJ.ElbourneD. R. (2014). Systematic review of the Hawthorne effect: New concepts are needed to study research participation effects. Journal of Clinical Epidemiology, 67, 267–277.
47.
MehlM. R. (2017). The Electronically Activated Recorder (EAR): A method for the naturalistic observation of daily social behavior. Current Directions in Psychological Science, 26, 184–190.
48.
MihailidisA.BarbenelJ. C.FernieG. (2004). The efficacy of an intelligent cognitive orthosis to facilitate handwashing by persons with moderate to severe dementia. Neuropsychological Rehabilitation, 14, 135–171.
49.
MihailidisA.BogerJ. N.CraigT.HoeyJ. (2008). The COACH prompting system to assist older adults with dementia through handwashing: An efficacy study. BMC Geriatrics, 8, Article 28. doi:10.1186/1471-2318-8-28
50.
MillerG. (2012). The smartphone psychology manifesto. Perspectives on Psychological Science, 7, 221–237.
51.
MillnerA. J.LeeM. D.NockM. K. (2017). Describing and measuring the pathway to suicide attempts: A preliminary study. Suicide and Life-Threatening Behavior, 47, 353–336.
52.
MojtabaiR.JormA. F. (2015). Trends in psychological distress, depressive episodes and mental health treatment-seeking in the United States: 2001–2012. Journal of Affective Disorders, 174, 556–561.
53.
MojtabaiR.OlfsonM.HanB. (2016). National trends in the prevalence and treatment of depression in adolescents and young adults. Pediatrics, 138(6), Article e20161878. doi:10.1542/peds.2016-1878
54.
Nahum-ShaniI.HeklerE. B.Spruijt-MetzD. (2015). Building health behavior models to guide the development of just-in-time adaptive interventions: A pragmatic framework. Health Psychology, 34 (Suppl.), 1209–1219. doi:10.1037/hea0000306
55.
Nahum-ShaniI.SmithS. N.SpringB. J.CollinsL. M.WitkiewitzK.TewariA.MurphyS. A. (2018). Just-in-time adaptive interventions (JITAIs) in mobile health: Key components and design principles for ongoing health behavior support. Annals of Behavioral Medicine, 52(6):446–462. doi:10.1007/s12160-016-9830-8
NebekerC.LagareT.TakemotoM.LewarsB.CristK.BlossC. S.KerrJ. (2016). Engaging research participants to inform the ethical conduct of mobile imaging, pervasive sensing, and location tracking research. Translational Behavioral Medicine, 6, 577–586.
59.
NelsonB. W.AllenN. B. (2018). Accuracy of wearables during a continuous and ecologically valid 24-hour period that approximates actual consumer device use conditions within an individual. JMIR Preprints. doi:10.2196/preprints.10828
60.
NelsonB. W.ByrneM. L.SimmonsJ. G.WhittleS.SchwartzO. S.ReynoldsE. C.. . . AllenN. B. (2017). Adolescent sympathetic activity and salivary C-reactive protein: The effects of parental behavior. Health Psychology, 36, 955–965. doi: 10.1037/hea0000516
61.
OchsE.ShohetM.CamposB.BeckM. (2010). Coming together at dinner: A study of working families. In. B. Schneider (Ed.), Workplace flexibility: Realigning 20th-century jobs for a 21st-century workforce (pp. 57–70). Ithica, NY: ILR Press.
62.
Okamoto-MizunoK.MizunoK. (2012). Effects of thermal environment on sleep and circadian rhythm. Journal of Physiological Anthropology, 31, Article 14. doi:10.1186/1880-6805-31-14
63.
PhiliposeM.FishkinK. P.PerkowitzM.PattersonD. J.FoxD.KautzH.HahnelD. (2004). Inferring activities from interactions with objects. IEEE Pervasive Computing, 3(4), 50–57. doi:10.1109/MPRV.2004.7
64.
PietromonacoP. R.CollinsN. L. (2017). Interpersonal mechanisms linking close relationships to health. American Psychologist, 72, 531–542.
65.
PisaniA. R.WymanP. A.MohrD. C.PerrinoT.GalloC.VillamarJ.. . . BrownC. H. (2016). Human subjects protection and technology in prevention science: Selected opportunities and challenges. Prevention Science, 17, 765–778.
66.
ReavleyN. J.JormA. F. (2014). Mental health reform: Increased resources but limited gains. Medical Journal of Australia, 201, 375–376.
67.
The Regents of the University of California. (2016). Connected and Open Research Ethics (CORE) Platform. Retrieved from http://thecore-platform.ucsd.edu/
68.
ReisH. T.GoslingS. D. (2010). Social psychological methods outside the laboratory. In FiskeS. T.GilbertD. T.LindzeyG. (Eds.), Handbook of social psychology (pp. 82–114). Hoboken, NJ: John Wiley & Sons Inc. doi:10.1002/9780470561119.socpsy001003
69.
RepettiR. L.ReynoldsB. M.SearsM. S. (2015). Families under the microscope: Repeated sampling of perceptions, experiences, biology, and behavior. Journal of Marriage and Family, 77, 126–146.
70.
RobertoC. A.KawachiI. (2014). Use of psychology and behavioral economics to promote healthy eating. American Journal of Preventive Medicine, 47, 832–837.
71.
RonzioC. R.GuagliardoM. F.PersaudN. (2006). Disparity in location of urban mental service providers. American Journal of Orthopsychiatry, 76, 37–43.
72.
SaxbeD. E.RepettiR. L.GraeschA. P. (2011). Time spent in housework and leisure: Links with parents’ physiological recovery from work. Journal of Family Psychology, 25, 271–281.
73.
ShiffmanS.StoneA. A.HuffordM. R. (2008). Ecological momentary assessment. Annual Review of Clinical Psychology, 4, 1–32.
74.
SinglaG.CookD. J.Schmitter-EdgecombeM. (2010). Recognizing independent and joint activities among multiple residents in smart environments. Journal of Ambient Intelligence and Humanized Computing, 1, 57–63.
TavernierR.AdamE. K. (2017). Text message intervention improves objective sleep hours among adolescents: The moderating role of race-ethnicity. Sleep Health, 3, 62–67.
78.
TorousJ.NebekerC. (2017). Navigating ethics in the digital age: Introducing Connected and Open Research Ethics (CORE), a tool for researchers and institutional review boards. Journal of Medical Internet Research, 19(2), Article e38. doi:10.2196/jmir.6793
79.
TorousJ.RobertsL. W. (2017a). The ethical use of mobile health technology in clinical psychiatry. The Journal of Nervous and Mental Disease, 205, 4–8.
80.
TorousJ.RobertsL. W. (2017b). Needed innovation in digital health and smartphone applications for mental health: Transparency and trust. JAMA Psychiatry, 74, 437–438.
81.
TurkM. A.PentlandA. P. (1991). Face recognition using eigenfaces. Journal of Cognitive Neuroscience, 3, 72–86.
82.
van de LeemputI. A.WichersM.CramerA. O.BorsboomD.TuerlinckxF.KuppensP.. . . DeromC. (2014). Critical slowing down as early warning for the onset and termination of depression. Proceedings of the National Academy of Sciences, USA, 111, 87–92.
83.
WangP. S.LaneM.OlfsonM.PincusH. A.WellsK. B.KesslerR. C. (2005). Twelve-month use of mental health services in the United States: Results from the National Comorbidity Survey Replication. Archives of General Psychiatry, 62, 629–640.
84.
WangS. W.RepettiR.SearsM. (2013). Using direct observational methods to study the real lives of families: Advantages, complexities, and conceptual and practical considerations. In GrzywaczJ. G.DemeroutiE. (Eds.), New frontiers in work and family research (pp. 191–210). East Sussex, England: Psychology Press.
85.
ZhaoM.AdibF.KatabiD. (2016, October). Emotion recognition using wireless signals. In GruteserM.ChenY. (eds.), MobiCom ’16: Proceedings of the 22nd Annual International Conference on Mobile Computing and Networking (pp. 95–108). doi:10.1145/2973750.2973762
86.
ZhaoM.YueS.KatabiD.JaakkolaT. S.BianchiM. T. (2017). Learning sleep stages from radio signals: A conditional adversarial architecture. Proceedings of the 34th International Conference on Machine Learning, PMLR, 70, 4100–4109.
