Human Theory of Mind Inference in Search and Rescue Tasks

Abstract

The ability to make inferences about other’s mental state is referred to as having a Theory of Mind (ToM). Such ability is the foundation of many human social interactions such as empathy, teamwork, and communication. As intelligent agents being involved in diverse human-agent teams, they are also expected to be socially intelligent to become effective teammates. To provide a feasible baseline for future social intelligent agents, this paper presents a experimental study on the process of human ToM reference. Human observers’ inferences are compared with participants’ verbally reported mental state in a simulated search and rescue task. Results show that ToM inference is a challenging task even for experienced human observers.

Get full access to this article

View all access options for this article.

References

Baker

Saxe

Tenenbaum

(2011, 01). Bayesian theory of mind: Modeling joint belief-desire attribution. Proceedings of the Thirty-Third Annual Conference of the Cognitive Science Society.

Baron-Cohen

Leslie

Frith

(1985). Does the autistic child have a “theory of mind. Cognition, 37–46.

Birch

(2005). When knowledge is a curse: children’s and adults reasoning about mental states. Current Directions in Psychological Science, 1–5.

Bratman

(1987). Intentions, plans, and practical reason. Harvard University Press.

Casper

Murphy

R. R.

(2003). Human-robot interactions during the robot-assisted urban search and rescue response at the world trade center. IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 33(3), 367–385. doi: 10.1109/TSMCB.2003.811794

Ericsson

Simon

(1993). Protocol analysis: Verbal reports as data, revised edition. MIT Press.

Ericsson

K. A.

Simon

H. A.

(1984). Protocol analysis: Verbal reports as data. the MIT Press.

Fiore

Bracken

Demir

Freeman

Lewis

Huang

(2020). Transdisciplinary team research to develop theory of mind in human-ai teams. Proceedings of the Sixty-fourth Annual Conference of the Human Factors and Ergonomics Society.

Jain

Jena

Gupta

Hughes

Lewis

Sycara

(2020). Predicting human strategies in simulated search and rescue task. Accepted at NeurIPS 2020; Workshop on Artificial Intelligence for Humanitarian Assistance and Disaster Response (AI+HADR 2020).

10.

McHugh

M. L.

(2012). Interrater reliability: the kappa statistic. Biochemia medica, 22(3), 276–282.

11.

Nourbakhsh

I. R.

Sycara

Koes

Yong

Lewis

Burion

(2005). Human-robot teaming for search and rescue. IEEE Pervasive Computing, 4(1), 72–79. doi: 10.1109/MPRV.2005.13

12.

Samson

Apperly

(2010). There is more to mind reading than having theory of mind concepts: new directions in theory of mind research. Infant Child Development, 443–454.

13.

Stich

Ravenscroft

(1992). What is folk psychology? Cognition, 447–468.

14.

Wimmer

Perner

(1983). Beliefs about beliefs: Representation and constraining function of wrong beliefs in young children’s understanding of deception. Cognition, 103–128.