Monte Carlo Planning Method Estimates Planning Horizons during Interactive Social Exchange

Simple item page
dc.contributor.authorHula, Andreasen
dc.contributor.authorMontague, P. Readen
dc.contributor.authorDayan, Peteren
dc.date.accessioned2018-11-19T18:38:15Zen
dc.date.available2018-11-19T18:38:15Zen
dc.date.issued2015-06en
dc.description.abstractReciprocating interactions represent a central feature of all human exchanges. They have been the target of various recent experiments, with healthy participants and psychiatric populations engaging as dyads in multi-round exchanges such as a repeated trust task. Behaviour in such exchanges involves complexities related to each agent's preference for equity with their partner, beliefs about the partner's appetite for equity, beliefs about the partner's model of their partner, and so on. Agents may also plan different numbers of steps into the future. Providing a computationally precise account of the behaviour is an essential step towards understanding what underlies choices. A natural framework for this is that of an interactive partially observable Markov decision process (IPOMDP). However, the various complexities make IPOMDPs inordinately computationally challenging. Here, we show how to approximate the solution for the multi-round trust task using a variant of the Monte-Carlo tree search algorithm. We demonstrate that the algorithm is efficient and effective, and therefore can be used to invert observations of behavioural choices. We use generated behaviour to elucidate the richness and sophistication of interactive inference.en
dc.description.sponsorshipThis work was supported by a Wellcome Trust Principal Research Fellowship (PRM, AH) under grant 091188/Z/10/Z, The Kane Family Foundation (PRM), NIDA grant R01DA11723 (PRM), NIMH grant R01MH085496 (PRM), NIA grant RC4AG039067 (PRM), and The Gatsby Charitable Foundation (PD). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.en
dc.format.mimetypeapplication/pdfen
dc.identifier.doihttps://doi.org/10.1371/journal.pcbi.1004254en
dc.identifier.eissn1553-7358en
dc.identifier.issn1553-734Xen
dc.identifier.issue6en
dc.identifier.othere1004254en
dc.identifier.pmid26053429en
dc.identifier.urihttp://hdl.handle.net/10919/85909en
dc.identifier.volume11en
dc.language.isoen_USen
dc.publisherPLOSen
dc.rightsCreative Commons Attribution 4.0 Internationalen
dc.rights.urihttp://creativecommons.org/licenses/by/4.0/en
dc.subjectdecision-makingen
dc.subjectgame-theoryen
dc.subjectcooperationen
dc.subjectreciprocityen
dc.subjectfairnessen
dc.subjecttrusten
dc.subjectnormsen
dc.subjectmodelen
dc.titleMonte Carlo Planning Method Estimates Planning Horizons during Interactive Social Exchangeen
dc.title.serialPLOS Computational Biologyen
dc.typeArticle - Refereeden
dc.type.dcmitypeTexten

Files

Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
journal.pcbi.1004254.PDF
Size:
7.29 MB
Format:
Adobe Portable Document Format
Description:
Download

Collections

Scholarly Works, Fralin Biomedical Research Institute at VTC
Destination Area: Adaptive Brain and Behavior (ABB)