Virginia Tech
    • Log in
    View Item 
    •   VTechWorks Home
    • Destination Areas (DAs)
    • Destination Areas (DAs)
    • Destination Area: Adaptive Brain and Behavior (ABB)
    • View Item
    •   VTechWorks Home
    • Destination Areas (DAs)
    • Destination Areas (DAs)
    • Destination Area: Adaptive Brain and Behavior (ABB)
    • View Item
    JavaScript is disabled for your browser. Some features of this site may not work without it.

    Active inference and agency: optimal control without cost functions

    Thumbnail
    View/Open
    MontagueActiveInference2012.pdf (601.7Kb)
    Downloads: 160
    Date
    2012-08-03
    Author
    Friston, Karl J.
    Samothrakis, Spyridon
    Montague, P. Read
    Metadata
    Show full item record
    Abstract
    This paper describes a variational free-energy formulation of (partially observable) Markov decision problems in decision making under uncertainty. We show that optimal control can be cast as active inference. In active inference, both action and posterior beliefs about hidden states minimise a free energy bound on the negative log-likelihood of observed states, under a generative model. In this setting, reward or cost functions are absorbed into prior beliefs about state transitions and terminal states. Effectively, this converts optimal control into a pure inference problem, enabling the application of standard Bayesian filtering techniques.We then consider optimal trajectories that rest on posterior beliefs about hidden states in the future. Crucially, this entails modelling control as a hidden state that endows the generative model with a representation of agency. This leads to a distinction between models with and without inference on hidden control states; namely, agency-free and agency-based models, respectively.
    URI
    http://hdl.handle.net/10919/78836
    Collections
    • Destination Area: Adaptive Brain and Behavior (ABB) [394]
    • Scholarly Works, Fralin Biomedical Research Institute at VTC [372]

    If you believe that any material in VTechWorks should be removed, please see our policy and procedure for Requesting that Material be Amended or Removed. All takedown requests will be promptly acknowledged and investigated.

    Virginia Tech | University Libraries | Contact Us
     

     

    VTechWorks

    AboutPoliciesHelp

    Browse

    All of VTechWorksCommunities & CollectionsBy Issue DateAuthorsTitlesSubjectsThis CollectionBy Issue DateAuthorsTitlesSubjects

    My Account

    Log inRegister

    Statistics

    View Usage Statistics

    If you believe that any material in VTechWorks should be removed, please see our policy and procedure for Requesting that Material be Amended or Removed. All takedown requests will be promptly acknowledged and investigated.

    Virginia Tech | University Libraries | Contact Us