TY - JOUR
T1 - Separate mesocortical and mesolimbic pathways encode effort and reward learning signals
AU - Hauser, Tobias U.
AU - Eldar, Eran
AU - Dolan, Raymond J.
N1 - Funding Information: ACKNOWLEDGMENTS. We thank Francesco Rigoli, Peter Zeidman, Philipp Schwartenbeck, and Gabriel Ziegler for helpful discussions. We also thank Peter Dayan and Laurence Hunt for comments on an earlier version of the manuscript. We thank Francesca Hauser-Piatti for creating graphical stimuli and illustrations. Finally, we thank Al Reid for providing the force grippers. A Wellcome Trust Cambridge-UCL Mental Health and Neurosciences Network grant (095844/Z/11/Z) supported all authors. R.J.D. holds a Wellcome Trust Senior Investigator award (098362/Z/12/Z). The Max Planck UCL Centre is a joint initiative supported by UCL and the Max Planck Society. The Wellcome Trust Centre for Neuroimaging is supported by core funding from the Wellcome Trust (091593/Z/10/Z). Publisher Copyright: © 2017, National Academy of Sciences. All rights reserved.
PY - 2017/8/29
Y1 - 2017/8/29
N2 - Optimal decision making mandates organisms learn the relevant features of choice options. Likewise, knowing how much effort we should expend can assume paramount importance. A mesolimbic network supports reward learning, but it is unclear whether other choice features, such as effort learning, rely on this same network. Using computational fMRI, we show parallel encoding of effort and reward prediction errors (PEs) within distinct brain regions, with effort PEs expressed in dorsomedial prefrontal cortex and reward PEs in ventral striatum. We show a common mesencephalic origin for these signals evident in overlapping, but spatially dissociable, dopaminergic midbrain regions expressing both types of PE. During action anticipation, reward and effort expectations were integrated in ventral striatum, consistent with a computation of an overall net benefit of a stimulus. Thus, we show that motivationally relevant stimulus features are learned in parallel dopaminergic pathways, with formation of an integrated utility signal at choice.
AB - Optimal decision making mandates organisms learn the relevant features of choice options. Likewise, knowing how much effort we should expend can assume paramount importance. A mesolimbic network supports reward learning, but it is unclear whether other choice features, such as effort learning, rely on this same network. Using computational fMRI, we show parallel encoding of effort and reward prediction errors (PEs) within distinct brain regions, with effort PEs expressed in dorsomedial prefrontal cortex and reward PEs in ventral striatum. We show a common mesencephalic origin for these signals evident in overlapping, but spatially dissociable, dopaminergic midbrain regions expressing both types of PE. During action anticipation, reward and effort expectations were integrated in ventral striatum, consistent with a computation of an overall net benefit of a stimulus. Thus, we show that motivationally relevant stimulus features are learned in parallel dopaminergic pathways, with formation of an integrated utility signal at choice.
KW - Apathy
KW - Dorsomedial prefrontal cortex
KW - Effort prediction errors
KW - Reward prediction errors
KW - Substantia nigra/ventral tegmental area
UR - http://www.scopus.com/inward/record.url?scp=85028555926&partnerID=8YFLogxK
U2 - https://doi.org/10.1073/pnas.1705643114
DO - https://doi.org/10.1073/pnas.1705643114
M3 - Article
C2 - 28808037
SN - 0027-8424
VL - 114
SP - E7395-E7404
JO - Proceedings of the National Academy of Sciences of the United States of America
JF - Proceedings of the National Academy of Sciences of the United States of America
IS - 35
ER -