TY - JOUR
T1 - Multiplicity of control in the basal ganglia
T2 - Computational roles of striatal subregions
AU - Bornstein, Aaron M.
AU - Daw, Nathaniel D.
N1 - Funding Information:
The authors are supported by a Scholar Award from the McKnight Foundation , a NARSAD Young Investigator Award, Human Frontiers Science Program Grant RGP0036/2009-C , and NIMH grant 1R01MH087882-01, part of the CRCNS program. We thank Fenna Krienen, Amitai Shenhav, Dylan Simon and Elliott Wimmer for helpful conversations.
PY - 2011/6
Y1 - 2011/6
N2 - The basal ganglia, in particular the striatum, are central to theories of behavioral control, and often identified as a seat of action selection. Reinforcement learning (RL) models. - which have driven much recent experimental work on this region. - cast striatum as a dynamic controller, integrating sensory and motivational information to construct efficient and enriching behavioral policies. Befitting this informationally central role, the BG sit at the nexus of multiple anatomical 'loops' of synaptic projections, connecting a wide range of cortical and subcortical structures. Numerous pioneering anatomical studies conducted over the past several decades have meticulously catalogued these loops, and labeled them according to the inferred functions of the connected regions. The specific cotermina of the projections are highly localized to several different subregions of the striatum, leading to the suggestion that these subregions perform complementary but distinct functions. However, until recently, the dominant computational framework outlined only a bipartite, dorsal/ventral, division of striatum. We review recent computational and experimental advances that argue for a more finely fractionated delineation. In particular, experimental data provide extensive insight into unique functions subserved by the dorsomedial striatum (DMS). These functions appear to correspond well with theories of a 'model-based' RL subunit, and may also shed light on the suborganization of ventral striatum. Finally, we discuss the limitations of these ideas and how they point the way toward future refinements of neurocomputational theories of striatal function, bringing them into contact with other areas of computational theory and other regions of the brain.
AB - The basal ganglia, in particular the striatum, are central to theories of behavioral control, and often identified as a seat of action selection. Reinforcement learning (RL) models. - which have driven much recent experimental work on this region. - cast striatum as a dynamic controller, integrating sensory and motivational information to construct efficient and enriching behavioral policies. Befitting this informationally central role, the BG sit at the nexus of multiple anatomical 'loops' of synaptic projections, connecting a wide range of cortical and subcortical structures. Numerous pioneering anatomical studies conducted over the past several decades have meticulously catalogued these loops, and labeled them according to the inferred functions of the connected regions. The specific cotermina of the projections are highly localized to several different subregions of the striatum, leading to the suggestion that these subregions perform complementary but distinct functions. However, until recently, the dominant computational framework outlined only a bipartite, dorsal/ventral, division of striatum. We review recent computational and experimental advances that argue for a more finely fractionated delineation. In particular, experimental data provide extensive insight into unique functions subserved by the dorsomedial striatum (DMS). These functions appear to correspond well with theories of a 'model-based' RL subunit, and may also shed light on the suborganization of ventral striatum. Finally, we discuss the limitations of these ideas and how they point the way toward future refinements of neurocomputational theories of striatal function, bringing them into contact with other areas of computational theory and other regions of the brain.
UR - http://www.scopus.com/inward/record.url?scp=79960203266&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=79960203266&partnerID=8YFLogxK
U2 - 10.1016/j.conb.2011.02.009
DO - 10.1016/j.conb.2011.02.009
M3 - Review article
C2 - 21429734
AN - SCOPUS:79960203266
SN - 0959-4388
VL - 21
SP - 374
EP - 380
JO - Current Opinion in Neurobiology
JF - Current Opinion in Neurobiology
IS - 3
ER -