Distinct Eligibility Traces for LTP and LTD in Cortical Synapses

Kaiwen He, Marco Huertas, Su Z. Hong, XiaoXiu Tie, Johannes W Hell, Harel Shouval, Alfredo Kirkwood

Research output: Contribution to journalArticle

46 Citations (Scopus)

Abstract

In reward-based learning, synaptic modifications depend on a brief stimulus and a temporally delayed reward, which poses the question of how synaptic activity patterns associate with a delayed reward. A theoretical solution to this so-called distal reward problem has been the notion of activity-generated "synaptic eligibility traces," silent and transient synaptic tags that can be converted into long-term changes in synaptic strength by reward-linked neuromodulators. Here we report the first experimental demonstration of eligibility traces in cortical synapses. We demonstrate the Hebbian induction of distinct traces for LTP and LTD and their subsequent timing-dependent transformation into lasting changes by specific monoaminergic receptors anchored to postsynaptic proteins. Notably, the temporal properties of these transient traces allow stable learning in a recurrent neural network that accurately predicts the timing of the reward, further validating the induction and transformation of eligibility traces for LTP and LTD as a plausible synaptic substrate for reward-based learning.

Original languageEnglish (US)
Pages (from-to)528-538
Number of pages11
JournalNeuron
Volume88
Issue number3
DOIs
StatePublished - Nov 4 2015

Fingerprint

Reward
Synapses
Learning
Neurotransmitter Agents
Proteins

ASJC Scopus subject areas

  • Neuroscience(all)

Cite this

He, K., Huertas, M., Hong, S. Z., Tie, X., Hell, J. W., Shouval, H., & Kirkwood, A. (2015). Distinct Eligibility Traces for LTP and LTD in Cortical Synapses. Neuron, 88(3), 528-538. https://doi.org/10.1016/j.neuron.2015.09.037

Distinct Eligibility Traces for LTP and LTD in Cortical Synapses. / He, Kaiwen; Huertas, Marco; Hong, Su Z.; Tie, XiaoXiu; Hell, Johannes W; Shouval, Harel; Kirkwood, Alfredo.

In: Neuron, Vol. 88, No. 3, 04.11.2015, p. 528-538.

Research output: Contribution to journalArticle

He, K, Huertas, M, Hong, SZ, Tie, X, Hell, JW, Shouval, H & Kirkwood, A 2015, 'Distinct Eligibility Traces for LTP and LTD in Cortical Synapses', Neuron, vol. 88, no. 3, pp. 528-538. https://doi.org/10.1016/j.neuron.2015.09.037
He, Kaiwen ; Huertas, Marco ; Hong, Su Z. ; Tie, XiaoXiu ; Hell, Johannes W ; Shouval, Harel ; Kirkwood, Alfredo. / Distinct Eligibility Traces for LTP and LTD in Cortical Synapses. In: Neuron. 2015 ; Vol. 88, No. 3. pp. 528-538.
@article{cd29f9a0bdca47908b346c8025596d8f,
title = "Distinct Eligibility Traces for LTP and LTD in Cortical Synapses",
abstract = "In reward-based learning, synaptic modifications depend on a brief stimulus and a temporally delayed reward, which poses the question of how synaptic activity patterns associate with a delayed reward. A theoretical solution to this so-called distal reward problem has been the notion of activity-generated {"}synaptic eligibility traces,{"} silent and transient synaptic tags that can be converted into long-term changes in synaptic strength by reward-linked neuromodulators. Here we report the first experimental demonstration of eligibility traces in cortical synapses. We demonstrate the Hebbian induction of distinct traces for LTP and LTD and their subsequent timing-dependent transformation into lasting changes by specific monoaminergic receptors anchored to postsynaptic proteins. Notably, the temporal properties of these transient traces allow stable learning in a recurrent neural network that accurately predicts the timing of the reward, further validating the induction and transformation of eligibility traces for LTP and LTD as a plausible synaptic substrate for reward-based learning.",
author = "Kaiwen He and Marco Huertas and Hong, {Su Z.} and XiaoXiu Tie and Hell, {Johannes W} and Harel Shouval and Alfredo Kirkwood",
year = "2015",
month = "11",
day = "4",
doi = "10.1016/j.neuron.2015.09.037",
language = "English (US)",
volume = "88",
pages = "528--538",
journal = "Neuron",
issn = "0896-6273",
publisher = "Cell Press",
number = "3",

}

TY - JOUR

T1 - Distinct Eligibility Traces for LTP and LTD in Cortical Synapses

AU - He, Kaiwen

AU - Huertas, Marco

AU - Hong, Su Z.

AU - Tie, XiaoXiu

AU - Hell, Johannes W

AU - Shouval, Harel

AU - Kirkwood, Alfredo

PY - 2015/11/4

Y1 - 2015/11/4

N2 - In reward-based learning, synaptic modifications depend on a brief stimulus and a temporally delayed reward, which poses the question of how synaptic activity patterns associate with a delayed reward. A theoretical solution to this so-called distal reward problem has been the notion of activity-generated "synaptic eligibility traces," silent and transient synaptic tags that can be converted into long-term changes in synaptic strength by reward-linked neuromodulators. Here we report the first experimental demonstration of eligibility traces in cortical synapses. We demonstrate the Hebbian induction of distinct traces for LTP and LTD and their subsequent timing-dependent transformation into lasting changes by specific monoaminergic receptors anchored to postsynaptic proteins. Notably, the temporal properties of these transient traces allow stable learning in a recurrent neural network that accurately predicts the timing of the reward, further validating the induction and transformation of eligibility traces for LTP and LTD as a plausible synaptic substrate for reward-based learning.

AB - In reward-based learning, synaptic modifications depend on a brief stimulus and a temporally delayed reward, which poses the question of how synaptic activity patterns associate with a delayed reward. A theoretical solution to this so-called distal reward problem has been the notion of activity-generated "synaptic eligibility traces," silent and transient synaptic tags that can be converted into long-term changes in synaptic strength by reward-linked neuromodulators. Here we report the first experimental demonstration of eligibility traces in cortical synapses. We demonstrate the Hebbian induction of distinct traces for LTP and LTD and their subsequent timing-dependent transformation into lasting changes by specific monoaminergic receptors anchored to postsynaptic proteins. Notably, the temporal properties of these transient traces allow stable learning in a recurrent neural network that accurately predicts the timing of the reward, further validating the induction and transformation of eligibility traces for LTP and LTD as a plausible synaptic substrate for reward-based learning.

UR - http://www.scopus.com/inward/record.url?scp=84946103029&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84946103029&partnerID=8YFLogxK

U2 - 10.1016/j.neuron.2015.09.037

DO - 10.1016/j.neuron.2015.09.037

M3 - Article

VL - 88

SP - 528

EP - 538

JO - Neuron

JF - Neuron

SN - 0896-6273

IS - 3

ER -