Probabilistic reinforcement learning in adults with autism spectrum disorders

Marjorie Solomon Friedman, Anne C. Smith, Michael J. Frank, Stanford Ly, Cameron S Carter

Research output: Contribution to journalArticle

40 Citations (Scopus)

Abstract

Background: Autism spectrum disorders (ASDs) can be conceptualized as disorders of learning, however there have been few experimental studies taking this perspective. Methods: We examined the probabilistic reinforcement learning performance of 28 adults with ASDs and 30 typically developing adults on a task requiring learning relationships between three stimulus pairs consisting of Japanese characters with feedback that was valid with different probabilities (80%, 70%, and 60%). Both univariate and Bayesian state-space data analytic methods were employed. Hypotheses were based on the extant literature as well as on neurobiological and computational models of reinforcement learning. Results: Both groups learned the task after training. However, there were group differences in early learning in the first task block where individuals with ASDs acquired the most frequently accurately reinforced stimulus pair (80%) comparably to typically developing individuals; exhibited poorer acquisition of the less frequently reinforced 70% pair as assessed by state-space learning curves; and outperformed typically developing individuals on the near chance (60%) pair. Individuals with ASDs also demonstrated deficits in using positive feedback to exploit rewarded choices. Conclusions: Results support the contention that individuals with ASDs are slower learners. Based on neurobiology and on the results of computational modeling, one interpretation of this pattern of findings is that impairments are related to deficits in flexible updating of reinforcement history as mediated by the orbito-frontal cortex, with spared functioning of the basal ganglia. This hypothesis about the pathophysiology of learning in ASDs can be tested using functional magnetic resonance imaging.

Original languageEnglish (US)
Pages (from-to)109-120
Number of pages12
JournalAutism Research
Volume4
Issue number2
DOIs
StatePublished - Apr 2011

Fingerprint

Learning
Learning Curve
Neurobiology
Learning Disorders
Frontal Lobe
Basal Ganglia
Reinforcement (Psychology)
Autism Spectrum Disorder
History
Magnetic Resonance Imaging

Keywords

  • Autism spectrum disorders
  • Basal ganglia
  • Computational model
  • Orbito-frontal cortex
  • Probabilistic
  • Reinforcement learning

ASJC Scopus subject areas

  • Neuroscience(all)
  • Clinical Neurology
  • Genetics(clinical)

Cite this

Probabilistic reinforcement learning in adults with autism spectrum disorders. / Friedman, Marjorie Solomon; Smith, Anne C.; Frank, Michael J.; Ly, Stanford; Carter, Cameron S.

In: Autism Research, Vol. 4, No. 2, 04.2011, p. 109-120.

Research output: Contribution to journalArticle

Friedman, Marjorie Solomon ; Smith, Anne C. ; Frank, Michael J. ; Ly, Stanford ; Carter, Cameron S. / Probabilistic reinforcement learning in adults with autism spectrum disorders. In: Autism Research. 2011 ; Vol. 4, No. 2. pp. 109-120.
@article{b049cc1949fc4fb0b2b81a3de9874cb0,
title = "Probabilistic reinforcement learning in adults with autism spectrum disorders",
abstract = "Background: Autism spectrum disorders (ASDs) can be conceptualized as disorders of learning, however there have been few experimental studies taking this perspective. Methods: We examined the probabilistic reinforcement learning performance of 28 adults with ASDs and 30 typically developing adults on a task requiring learning relationships between three stimulus pairs consisting of Japanese characters with feedback that was valid with different probabilities (80{\%}, 70{\%}, and 60{\%}). Both univariate and Bayesian state-space data analytic methods were employed. Hypotheses were based on the extant literature as well as on neurobiological and computational models of reinforcement learning. Results: Both groups learned the task after training. However, there were group differences in early learning in the first task block where individuals with ASDs acquired the most frequently accurately reinforced stimulus pair (80{\%}) comparably to typically developing individuals; exhibited poorer acquisition of the less frequently reinforced 70{\%} pair as assessed by state-space learning curves; and outperformed typically developing individuals on the near chance (60{\%}) pair. Individuals with ASDs also demonstrated deficits in using positive feedback to exploit rewarded choices. Conclusions: Results support the contention that individuals with ASDs are slower learners. Based on neurobiology and on the results of computational modeling, one interpretation of this pattern of findings is that impairments are related to deficits in flexible updating of reinforcement history as mediated by the orbito-frontal cortex, with spared functioning of the basal ganglia. This hypothesis about the pathophysiology of learning in ASDs can be tested using functional magnetic resonance imaging.",
keywords = "Autism spectrum disorders, Basal ganglia, Computational model, Orbito-frontal cortex, Probabilistic, Reinforcement learning",
author = "Friedman, {Marjorie Solomon} and Smith, {Anne C.} and Frank, {Michael J.} and Stanford Ly and Carter, {Cameron S}",
year = "2011",
month = "4",
doi = "10.1002/aur.177",
language = "English (US)",
volume = "4",
pages = "109--120",
journal = "Autism Research",
issn = "1939-3806",
publisher = "John Wiley and Sons Inc.",
number = "2",

}

TY - JOUR

T1 - Probabilistic reinforcement learning in adults with autism spectrum disorders

AU - Friedman, Marjorie Solomon

AU - Smith, Anne C.

AU - Frank, Michael J.

AU - Ly, Stanford

AU - Carter, Cameron S

PY - 2011/4

Y1 - 2011/4

N2 - Background: Autism spectrum disorders (ASDs) can be conceptualized as disorders of learning, however there have been few experimental studies taking this perspective. Methods: We examined the probabilistic reinforcement learning performance of 28 adults with ASDs and 30 typically developing adults on a task requiring learning relationships between three stimulus pairs consisting of Japanese characters with feedback that was valid with different probabilities (80%, 70%, and 60%). Both univariate and Bayesian state-space data analytic methods were employed. Hypotheses were based on the extant literature as well as on neurobiological and computational models of reinforcement learning. Results: Both groups learned the task after training. However, there were group differences in early learning in the first task block where individuals with ASDs acquired the most frequently accurately reinforced stimulus pair (80%) comparably to typically developing individuals; exhibited poorer acquisition of the less frequently reinforced 70% pair as assessed by state-space learning curves; and outperformed typically developing individuals on the near chance (60%) pair. Individuals with ASDs also demonstrated deficits in using positive feedback to exploit rewarded choices. Conclusions: Results support the contention that individuals with ASDs are slower learners. Based on neurobiology and on the results of computational modeling, one interpretation of this pattern of findings is that impairments are related to deficits in flexible updating of reinforcement history as mediated by the orbito-frontal cortex, with spared functioning of the basal ganglia. This hypothesis about the pathophysiology of learning in ASDs can be tested using functional magnetic resonance imaging.

AB - Background: Autism spectrum disorders (ASDs) can be conceptualized as disorders of learning, however there have been few experimental studies taking this perspective. Methods: We examined the probabilistic reinforcement learning performance of 28 adults with ASDs and 30 typically developing adults on a task requiring learning relationships between three stimulus pairs consisting of Japanese characters with feedback that was valid with different probabilities (80%, 70%, and 60%). Both univariate and Bayesian state-space data analytic methods were employed. Hypotheses were based on the extant literature as well as on neurobiological and computational models of reinforcement learning. Results: Both groups learned the task after training. However, there were group differences in early learning in the first task block where individuals with ASDs acquired the most frequently accurately reinforced stimulus pair (80%) comparably to typically developing individuals; exhibited poorer acquisition of the less frequently reinforced 70% pair as assessed by state-space learning curves; and outperformed typically developing individuals on the near chance (60%) pair. Individuals with ASDs also demonstrated deficits in using positive feedback to exploit rewarded choices. Conclusions: Results support the contention that individuals with ASDs are slower learners. Based on neurobiology and on the results of computational modeling, one interpretation of this pattern of findings is that impairments are related to deficits in flexible updating of reinforcement history as mediated by the orbito-frontal cortex, with spared functioning of the basal ganglia. This hypothesis about the pathophysiology of learning in ASDs can be tested using functional magnetic resonance imaging.

KW - Autism spectrum disorders

KW - Basal ganglia

KW - Computational model

KW - Orbito-frontal cortex

KW - Probabilistic

KW - Reinforcement learning

UR - http://www.scopus.com/inward/record.url?scp=79953748372&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=79953748372&partnerID=8YFLogxK

U2 - 10.1002/aur.177

DO - 10.1002/aur.177

M3 - Article

C2 - 21425243

AN - SCOPUS:79953748372

VL - 4

SP - 109

EP - 120

JO - Autism Research

JF - Autism Research

SN - 1939-3806

IS - 2

ER -