his.sePublikationer
Ändra sökning
RefereraExporteraLänk till posten
Permanent länk

Direktlänk
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annat format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annat språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf
Affective–associative two-process theory: a neurocomputational account of partial reinforcement extinction effects
Department of Applied IT, University of Gothenburg, Gothenburg, Sweden. (Interaction Lab)
Department of Applied IT, University of Gothenburg, Gothenburg, Sweden.
Högskolan i Skövde, Institutionen för informationsteknologi. Högskolan i Skövde, Forskningscentrum för Informationsteknologi. (Interaction Lab (ILAB))ORCID-id: 0000-0002-6568-9342
Institute of Neuroinformatics, Neuroscience Center Zurich, University and ETH Zurich, Zurich, Switzerland.
Visa övriga samt affilieringar
2017 (Engelska)Ingår i: Biological Cybernetics, ISSN 0340-1200, E-ISSN 1432-0770, Vol. 111, nr 5-6, s. 365-388Artikel i tidskrift (Refereegranskat) Published
Abstract [en]

The partial reinforcement extinction effect (PREE) is an experimentally established phenomenon: behavioural response to a given stimulus is more persistent when previously inconsistently rewarded than when consistently rewarded. This phenomenon is, however, controversial in animal/human learning theory. Contradictory findings exist regarding when the PREE occurs. One body of research has found a within-subjects PREE, while another has found a within-subjects reversed PREE (RPREE). These opposing findings constitute what is considered the most important problem of PREE for theoreticians to explain. Here, we provide a neurocomputational account of the PREE, which helps to reconcile these seemingly contradictory findings of within-subjects experimental conditions. The performance of our model demonstrates how omission expectancy, learned according to low probability reward, comes to control response choice following discontinuation of reward presentation (extinction). We find that a PREE will occur when multiple responses become controlled by omission expectation in extinction, but not when only one omission-mediated response is available. Our model exploits the affective states of reward acquisition and reward omission expectancy in order to differentially classify stimuli and differentially mediate response choice. We demonstrate that stimulus–response (retrospective) and stimulus–expectation–response (prospective) routes are required to provide a necessary and sufficient explanation of the PREE versus RPREE data and that Omission representation is key for explaining the nonlinear nature of extinction data.

Ort, förlag, år, upplaga, sidor
Springer, 2017. Vol. 111, nr 5-6, s. 365-388
Nyckelord [en]
Partial reinforcement, Reinforcement learning, Decision making, Associative two-process theory, Affect
Nationell ämneskategori
Annan data- och informationsvetenskap
Forskningsämne
Interaction Lab (ILAB)
Identifikatorer
URN: urn:nbn:se:his:diva-14392DOI: 10.1007/s00422-017-0730-1ISI: 000415625500004PubMedID: 28913644Scopus ID: 2-s2.0-85029510456OAI: oai:DiVA.org:his-14392DiVA, id: diva2:1156311
Projekt
NeuralDynamics, 7th framework of the EU, grant #270247
Forskningsfinansiär
EU, FP7, Sjunde ramprogrammet, 270247Tillgänglig från: 2017-11-11 Skapad: 2017-11-11 Senast uppdaterad: 2018-02-01Bibliografiskt granskad

Open Access i DiVA

Fulltext saknas i DiVA

Övriga länkar

Förlagets fulltextPubMedScopus

Personposter BETA

Lowe, RobertBilling, Erik

Sök vidare i DiVA

Av författaren/redaktören
Lowe, RobertBilling, Erik
Av organisationen
Institutionen för informationsteknologiForskningscentrum för Informationsteknologi
I samma tidskrift
Biological Cybernetics
Annan data- och informationsvetenskap

Sök vidare utanför DiVA

GoogleGoogle Scholar

doi
pubmed
urn-nbn

Altmetricpoäng

doi
pubmed
urn-nbn
Totalt: 297 träffar
RefereraExporteraLänk till posten
Permanent länk

Direktlänk
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annat format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annat språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf