Learning in settings with partial feedback and the wavy recency effect of rare events

Research output: Contribution to journalArticlepeer-review

Abstract

Analyses of human learning reveal a discrepancy between the long- and the short-term effects of outcomes on subsequent choice. The long-term effect is simple: favorable outcomes increase the choice rate of an alternative whereas unfavorable outcomes decrease it. The short-term effects are more complex. Favorable outcomes can decrease the choice rate of the best option. This pattern violates the positive recency assumption that underlies the popular models of learning. The current research tries to clarify the implications of these results. Analysis of wide sets of learning experiments shows that rare positive outcomes have a wavy recency effect. The probability of risky choice after a successful outcome from risk-taking at trial t is initially (at t + 1) relatively high, falls to a minimum at t + 2, then increases for about 15 trials, and then decreases again. Rare negative outcomes trigger a wavy reaction when the feedback is complete, but not under partial feedback. The difference between the effects of rare positive and rare negative outcomes and between full and partial feedback settings can be described as a reflection of an interaction of an effort to discover patterns with two other features of human learning: surprise-triggers-change and the hot stove effect. A similarity-based descriptive model is shown to capture well all these interacting phenomena. In addition, the model outperforms the leading models in capturing the outcomes of data used in the 2010 Technion Prediction Tournament.

Original languageEnglish
Pages (from-to)18-43
Number of pages26
JournalCognitive Psychology
Volume93
DOIs
StatePublished - 1 Mar 2017

Keywords

  • Contingencies of reinforcements
  • Decisions from experience
  • Law of effect
  • Negative recency
  • Pattern learning
  • The gambler's fallacy

All Science Journal Classification (ASJC) codes

  • Neuropsychology and Physiological Psychology
  • Experimental and Cognitive Psychology
  • Developmental and Educational Psychology
  • Linguistics and Language
  • Artificial Intelligence

Fingerprint

Dive into the research topics of 'Learning in settings with partial feedback and the wavy recency effect of rare events'. Together they form a unique fingerprint.

Cite this