Definitionv1

Variable reward: a reward schedule that delivers

Variable reward: a reward schedule that delivers reinforcement after an unpredictable number of responses or time intervals, creating higher response rates and dramatically greater resistance to extinction compared to fixed reward schedules

Why This Is a Definition

This definition precisely captures the semantic boundary of 'variable reward' by identifying its genus (reward schedule) and differentia (unpredictable number of responses or time intervals). It distinguishes variable rewards from fixed schedules by explaining their functional characteristics (higher response rates, greater resistance to extinction) and references the foundational research (Skinner's operant conditioning, Schultz's dopamine research) that establishes this specific meaning within the curriculum.

Source Lessons

L-1037

Variable rewards and habit strength

Unpredictable rewards create stronger habits than predictable ones.

Connections

Defines (59)

AxiomCognitive Defusion: Thoughts Are Objects AxiomExtended Cognition Thesis AxiomDirected Attention as Depletable Resource AxiomHindsight Bias and Calibration Necessity AxiomHabits as Context-Response Associations AxiomTwo-Level Metacognitive Architecture AxiomExpertise Transforms Perceptual Chunking AxiomLinguistic Structuring of Thought AxiomComplementary Learning Systems Architecture AxiomCognitive Dissonance Drives Information Avoidance AxiomDual Coding Theory: Verbal and Visual Channels AxiomConversational Memory Asymmetry From Production Planning AxiomUltradian and Circadian Cognitive Rhythms AxiomNeural Plasticity Enables Lifelong Automatic Learning AxiomPatterns Exist in Hierarchical Logical Levels AxiomEmotion as Systematic Cognitive Modulator AxiomBias Blind Spot Asymmetry AxiomCognition Operates Through Dual Processing Systems AxiomLooping Effects of Human Classification AxiomAutomatic Pattern Perception AxiomHierarchical Chunking Expands Capacity AxiomBasic-Level Category Privilege AxiomConstrual Level Effects on Perception AxiomPiagetian Equilibration Through Schema Dynamics AxiomYou necessarily trust your own cognitive faculties as a AxiomExpert performance in complex domains requires deliberate AxiomDopamine neurons fire when a reward is anticipated based on AxiomWhen a habit forms, neural activity spikes at the cue and AxiomDefault options determine behavior more reliably than AxiomRegulatory flexibility—the ability to shift between PrincipleApply the same tags to notes from different domains when PrincipleBuild capture habits by anchoring them to existing routines PrincipleProcess inbox items in two distinct passes—first clarifying PrincipleRecord the situational context that makes captured PrincipleInstrument systems with the minimum number of metrics that PrincipleConsolidate all agent status information onto a single PrincipleExpect and plan for an implementation dip where performance PrincipleWhen designing cognitive agents, examine the full pattern PrincipleMake context switching costs visible through deliberate PrincipleBlock your measured peak attention hours on your calendar as PrincipleUse the 'five whys' technique on any significant energy PrincipleProtect circadian consistency through same-time sleep/wake PrincipleUse environmental initiation ease as the primary lever for PrinciplePrioritize controllable cue types (time, location, preceding PrincipleMake the desired transition between behavioral links the PrincipleFor complex cognitive tasks that resist starting, design PrincipleEstablish post-extinction monitoring with four defined PrincipleConduct functional analysis before attempting extinction by PrincipleDistinguish between hypothesis failure (wrong theory),PrincipleDefine routine chains at explicit trigger-action granularity PrincipleCompare your self-concept against your actual behavioral PrincipleReview accumulated notes in batches spanning weeks or months PrincipleCognitive offloading must become an automatic daily habit PrincipleFrame goals at the identity level ('become a person who X')PrincipleDesign every information artifact with explicit compression PrincipleDesign systems based on Theory Y assumptions (people seek PrincipleWhen two opposing beliefs are both evidentially supported,PrincipleConduct integration work as part of daily life rather than PrincipleVerify habit automaticity by checking whether the behavior

Back to Concepts