Principlev1

Every decision automation system must include explicit

Every decision automation system must include explicit override conditions that specify when to suspend the automated rule and return to full deliberation.

Why This Is a Principle

This derives from Cognition Operates Through Dual Processing Systems (System 1 vs System 2), Goals as Perceptual Filters (goals as filters), and Automaticity Without Conscious Control (automatic processes). The principle prescribes a specific design requirement: override conditions are mandatory, not optional. It's actionable (tells you WHAT to include), general (applies to all automated decision systems), and addresses the failure mode of applying routine logic to non-routine situations.

Source Lessons

L-0416

Decision agents

Agents for recurring decision types like buy-versus-build or accept-versus-decline.

L-0492

Graceful degradation

Design your systems to fail partially rather than completely.

Connections

Derived From (5)

AxiomGoals as Perceptual Filters AxiomAutomaticity Without Conscious Control AxiomCognition Operates Through Dual Processing Systems AxiomBehavior requires an initiating signal to occur at a AxiomImplementation intentions (if-then plans) significantly

Back to Concepts