Principlev1

Veto power must be restricted to domains where false

Veto power must be restricted to domains where false positives (unnecessary caution) are categorically less costly than false negatives (catastrophic harm), protecting only against irreversible, identity-destroying, or physically catastrophic outcomes.

Why This Is a Principle

This principle derives from loss aversion (Losses loom larger than equivalent gains in human) and signal detection tradeoffs (Every detection system faces a fundamental tradeoff between). It specifies criteria for when veto power is warranted based on asymmetric costs. It's a design principle for governance architecture, not a foundational axiom.

Source Lessons

L-0778

The veto power

Some drives should have veto power in specific situations — define these in advance.

Connections

Derived From (2)

AxiomLosses loom larger than equivalent gains in human AxiomEvery detection system faces a fundamental tradeoff between

Back to Concepts