Retire metrics that can't distinguish gaming from genuine progress — wrong information you trust is worse than no information
Retire metrics entirely when they no longer distinguish between gaming behavior and genuine progress, as continued use of a decoupled metric produces wrong information you trust rather than mere absence of information.
Why This Is a Rule
Donald Campbell's Law states: "The more any quantitative social indicator is used for social decision-making, the more subject it will be to corruption pressures and the more apt it will be to distort and corrupt the social processes it is intended to monitor." Applied to personal measurement: the longer a metric drives your decisions, the more your behavior adapts to optimize the metric rather than the underlying outcome.
When this adaptation reaches the point where the metric can't distinguish gaming from genuine progress, the metric has become worse than useless — it's actively harmful. No metric produces an information vacuum that you know you need to fill. A decoupled metric produces confident wrong information that steers you away from what matters. You trust the number because it's a number, and numbers feel objective, even when the number has completely decoupled from reality.
The asymmetry is critical: absence of information motivates investigation. Wrong information that you trust prevents investigation because you believe you already know the answer. A team tracking "story points completed" that has decoupled from actual delivery velocity won't investigate velocity problems because their metric says everything is fine.
When This Fires
- When Audit decision-driving metrics every 3 months: what does it incentivize, is the proxy still valid, and what does gaming look like?'s gaming check reveals that gaming behavior and genuine progress produce the same metric reading
- When a metric consistently shows "good" results but the underlying reality feels wrong
- When you can describe exactly how to game a metric and your behavior matches that description
- During metric audits when determining whether to revise or retire
Common Failure Mode
Revising rather than retiring: "The metric has problems, so let's adjust the formula." If the fundamental proxy relationship has broken — if the metric can't distinguish real from gamed — no formula adjustment fixes it. You need a new metric that measures a different aspect of the outcome, one that gaming behavior hasn't yet learned to optimize. Revising a decoupled metric just makes the decoupled metric more complex.
The Protocol
(1) During metric audit (Audit decision-driving metrics every 3 months: what does it incentivize, is the proxy still valid, and what does gaming look like?), apply the distinguishability test: describe what gaming this metric looks like. Describe what genuine progress looks like. (2) If you can't distinguish the two descriptions — if gaming behavior and genuine progress produce the same metric values — the metric has failed the distinguishability test. (3) Retire the metric immediately. Remove it from dashboards, stop tracking it, stop referencing it in decisions. (4) Accept the temporary information vacuum. "We don't know how to measure this right now" is an honest state that motivates finding a better metric. (5) Design a replacement metric that measures a different aspect of the outcome — one that gaming hasn't adapted to yet. The replacement will also eventually decouple (Goodhart's Law guarantees it), but it buys another 3-6 months of valid signal before the next audit.