Skip to content
How to ThinkIn the Age of AI
Rulev2RL-577

Separate reasoning from credentials

When someone shares expertise or makes a recommendation, separate your evaluation of their reasoning from your evaluation of their credentials by asking 'Would I find this compelling if it came from a low-status source?'

Why This Is a Rule

Authority bias — automatically weighting information more heavily when it comes from a high-status source — is one of the most pervasive cognitive biases. The same argument that sounds brilliant from a Stanford professor sounds unremarkable from a community college student. The reasoning is identical; only the source changed. Yet your brain treated them differently because status serves as a heuristic for credibility.

The counterfactual test — "Would I find this compelling from a low-status source?" — strips the status halo from the reasoning, forcing you to evaluate the argument on its own merits. If the reasoning is sound, it should be compelling regardless of source. If it's only compelling because of who said it, you're not evaluating reasoning — you're deferring to authority, which is efficient when the authority is genuinely expert in the relevant domain but dangerous when authority is mistranslated across domains or when the authority's confidence exceeds their evidence.

This doesn't mean ignore credentials — expertise is real and informative. But credentials should inform your prior probability that the reasoning is sound, not substitute for evaluating the reasoning itself. "This comes from a Nobel laureate" means "there's a higher chance the reasoning is rigorous." It doesn't mean "the reasoning is automatically correct."

When This Fires

Common Failure Mode

Authority-laundered poor reasoning: accepting weak arguments because the source is impressive. "This CEO says we should move fast and break things" sounds visionary from a billionaire founder and reckless from an unknown startup founder — but the quality of the strategy advice is the same regardless of who said it. Evaluate the strategy, not the source's net worth.

The Protocol

(1) When someone makes a recommendation or shares an argument, notice the source's status: are they high-credentials, famous, or institutionally prestigious? (2) If yes → apply the counterfactual: "If an unknown person with no special credentials made this exact same argument with this exact same evidence, would I find it compelling?" (3) If the argument is compelling regardless of source → the reasoning stands on its own merits. Accept it based on the reasoning. (4) If the argument is only compelling because of who said it → the reasoning is weak and you're deferring to authority. Investigate the reasoning independently before accepting. (5) Note: this also works in reverse. Apply "Would I dismiss this if it came from a high-status source?" to arguments from low-status sources to catch reverse authority bias.