Principlev1

Check schemas against test data they were not built from

Check schemas against test data they were not built from rather than only the training data they were derived from to distinguish genuine patterns from memorized examples.

Why This Is a Principle

Grounded in Hindsight Bias and Calibration Necessity (memory shifts toward outcomes) and Domain-Specific Calibration Development (calibration requires domain-specific feedback). The principle prescribes testing on new data to validate generalization—preventing overfitting in schema formation.

Source Lessons

L-0323

Schema quality criteria

Define what makes a schema good — accuracy predictive power simplicity scope.

Connections

Derived From (2)

AxiomHindsight Bias and Calibration Necessity AxiomDomain-Specific Calibration Development

Back to Concepts