Definitionv1DF-591
Benchmark
a measurable baseline measurement of system performance taken before any optimization changes are applied, used to determine whether subsequent changes actually improved performance
Why This Is a Definition
This definition precisely establishes the semantic boundary of 'benchmark' by identifying it as a specific type of measurement (measurable baseline) taken at a particular time (before optimization) with a specific purpose (determining if changes improved performance). It distinguishes this from mere measurement or observation and emphasizes the comparative nature of benchmarking as a logical necessity for determining actual improvement.
Connections
Defines (58)
AxiomExponential Information DecayAxiomExtended Cognition ThesisAxiomDirected Attention as Depletable ResourceAxiomHindsight Bias and Calibration NecessityAxiomTwo-Level Metacognitive ArchitectureAxiomConversational Memory Asymmetry From Production PlanningAxiomUltradian and Circadian Cognitive RhythmsAxiomPatterns Exist in Hierarchical Logical LevelsAxiomEmotional Hijacking of JudgmentAxiomSystematic Overconfidence TaxonomyAxiomEmotion as Systematic Cognitive ModulatorAxiomNatural Frequency Format AdvantageAxiomCognition Operates Through Dual Processing SystemsAxiomValid Intuition Requires Stable Regularities and FeedbackAxiomMental States Are Cognitively ImputableAxiomCognitive and Affective Empathy Are DistinctAxiomAutomatic Pattern PerceptionAxiomDunbar's Number Limits Stable RelationshipsAxiomBasic-Level Category PrivilegeAxiomConstrual Level Effects on PerceptionAxiomPiagetian Equilibration Through Schema DynamicsAxiomFlexible Context-Dependent CategorizationAxiomPeople interpret failure as either evidence about…AxiomEvery detection system faces a fundamental tradeoff between…AxiomTask switching between different types of cognitive work…AxiomWhen estimating future task duration, people naturally adoptAxiomExpert performance in complex domains requires deliberate…AxiomCognitive performance follows an inverted-U relationship…PrincipleDesign capture and retrieval systems to minimize friction…PrincipleApply the same tags to notes from different domains…PrincipleProcess inbox items in two distinct passes—first clarifying…PrincipleInstrument systems with the minimum number of metrics…PrincipleMatch monitoring frequency to the rate at which meaningful…PrincipleDedicate focused, time-boxed sessions to improving one…PrincipleDesign optimization sessions to create moderate activation…PrincipleHold measurement protocol constant across before-and-after…PrincipleBenchmark efficiency, accuracy, and quality dimensions…PrincipleIdentify and eliminate shared dependencies across multiple…PrincipleBlock your measured peak attention hours on your calendar…PrincipleWhen large language models express 90%+ linguistic…PrincipleIdentify your information pipeline bottleneck by testing…PrincipleShift focus from event reflection to system reflection…PrincipleUse goals to set directional targets but rely on systems…PrincipleFor complex cognitive tasks that resist starting, design…PrincipleDesign micro-chain final links to produce one minimal unit…PrincipleDesign social chain links to specify your own behavior…PrincipleIdentify the essential function each routine serves…PrincipleWeight emotional data more heavily in domains where…PrincipleWhen holding more power in a relationship (formal authority…PrincipleReview accumulated notes in batches spanning weeks or monthsPrincipleUse satisficing decision rules (define 'good enough'…PrincipleAggregate predictions by confidence level and compare statedPrincipleDesign physical and digital workspaces to afford only…PrincipleDocument not only what tools you use but the complete…PrincipleTest each candidate classification dimension by asking…PrincipleWhen presenting complex information to diverse audiences…PrincipleScore tasks on three dimensions — irreversibility (cost…PrincipleSpecify every delegation with five components