Evaluate frozen relevance hypothesis once on held-out Google CPU queries

docs/RELEVANCE-CALIBRATION.md

@@ -108,3 +108,43 @@ Policy SHA-256:
 `df0a887b97dd7fda6aeff1b6c966fe7558521f40dbe1c911e91cfd312dca7461`.
 Ignored analysis: `.searchi/qa/calibration-cosine-policy-v1.json`.
 Held-out remains unevaluated at this freeze. Product ranking is unchanged.
+
+## Held-out result and disposition, 2026-10-13
+
+After the policy freeze was committed and pushed, actual Google CPU inference
+completed all 24 held-out queries plus six Code-scope repeats. The fixture,
+model, policy and threshold were unchanged. The explicit runner option requires
+the exact pre-evaluation policy SHA; default execution remains calibration-only.
+Four structural Rust tests and strict all-target Clippy passed.
+
+| Scope | Unfiltered semantic / hybrid positive top-1 | Positive top results retained at 0.70 | Absent requests with retained semantic neighbours |
+| --- | --- | --- | --- |
+| All files | 16/16 | 15/16 | 0/8 |
+| Additional Code scope | 4/4 | 4/4 | 0/2 |
+
+The lost request is `version-wildcard-de`: its correct All files semantic
+candidate scores **0.6766**, below the frozen threshold. It has no lexical
+results, so preserving lexical retrieval would not rescue it. The same request
+under Code scope scores **0.7388** and survives. The highest absent All files
+top score is approximately **0.6954**, exceeding that positive score: there is
+no single raw-cosine threshold separating these held-out top results.
+
+**Reject deployment as a universal default cutoff.** Do not lower this policy
+after seeing held-out outcomes or claim that its strong calibration result
+proved safe abstention. Product ranking remains unchanged. The next relevance
+work should preserve access to weak-but-correct results and evaluate richer
+evidence on a new independent corpus; this sample is no longer unseen data.
+
+`scores.hypothesis_semantic` measures retained semantic candidates only.
+The recorded production hybrid request is unmodified; no filtered hybrid
+fusion or UI confidence behavior was executed. This small bilingual corpus
+does not establish general customer quality or media abstention.
+
+Raw ignored report: `.searchi/qa/held-out-cosine-v1.json`, SHA-256
+`8f6baceac27e90c719c2bbb522eeb2d1623056e2f8334f31f7dd67a912c0fccd`.
+Diagnostic runner SHA-256:
+`db685085f7f53d02cc85ef7c534e8ac02f4c5c806940bd4ff44ccbeae76e5762`.
+Worker capabilities record Google EmbeddingGemma 2, CPU, one thread, query
+role, context 512 and 768 dimensions. Semantic indexing took 73,991.6605 ms;
+query startup took 7,153.4587 ms. These ordered debug setup measurements are
+not UI latency or warm p95. Owned workers exited; the installed app was retained.