Keep prepared search readers warm and verify abrupt indexing recovery

This commit is contained in:
karl committed 2026-10-13 01:36:34 +02:00
1 parent 423a1ea57d
commit 6b78c8bb7f
17 files changed
+1011 -41

No files matched your search

+9 -3
View File
@@ -30,7 +30,7 @@ Status: implementation started; no production release yet. Windows VM tests use
- [ ] Versioned embeddings, ANN index, exact-match priority and hybrid fusion.
- [ ] English/German relevance corpus and measured top-10 recall.
- [ ] Atomic model/index replacement and resumable persistent work queues.
- [ ] Completed-source manifests with title/model/window policy keys and
- [x] Completed-source manifests with title/model/window policy keys and
citation remapping; reuse only verified complete document/media groups.
- [ ] Durable generation tasks, crash resume and final corpus reconciliation;
see [incremental semantic design](INCREMENTAL-SEMANTIC.md).
@@ -100,7 +100,7 @@ Status: implementation started; no production release yet. Windows VM tests use
Warm p95 alone does not satisfy the first-use requirement.
- [ ] Test migrations, interrupted work, invalid documents, inaccessible/offline roots and cloud placeholders.
- [ ] Automated native build matrix and documented supported cross-compilation paths.
- [x] Native Linux headless workspace tests: 104 passed, 16 explicitly ignored.
- [x] Native Linux headless workspace tests: 106 passed, 18 explicitly ignored.
- [x] Native Linux Google text/code/media reference parity and service
lifecycle/rebuild recovery: seven genuine CPU integration tests passed.
- [x] Unsigned Linux x86-64 headless archive: verify extracted checksums/modes,
@@ -136,6 +136,9 @@ Audit and measured priorities: [EMBEDDINGGEMMA2-AUDIT.md](EMBEDDINGGEMMA2-AUDIT.
paired repeated-query/filter-change results with unchanged retrieval evidence.
- [x] Bounded provider-scoped actual-query vector LRU with accurate cache traces;
preserve filtering, source freshness, failures and actual warmup probes.
- [x] Bounded shared prepared-ANN handoff before SQL activation; retain query
model/LRU and readiness across publication. Actual CPU first new query has
no foreground graph load; [recovery/handoff evidence](RECOVERY-AND-HANDOFF.md).
- [x] Reduce semantic settle delay to 120 ms and retain old ready generation
during rebuilding; test initial-generation and activation readiness boundaries.
- [x] Bound whole IPC write/read deadlines and recover from a nonreading helper;
@@ -153,7 +156,10 @@ Audit and measured priorities: [EMBEDDINGGEMMA2-AUDIT.md](EMBEDDINGGEMMA2-AUDIT.
on normal rescans; stale/missing agent excerpts fail closed.
- [x] Actual Google CPU same-metadata text mutation before/during inference:
reject publication, rescan without metadata workarounds and reuse unaffected vectors.
- [ ] Process-kill/concurrent deletion/media mutation, component-policy reuse and
- [x] Abrupt owned CLI termination after a committed partial audio chunk;
resume completed documents and reencode unfinished media without duplicates.
Process termination does not prove power-loss durability.
- [ ] Concurrent deletion/media mutation, component-policy reuse and
indexing/foreground measurements.
See [INCREMENTAL-SEMANTIC.md](INCREMENTAL-SEMANTIC.md).
- [ ] Benchmark genuine token-budgeted multi-sequence batching and isolation.