Use measured query-only context across desktop CLI and MCP

This commit is contained in:
karl committed 2026-10-13 07:30:40 +02:00
1 parent 95c72c5fd4
commit 88cd9c7f5a
12 files changed
+582 -20

No files matched your search

+7
View File
@@ -178,6 +178,13 @@ Audit and measured priorities: [EMBEDDINGGEMMA2-AUDIT.md](EMBEDDINGGEMMA2-AUDIT.
- [ ] Measure representative mixed-media contention, single-thread latency,
extraction/decoder/ANN work and native UI p95 before closing this gate.
- [ ] Attribute startup cost; measure smaller query context and selective encoders.
- [x] Query-only 512-token context in the normal worker, desktop/CLI/MCP
integration and actual Windows CPU parity/boundary/reference tests.
Paired samples reduced private commitment by 183 MB; resident memory and
cached startup were essentially unchanged. See [QUERY-CONTEXT.md](QUERY-CONTEXT.md).
- [ ] Verify native Linux/macOS, GPU parity and updated installed packages.
- [ ] Evaluate text readiness before the larger media projector finishes
downloading; preserve verified assets and honest media setup status.
- [ ] Buffered bounded media IPC and linear UTF-8 source-window offset processing.
- [ ] Evaluate 256d MRL and content-specific vision budgets on independent data.
- [ ] Validate GPU precision, synchronization-aware timings, parity and fallback