Use measured query-only context across desktop CLI and MCP
This commit is contained in:
1 parent
95c72c5fd4
commit
88cd9c7f5a
12 files changed
+582
-20
No files matched your search
@@ -178,6 +178,13 @@ Audit and measured priorities: [EMBEDDINGGEMMA2-AUDIT.md](EMBEDDINGGEMMA2-AUDIT.
|
||||
- [ ] Measure representative mixed-media contention, single-thread latency,
|
||||
extraction/decoder/ANN work and native UI p95 before closing this gate.
|
||||
- [ ] Attribute startup cost; measure smaller query context and selective encoders.
|
||||
- [x] Query-only 512-token context in the normal worker, desktop/CLI/MCP
|
||||
integration and actual Windows CPU parity/boundary/reference tests.
|
||||
Paired samples reduced private commitment by 183 MB; resident memory and
|
||||
cached startup were essentially unchanged. See [QUERY-CONTEXT.md](QUERY-CONTEXT.md).
|
||||
- [ ] Verify native Linux/macOS, GPU parity and updated installed packages.
|
||||
- [ ] Evaluate text readiness before the larger media projector finishes
|
||||
downloading; preserve verified assets and honest media setup status.
|
||||
- [ ] Buffered bounded media IPC and linear UTF-8 source-window offset processing.
|
||||
- [ ] Evaluate 256d MRL and content-specific vision budgets on independent data.
|
||||
- [ ] Validate GPU precision, synchronization-aware timings, parity and fallback
|
||||
|
||||
Reference in new issue
Block a user