Retain mixed evaluation indexing costs and partial failure evidence

This commit is contained in:
karl committed 2026-10-13 07:09:47 +02:00
1 parent 49aa140480
commit 45fd133407
2 files changed
+39 -8

No files matched your search

+4 -1
View File
@@ -20,7 +20,10 @@ differ. Inference runs must be coordinated with other CPU measurements. Expect
media indexing to take minutes; its explicit one-hour bound is a safety ceiling,
not a performance target. Indexing and query errors remain visible. Temporary
corpora/indexes are cleaned after the owned sessions close. Partial query results
are retained in the requested output if a later request fails.
are retained in the requested output if a later request fails. Indexing stage
stdout/stderr, JSON reports, failures, timeouts and elapsed time are also retained.
`complete: true` means evaluation finished, never that release quality passed.
The query rows retain native basic metrics separately from MCP roundtrip time.
Reported metrics are file-level top1, reciprocal rank and recall@5 after file
identity deduplication. Hard negatives in the first five and no-answer queries