Retain mixed evaluation indexing costs and partial failure evidence
This commit is contained in:
1 parent
49aa140480
commit
45fd133407
2 files changed
+39
-8
No files matched your search
@@ -20,7 +20,10 @@ differ. Inference runs must be coordinated with other CPU measurements. Expect
|
||||
media indexing to take minutes; its explicit one-hour bound is a safety ceiling,
|
||||
not a performance target. Indexing and query errors remain visible. Temporary
|
||||
corpora/indexes are cleaned after the owned sessions close. Partial query results
|
||||
are retained in the requested output if a later request fails.
|
||||
are retained in the requested output if a later request fails. Indexing stage
|
||||
stdout/stderr, JSON reports, failures, timeouts and elapsed time are also retained.
|
||||
`complete: true` means evaluation finished, never that release quality passed.
|
||||
The query rows retain native basic metrics separately from MCP roundtrip time.
|
||||
|
||||
Reported metrics are file-level top1, reciprocal rank and recall@5 after file
|
||||
identity deduplication. Hard negatives in the first five and no-answer queries
|
||||
|
||||
Reference in new issue
Block a user