Verify normal speech runtime and preserve independent quality limitations

This commit is contained in:
karl committed 2026-10-13 20:41:19 +02:00
1 parent f6b0c8f713
commit e68f4fcadc
4 files changed
+59 -1

No files matched your search

+33 -1
View File
@@ -53,7 +53,7 @@ inference budget.
- [x] Current CPU native worker English/German context reuse and Unicode paths.
- [x] Actual shared-service ASR plus Google lifecycle integration.
- [ ] Frozen independent four-file/ten-query and separate seam evaluation.
- [x] Frozen independent four-file/ten-query and separate seam evaluation.
- [ ] Normal hardware-detecting runtime staging and Windows package startup.
- [ ] Publish/install the verified Windows update.
- [ ] Native playback and graphical interaction, actual GPU execution, and
@@ -90,3 +90,35 @@ nested MSBuild path length. Its log is retained, SHA
`59f1820d6ac6adac6f525d8084c442c1ed261753eb34fcce916dc157041f777c`.
An unchanged build in a shorter owned output directory is underway; no CPU-only
distribution was substituted.
The shorter-path normal auto build subsequently completed. Worker SHA
`0b716fa17e8216ed46c7755d15acab20f658254b99780c7a68bab03d765c55bc`,
inventory SHA
`0e116c604141af147bd91736ec0722a0660dcda8c9da008e494c464753f4e5a1`.
It contains private Vulkan/CPU backends, loader and matching Microsoft runtime
files. The current normal artifact passed genuine repeated English recognition
from Unicode paths with CPU forced. Fifty owned-process samples observed the
CPU backend and no Vulkan modules; sampling alone does not prove absence at
every instant. The pinned CPU-only loading branch complements that observation.
See [runtime evidence](../tools/speech-runtime/README.md).
## Frozen independent retrieval
The four-file fixture retained both real English/German recordings, instrumental
music and silence, plus all ten frozen queries. Six positive queries found a
relevant file first, with recall@5 also 6/6. Music and silence produced zero
accepted recognized passages. **All four absent queries still returned files.**
The two readings share translated subject matter; this is a small file-retrieval
test, not broad media accuracy or verified passage/word timing.
Every expected window input and published citation passed source validation,
including four windows across the two separate artificial seam sources.
Transcription errors, partial boundary phrases and overlap duplicates remain in
the evidence. Concept substring coverage is not a word-error score. Root
independently recomputed the exact recorded scorer output.
The complete report is 174868 bytes, SHA
`79ecb75d31c0193642c81862fd5476ad47adca518d4959e436bdd472cc281798`.
It uses the internal v3 CPU artifact and does not establish normal auto runtime
quality parity or GPU performance. Details and the retained comparison are in
[the evaluator](../tools/speech-eval/native-validation/README.md).