Verify normal speech runtime and preserve independent quality limitations
This commit is contained in:
1 parent
f6b0c8f713
commit
e68f4fcadc
4 files changed
+59
-1
No files matched your search
@@ -53,7 +53,7 @@ inference budget.
|
||||
|
||||
- [x] Current CPU native worker English/German context reuse and Unicode paths.
|
||||
- [x] Actual shared-service ASR plus Google lifecycle integration.
|
||||
- [ ] Frozen independent four-file/ten-query and separate seam evaluation.
|
||||
- [x] Frozen independent four-file/ten-query and separate seam evaluation.
|
||||
- [ ] Normal hardware-detecting runtime staging and Windows package startup.
|
||||
- [ ] Publish/install the verified Windows update.
|
||||
- [ ] Native playback and graphical interaction, actual GPU execution, and
|
||||
@@ -90,3 +90,35 @@ nested MSBuild path length. Its log is retained, SHA
|
||||
`59f1820d6ac6adac6f525d8084c442c1ed261753eb34fcce916dc157041f777c`.
|
||||
An unchanged build in a shorter owned output directory is underway; no CPU-only
|
||||
distribution was substituted.
|
||||
|
||||
The shorter-path normal auto build subsequently completed. Worker SHA
|
||||
`0b716fa17e8216ed46c7755d15acab20f658254b99780c7a68bab03d765c55bc`,
|
||||
inventory SHA
|
||||
`0e116c604141af147bd91736ec0722a0660dcda8c9da008e494c464753f4e5a1`.
|
||||
It contains private Vulkan/CPU backends, loader and matching Microsoft runtime
|
||||
files. The current normal artifact passed genuine repeated English recognition
|
||||
from Unicode paths with CPU forced. Fifty owned-process samples observed the
|
||||
CPU backend and no Vulkan modules; sampling alone does not prove absence at
|
||||
every instant. The pinned CPU-only loading branch complements that observation.
|
||||
See [runtime evidence](../tools/speech-runtime/README.md).
|
||||
|
||||
## Frozen independent retrieval
|
||||
|
||||
The four-file fixture retained both real English/German recordings, instrumental
|
||||
music and silence, plus all ten frozen queries. Six positive queries found a
|
||||
relevant file first, with recall@5 also 6/6. Music and silence produced zero
|
||||
accepted recognized passages. **All four absent queries still returned files.**
|
||||
The two readings share translated subject matter; this is a small file-retrieval
|
||||
test, not broad media accuracy or verified passage/word timing.
|
||||
|
||||
Every expected window input and published citation passed source validation,
|
||||
including four windows across the two separate artificial seam sources.
|
||||
Transcription errors, partial boundary phrases and overlap duplicates remain in
|
||||
the evidence. Concept substring coverage is not a word-error score. Root
|
||||
independently recomputed the exact recorded scorer output.
|
||||
|
||||
The complete report is 174868 bytes, SHA
|
||||
`79ecb75d31c0193642c81862fd5476ad47adca518d4959e436bdd472cc281798`.
|
||||
It uses the internal v3 CPU artifact and does not establish normal auto runtime
|
||||
quality parity or GPU performance. Details and the retained comparison are in
|
||||
[the evaluator](../tools/speech-eval/native-validation/README.md).
|
||||
Reference in new issue
Block a user