Verify normal speech runtime and preserve independent quality limitations

This commit is contained in:
karl committed 2026-10-13 20:41:19 +02:00
1 parent f6b0c8f713
commit e68f4fcadc
4 files changed
+59 -1

No files matched your search

@@ -0,0 +1,4 @@
; Keep duplicate native backends/redistributables compressible across the full
; resource tree. This affects installer compression only, not application memory.
; NSIS extraction needs approximately 128 MiB for this LZMA dictionary.
SetCompressorDictSize 128
+1
View File
@@ -26,6 +26,7 @@
},
"bundle": {
"active": false,
"windows": { "nsis": { "installerHooks": "installer-hooks.nsh" } },
"resources": { "resources/": "" },
"icon": [
"icons/32x32.png",
+33 -1
View File
@@ -53,7 +53,7 @@ inference budget.
- [x] Current CPU native worker English/German context reuse and Unicode paths.
- [x] Actual shared-service ASR plus Google lifecycle integration.
- [ ] Frozen independent four-file/ten-query and separate seam evaluation.
- [x] Frozen independent four-file/ten-query and separate seam evaluation.
- [ ] Normal hardware-detecting runtime staging and Windows package startup.
- [ ] Publish/install the verified Windows update.
- [ ] Native playback and graphical interaction, actual GPU execution, and
@@ -90,3 +90,35 @@ nested MSBuild path length. Its log is retained, SHA
`59f1820d6ac6adac6f525d8084c442c1ed261753eb34fcce916dc157041f777c`.
An unchanged build in a shorter owned output directory is underway; no CPU-only
distribution was substituted.
The shorter-path normal auto build subsequently completed. Worker SHA
`0b716fa17e8216ed46c7755d15acab20f658254b99780c7a68bab03d765c55bc`,
inventory SHA
`0e116c604141af147bd91736ec0722a0660dcda8c9da008e494c464753f4e5a1`.
It contains private Vulkan/CPU backends, loader and matching Microsoft runtime
files. The current normal artifact passed genuine repeated English recognition
from Unicode paths with CPU forced. Fifty owned-process samples observed the
CPU backend and no Vulkan modules; sampling alone does not prove absence at
every instant. The pinned CPU-only loading branch complements that observation.
See [runtime evidence](../tools/speech-runtime/README.md).
## Frozen independent retrieval
The four-file fixture retained both real English/German recordings, instrumental
music and silence, plus all ten frozen queries. Six positive queries found a
relevant file first, with recall@5 also 6/6. Music and silence produced zero
accepted recognized passages. **All four absent queries still returned files.**
The two readings share translated subject matter; this is a small file-retrieval
test, not broad media accuracy or verified passage/word timing.
Every expected window input and published citation passed source validation,
including four windows across the two separate artificial seam sources.
Transcription errors, partial boundary phrases and overlap duplicates remain in
the evidence. Concept substring coverage is not a word-error score. Root
independently recomputed the exact recorded scorer output.
The complete report is 174868 bytes, SHA
`79ecb75d31c0193642c81862fd5476ad47adca518d4959e436bdd472cc281798`.
It uses the internal v3 CPU artifact and does not establish normal auto runtime
quality parity or GPU performance. Details and the retained comparison are in
[the evaluator](../tools/speech-eval/native-validation/README.md).
+21
View File
@@ -36,6 +36,27 @@ inventory SHA-256 `4904995685a5e55e0a790d9cc409dc8458e39c30cda4097c5d70bf75cb5c9
This static CPU artifact does not prove normal dynamic-loader isolation, GPU
execution, speech retrieval quality or precise independently annotated timing.
The subsequent **normal Windows auto** build completed with all 27 inventoried
files (58,913,466 bytes). Its worker SHA-256 is
`0b716fa17e8216ed46c7755d15acab20f658254b99780c7a68bab03d765c55bc`;
inventory SHA-256 `0e116c604141af147bd91736ec0722a0660dcda8c9da008e494c464753f4e5a1`.
The same English Unicode/context test passed with forced CPU: first/warm ASR
41.31/38.46 seconds, warm load zero, fallback zero. Packaging compilation overlapped
this shared VM run, so these are functional timings, not a clean benchmark.
Fifty snapshots of the owned worker observed `ggml-cpu-cascadelake.dll`,
`ggml.dll`, `ggml-base.dll` and `whisper.dll`; neither `ggml-vulkan.dll` nor
`vulkan-1.dll` was observed. The pinned CPU-only loader branch loads only the CPU
module. Sampling alone does not prove that a module was never loaded.
Ignored observation artifact SHA-256:
`5a090b34e6a0d1ad88893295bc8db54e01f818db2ec20aca3c097d277720e158`.
Actual GPU execution/fallback and other operating systems remain unexecuted.
Windows MSBuild's nested Vulkan shader compiler failed with a long build output
path; the failed log SHA-256 is
`59f1820d6ac6adac6f525d8084c442c1ed261753eb34fcce916dc157041f777c`.
An unchanged-source build using a shorter owned output path completed. Prefer a
short build output directory on Windows; no CPU-only distribution was substituted.
The persistent worker receives binary requests: operation byte (1 live VAD,
2 contiguous recognition), little-endian u32 sample count and mono little-endian
f32 PCM, at most 480000 finite samples. Responses have a four-byte little-endian