Verify normal speech runtime and preserve independent quality limitations
This commit is contained in:
1 parent
f6b0c8f713
commit
e68f4fcadc
4 files changed
+59
-1
No files matched your search
@@ -0,0 +1,4 @@
|
|||||||
|
; Keep duplicate native backends/redistributables compressible across the full
|
||||||
|
; resource tree. This affects installer compression only, not application memory.
|
||||||
|
; NSIS extraction needs approximately 128 MiB for this LZMA dictionary.
|
||||||
|
SetCompressorDictSize 128
|
||||||
@@ -26,6 +26,7 @@
|
|||||||
},
|
},
|
||||||
"bundle": {
|
"bundle": {
|
||||||
"active": false,
|
"active": false,
|
||||||
|
"windows": { "nsis": { "installerHooks": "installer-hooks.nsh" } },
|
||||||
"resources": { "resources/": "" },
|
"resources": { "resources/": "" },
|
||||||
"icon": [
|
"icon": [
|
||||||
"icons/32x32.png",
|
"icons/32x32.png",
|
||||||
|
|||||||
@@ -53,7 +53,7 @@ inference budget.
|
|||||||
|
|
||||||
- [x] Current CPU native worker English/German context reuse and Unicode paths.
|
- [x] Current CPU native worker English/German context reuse and Unicode paths.
|
||||||
- [x] Actual shared-service ASR plus Google lifecycle integration.
|
- [x] Actual shared-service ASR plus Google lifecycle integration.
|
||||||
- [ ] Frozen independent four-file/ten-query and separate seam evaluation.
|
- [x] Frozen independent four-file/ten-query and separate seam evaluation.
|
||||||
- [ ] Normal hardware-detecting runtime staging and Windows package startup.
|
- [ ] Normal hardware-detecting runtime staging and Windows package startup.
|
||||||
- [ ] Publish/install the verified Windows update.
|
- [ ] Publish/install the verified Windows update.
|
||||||
- [ ] Native playback and graphical interaction, actual GPU execution, and
|
- [ ] Native playback and graphical interaction, actual GPU execution, and
|
||||||
@@ -90,3 +90,35 @@ nested MSBuild path length. Its log is retained, SHA
|
|||||||
`59f1820d6ac6adac6f525d8084c442c1ed261753eb34fcce916dc157041f777c`.
|
`59f1820d6ac6adac6f525d8084c442c1ed261753eb34fcce916dc157041f777c`.
|
||||||
An unchanged build in a shorter owned output directory is underway; no CPU-only
|
An unchanged build in a shorter owned output directory is underway; no CPU-only
|
||||||
distribution was substituted.
|
distribution was substituted.
|
||||||
|
|
||||||
|
The shorter-path normal auto build subsequently completed. Worker SHA
|
||||||
|
`0b716fa17e8216ed46c7755d15acab20f658254b99780c7a68bab03d765c55bc`,
|
||||||
|
inventory SHA
|
||||||
|
`0e116c604141af147bd91736ec0722a0660dcda8c9da008e494c464753f4e5a1`.
|
||||||
|
It contains private Vulkan/CPU backends, loader and matching Microsoft runtime
|
||||||
|
files. The current normal artifact passed genuine repeated English recognition
|
||||||
|
from Unicode paths with CPU forced. Fifty owned-process samples observed the
|
||||||
|
CPU backend and no Vulkan modules; sampling alone does not prove absence at
|
||||||
|
every instant. The pinned CPU-only loading branch complements that observation.
|
||||||
|
See [runtime evidence](../tools/speech-runtime/README.md).
|
||||||
|
|
||||||
|
## Frozen independent retrieval
|
||||||
|
|
||||||
|
The four-file fixture retained both real English/German recordings, instrumental
|
||||||
|
music and silence, plus all ten frozen queries. Six positive queries found a
|
||||||
|
relevant file first, with recall@5 also 6/6. Music and silence produced zero
|
||||||
|
accepted recognized passages. **All four absent queries still returned files.**
|
||||||
|
The two readings share translated subject matter; this is a small file-retrieval
|
||||||
|
test, not broad media accuracy or verified passage/word timing.
|
||||||
|
|
||||||
|
Every expected window input and published citation passed source validation,
|
||||||
|
including four windows across the two separate artificial seam sources.
|
||||||
|
Transcription errors, partial boundary phrases and overlap duplicates remain in
|
||||||
|
the evidence. Concept substring coverage is not a word-error score. Root
|
||||||
|
independently recomputed the exact recorded scorer output.
|
||||||
|
|
||||||
|
The complete report is 174868 bytes, SHA
|
||||||
|
`79ecb75d31c0193642c81862fd5476ad47adca518d4959e436bdd472cc281798`.
|
||||||
|
It uses the internal v3 CPU artifact and does not establish normal auto runtime
|
||||||
|
quality parity or GPU performance. Details and the retained comparison are in
|
||||||
|
[the evaluator](../tools/speech-eval/native-validation/README.md).
|
||||||
@@ -36,6 +36,27 @@ inventory SHA-256 `4904995685a5e55e0a790d9cc409dc8458e39c30cda4097c5d70bf75cb5c9
|
|||||||
This static CPU artifact does not prove normal dynamic-loader isolation, GPU
|
This static CPU artifact does not prove normal dynamic-loader isolation, GPU
|
||||||
execution, speech retrieval quality or precise independently annotated timing.
|
execution, speech retrieval quality or precise independently annotated timing.
|
||||||
|
|
||||||
|
The subsequent **normal Windows auto** build completed with all 27 inventoried
|
||||||
|
files (58,913,466 bytes). Its worker SHA-256 is
|
||||||
|
`0b716fa17e8216ed46c7755d15acab20f658254b99780c7a68bab03d765c55bc`;
|
||||||
|
inventory SHA-256 `0e116c604141af147bd91736ec0722a0660dcda8c9da008e494c464753f4e5a1`.
|
||||||
|
The same English Unicode/context test passed with forced CPU: first/warm ASR
|
||||||
|
41.31/38.46 seconds, warm load zero, fallback zero. Packaging compilation overlapped
|
||||||
|
this shared VM run, so these are functional timings, not a clean benchmark.
|
||||||
|
Fifty snapshots of the owned worker observed `ggml-cpu-cascadelake.dll`,
|
||||||
|
`ggml.dll`, `ggml-base.dll` and `whisper.dll`; neither `ggml-vulkan.dll` nor
|
||||||
|
`vulkan-1.dll` was observed. The pinned CPU-only loader branch loads only the CPU
|
||||||
|
module. Sampling alone does not prove that a module was never loaded.
|
||||||
|
Ignored observation artifact SHA-256:
|
||||||
|
`5a090b34e6a0d1ad88893295bc8db54e01f818db2ec20aca3c097d277720e158`.
|
||||||
|
Actual GPU execution/fallback and other operating systems remain unexecuted.
|
||||||
|
|
||||||
|
Windows MSBuild's nested Vulkan shader compiler failed with a long build output
|
||||||
|
path; the failed log SHA-256 is
|
||||||
|
`59f1820d6ac6adac6f525d8084c442c1ed261753eb34fcce916dc157041f777c`.
|
||||||
|
An unchanged-source build using a shorter owned output path completed. Prefer a
|
||||||
|
short build output directory on Windows; no CPU-only distribution was substituted.
|
||||||
|
|
||||||
The persistent worker receives binary requests: operation byte (1 live VAD,
|
The persistent worker receives binary requests: operation byte (1 live VAD,
|
||||||
2 contiguous recognition), little-endian u32 sample count and mono little-endian
|
2 contiguous recognition), little-endian u32 sample count and mono little-endian
|
||||||
f32 PCM, at most 480000 finite samples. Responses have a four-byte little-endian
|
f32 PCM, at most 480000 finite samples. Responses have a four-byte little-endian
|
||||||
|
|||||||
Reference in new issue
Block a user