Measure real CPU VAD on complete frozen media pool

This commit is contained in:
karl committed 2026-10-13 13:41:57 +02:00
1 parent bc47e14971
commit 7a6ab9fc6a
6 files changed
+152 -4

No files matched your search

+34 -1
View File
@@ -2,7 +2,8 @@
Research recorded 2026-10-13 against whisper.cpp **v1.9.5**, exact commit
`d1be6fde11ac6e0407606b4e42fe72d34add8037`. A real-model CPU silence contract
check has now passed; no media comparison, alignment experiment, product
check and complete five-source VAD run have now passed; no gated ASR comparison,
alignment experiment, product
integration or default change has been performed. The
corrected ungated ASR observations remain in [speech alignment](SPEECH-ALIGNMENT.md).
The instrumental piano's large CPU cost and unrelated text motivate testing;
@@ -183,6 +184,38 @@ parameter table, catches native error-level logs, and checks probability frame
coverage. This is a smoke test, not a speech-quality result or OS thread-count
measurement. An independent complete media comparison remains necessary.
## Complete frozen-pool VAD measurement
The tracked `tools/speech-vad/run.py` verified every source hash and primary
audio stream, decoded float PCM with full sample coverage, and ran the v6.2.0
candidate over all five existing competitors. Raw probabilities/logs and both
raw and source-intersected intervals are retained in ignored
`.searchi/speech/vad-v6-results.json`, SHA-256
`093be2005b57fe16a8f85161cc9da8966e70e2050cf19fa4122531e304dd70df`.
Current diagnostic worker SHA-256:
`28746d770ed470d13475d9474fcd37f28c38c39f27da09219bf9a15eef2adb19`.
| Source | Intervals | Detected source seconds | Whole VAD process ms |
| --- | ---: | ---: | ---: |
| clip04 (speech) | 12 | 66.04 | 2002.7 |
| music01 | 0 | 0 | 870.1 |
| music02 | 0 | 0 | 160.1 |
| sound01 | 0 | 0 | 57.7 |
| sound02 | 0 | 0 | 108.3 |
The first attempted run rejected finite float decoder overshoot above unity.
That input contract was incorrect: float decoding can exceed unity without
corruption. The wrapper now preserves finite samples without clipping and
rejects nonfinite values. The failure log was retained and no reduced pool
was scored. All three native contracts passed again with the corrected build;
four mapping regressions cover centiseconds, source origin, padded tails and
invalid intervals. Segmentation parameters and model remained frozen.
This small VAD-only result supports testing gated ASR next. It does not establish
speech recall, transcript correctness, timestamp accuracy, retrieval improvement
or a general music policy. No production gate was added and original Google
audio retrieval remains unchanged.
Open gates: actual one-thread audit, detection/recognition
comparison, ordinary and DTW timestamp regression, independent held-out quality,
background starvation/cancellation/crash recovery, packaging/license review,