Measure real CPU VAD on complete frozen media pool
This commit is contained in:
1 parent
bc47e14971
commit
7a6ab9fc6a
6 files changed
+152
-4
No files matched your search
+34
-1
@@ -2,7 +2,8 @@
|
||||
|
||||
Research recorded 2026-10-13 against whisper.cpp **v1.9.5**, exact commit
|
||||
`d1be6fde11ac6e0407606b4e42fe72d34add8037`. A real-model CPU silence contract
|
||||
check has now passed; no media comparison, alignment experiment, product
|
||||
check and complete five-source VAD run have now passed; no gated ASR comparison,
|
||||
alignment experiment, product
|
||||
integration or default change has been performed. The
|
||||
corrected ungated ASR observations remain in [speech alignment](SPEECH-ALIGNMENT.md).
|
||||
The instrumental piano's large CPU cost and unrelated text motivate testing;
|
||||
@@ -183,6 +184,38 @@ parameter table, catches native error-level logs, and checks probability frame
|
||||
coverage. This is a smoke test, not a speech-quality result or OS thread-count
|
||||
measurement. An independent complete media comparison remains necessary.
|
||||
|
||||
## Complete frozen-pool VAD measurement
|
||||
|
||||
The tracked `tools/speech-vad/run.py` verified every source hash and primary
|
||||
audio stream, decoded float PCM with full sample coverage, and ran the v6.2.0
|
||||
candidate over all five existing competitors. Raw probabilities/logs and both
|
||||
raw and source-intersected intervals are retained in ignored
|
||||
`.searchi/speech/vad-v6-results.json`, SHA-256
|
||||
`093be2005b57fe16a8f85161cc9da8966e70e2050cf19fa4122531e304dd70df`.
|
||||
Current diagnostic worker SHA-256:
|
||||
`28746d770ed470d13475d9474fcd37f28c38c39f27da09219bf9a15eef2adb19`.
|
||||
|
||||
| Source | Intervals | Detected source seconds | Whole VAD process ms |
|
||||
| --- | ---: | ---: | ---: |
|
||||
| clip04 (speech) | 12 | 66.04 | 2002.7 |
|
||||
| music01 | 0 | 0 | 870.1 |
|
||||
| music02 | 0 | 0 | 160.1 |
|
||||
| sound01 | 0 | 0 | 57.7 |
|
||||
| sound02 | 0 | 0 | 108.3 |
|
||||
|
||||
The first attempted run rejected finite float decoder overshoot above unity.
|
||||
That input contract was incorrect: float decoding can exceed unity without
|
||||
corruption. The wrapper now preserves finite samples without clipping and
|
||||
rejects nonfinite values. The failure log was retained and no reduced pool
|
||||
was scored. All three native contracts passed again with the corrected build;
|
||||
four mapping regressions cover centiseconds, source origin, padded tails and
|
||||
invalid intervals. Segmentation parameters and model remained frozen.
|
||||
|
||||
This small VAD-only result supports testing gated ASR next. It does not establish
|
||||
speech recall, transcript correctness, timestamp accuracy, retrieval improvement
|
||||
or a general music policy. No production gate was added and original Google
|
||||
audio retrieval remains unchanged.
|
||||
|
||||
Open gates: actual one-thread audit, detection/recognition
|
||||
comparison, ordinary and DTW timestamp regression, independent held-out quality,
|
||||
background starvation/cancellation/crash recovery, packaging/license review,
|
||||
|
||||
Reference in new issue
Block a user