Harden worker IPC and recoverable runtime staging

This commit is contained in:
karl committed 2026-10-12 23:46:01 +02:00
1 parent 0bba1a0aa7
commit b3ebd7a894
12 files changed
+1152 -75

No files matched your search

+6
View File
@@ -20,6 +20,12 @@ under the opt-in minilm-proof feature and tools/semantic-proof/HISTORICAL.md.
The persistent native helper uses bounded NDJSON over stdin/stdout. It has no
HTTP server or download code. Rust verifies the text model's length and SHA256
before starting it. Setup provisions assets; search never downloads them.
Each request has one 180-second IPC deadline across pipe writing and response
reading. Single-slot queues bound pending work. A stalled write or response
kills/reaps the helper and joins both IPC threads; only transport failures
qualify for a bounded CPU restart. Malformed/oversized responses remain
protocol errors. Cleanup assumes the shipped helper spawns no descendants
holding its pipe handles, matching the native implementation.
Production device mode is auto, with available compiled acceleration and CPU
fallback. Model/context initialization and returned inference/nonfinite-output