Teknium
4350668ae4
fix(transcription): fall back to CPU when CUDA runtime libs are missing
...
faster-whisper's device="auto" picks CUDA when ctranslate2's wheel
ships CUDA shared libs, even on hosts without the NVIDIA runtime
(libcublas.so.12 / libcudnn*). On those hosts the model often loads
fine but transcribe() fails at first dlopen, and the broken model
stays cached in the module-global — every subsequent voice message
in the gateway process fails identically until restart.
- Add _load_local_whisper_model() wrapper: try auto, catch missing-lib
errors, retry on device=cpu compute_type=int8.
- Wrap transcribe() with the same fallback: evict cached model, reload
on CPU, retry once. Required because the dlopen failure only surfaces
at first kernel launch, not at model construction.
- Narrow marker list (libcublas, libcudnn, libcudart, 'cannot be loaded',
'no kernel image is available', 'no CUDA-capable device', driver
mismatch). Deliberately excludes 'CUDA out of memory' and similar —
those are real runtime failures that should surface, not be silently
retried on CPU.
- Tests for load-time fallback, runtime fallback (with cached-model
eviction verified), and the OOM non-fallback path.
Reported via Telegram voice-message dumps on WSL2 hosts where libcublas
isn't installed by default.
2026-04-24 02:50:14 -07:00
..
2026-02-26 03:20:08 +03:00
2026-04-17 15:53:57 -07:00
2026-03-23 07:43:12 -07:00
2026-04-16 14:48:50 -07:00
2026-04-23 14:05:36 -07:00
2026-04-08 17:23:15 -07:00
2026-04-16 04:07:11 -07:00
2026-04-20 23:20:33 -07:00
2026-04-20 00:32:09 -07:00
2026-04-17 16:05:04 -07:00
2026-04-19 00:03:10 -07:00
2026-04-08 13:44:58 -07:00
2026-04-16 04:19:34 -07:00
2026-04-20 00:32:09 -07:00
2026-03-28 17:25:04 -07:00
2026-04-10 13:05:44 -07:00
2026-04-14 16:55:55 -07:00
2026-04-17 18:46:30 -07:00
2026-04-01 12:03:56 -07:00
2026-03-31 10:40:13 -07:00
2026-04-23 22:23:37 -07:00
2026-04-11 02:58:48 -07:00
2026-04-16 16:06:49 -07:00
2026-02-27 03:29:26 -05:00
2026-04-11 13:14:32 -05:00
2026-04-18 01:46:25 -07:00
2026-04-16 06:42:45 -07:00
2026-04-10 03:44:43 -07:00
2026-03-27 04:03:00 -07:00
2026-04-10 03:44:43 -07:00
2026-04-18 19:24:35 -07:00
2026-02-26 13:55:54 +03:00
2026-04-19 05:19:22 -07:00
2026-04-08 17:23:15 -07:00
2026-03-02 04:34:21 -08:00
2026-03-26 14:50:26 -07:00
2026-04-23 13:56:26 -07:00
2026-04-19 19:18:19 -07:00
2026-04-22 18:13:14 -07:00
2026-04-14 21:20:37 -07:00
2026-04-21 06:14:25 -07:00
2026-04-17 19:04:11 -07:00
2026-04-22 06:11:41 -07:00
2026-04-22 06:11:41 -07:00
2026-04-17 19:26:40 -07:00
2026-04-13 16:32:04 -07:00
2026-04-23 15:11:52 -07:00
2026-04-21 16:41:26 -07:00
2026-04-16 19:39:21 -07:00
2026-04-10 03:01:46 -07:00
2026-04-10 21:14:32 -07:00
2026-04-20 00:58:16 -07:00
2026-04-08 17:23:15 -07:00
2026-04-22 06:11:41 -07:00
2026-04-13 05:15:05 -07:00
2026-03-14 11:27:02 -07:00
2026-04-21 02:03:46 -07:00
2026-03-04 18:34:16 +03:00
2026-04-13 04:45:07 -07:00
2026-04-21 02:04:21 -07:00
2026-04-23 03:01:18 -07:00
2026-04-21 13:35:31 -07:00
2026-04-14 02:18:38 -07:00
2026-03-27 15:28:19 -07:00
2026-04-19 11:27:50 -07:00
2026-04-17 13:47:46 -07:00
2026-04-17 20:39:25 -07:00
2026-04-23 05:15:37 -07:00
2026-04-09 16:24:53 -07:00
2026-04-16 12:36:49 -07:00
2026-04-16 12:36:49 -07:00
2026-04-15 13:29:05 -07:00
2026-04-09 13:17:06 -07:00
2026-04-16 12:36:49 -07:00
2026-04-21 05:19:03 -07:00
2026-04-14 17:19:20 -07:00
2026-04-19 16:31:07 -07:00
2026-04-19 16:31:07 -07:00
2026-04-16 21:57:10 -07:00
2026-04-16 21:57:10 -07:00
2026-04-16 21:57:10 -07:00
2026-04-04 10:18:57 -07:00
2026-04-16 21:57:10 -07:00
2026-04-23 15:11:47 -07:00
2026-04-10 03:44:35 -07:00
2026-04-16 21:57:10 -07:00
2026-04-04 10:18:57 -07:00
2026-04-23 22:01:24 -07:00
2026-04-14 10:18:05 -07:00
2026-04-13 16:32:04 -07:00
2026-04-23 15:14:11 -07:00
2026-04-12 06:18:05 +05:30
2026-04-08 17:23:15 -07:00
2026-04-10 03:01:46 -07:00
2026-04-12 00:36:22 -07:00
2026-04-05 12:46:07 -07:00
2026-04-22 14:45:50 -07:00
2026-04-10 16:47:44 -07:00
2026-04-11 13:46:16 -07:00
2026-04-13 16:32:04 -07:00
2026-04-19 12:39:58 -07:00
2026-04-23 15:11:52 -07:00
2026-03-10 17:09:51 -07:00
2026-04-24 02:44:46 -07:00
2026-03-17 02:02:57 -07:00
2026-04-15 17:37:43 -07:00
2026-04-20 03:02:44 -07:00
2026-04-20 00:47:39 -07:00
2026-04-20 13:24:15 -07:00
2026-03-16 19:01:39 +03:00
2026-04-10 03:44:43 -07:00
2026-04-01 04:19:19 -07:00
2026-04-23 06:20:47 -07:00
2026-04-01 04:19:19 -07:00
2026-03-04 05:30:43 -08:00
2026-03-02 02:00:09 -08:00
2026-04-23 06:20:47 -07:00
2026-03-14 23:15:04 -07:00
2026-04-10 03:44:43 -07:00
2026-04-23 05:09:08 -07:00
2026-04-23 14:05:47 -07:00
2026-04-12 06:18:05 +05:30
2026-04-20 03:07:32 -07:00
2026-03-04 17:23:23 +03:00
2026-04-16 19:39:21 -07:00
2026-04-19 16:53:11 -07:00
2026-04-04 16:57:24 -07:00
2026-04-19 16:47:20 -07:00
2026-04-08 21:37:51 -07:00
2026-04-20 23:20:33 -07:00
2026-04-16 12:36:49 -07:00
2026-03-29 21:51:44 -07:00
2026-04-09 16:24:53 -07:00
2026-04-16 12:36:49 -07:00
2026-04-15 15:06:51 -07:00
2026-04-08 17:23:15 -07:00
2026-03-16 23:39:41 -07:00
2026-04-11 16:22:50 -07:00
2026-04-16 12:36:49 -07:00
2026-04-07 17:19:07 -07:00
2026-04-23 21:51:19 -07:00
2026-04-11 14:26:11 -07:00
2026-04-24 02:50:14 -07:00
2026-04-20 05:18:48 -07:00
2026-04-16 14:23:16 -07:00
2026-04-21 01:28:32 -07:00
2026-04-21 17:49:39 -07:00
2026-04-19 19:38:02 -07:00
2026-04-12 16:46:18 -07:00
2026-04-22 14:38:59 -07:00
2026-04-20 00:32:09 -07:00
2026-04-21 00:29:29 -07:00
2026-04-09 16:24:53 -07:00
2026-04-15 11:16:01 -07:00
2026-04-17 01:05:09 -07:00
2026-04-09 13:17:06 -07:00
2026-03-30 08:10:14 -07:00
2026-03-01 01:54:27 +03:00
2026-02-26 13:30:55 +03:00
2026-04-10 03:38:44 -07:00
2026-04-13 10:50:24 -07:00