- "Whisper server (self-hosted)" transcription provider for OpenAI-compatible Whisper servers (vLLM, speaches, LocalAI) over plain HTTP batch requests, with URL, model, language and key settings (Voice). Pause-ended spans are one request each, finalized in audio order, with provisional text while a span is open. See notes/whisper-server.md. - Transcribe (and other continuous capture) works on iOS with a cloud or Whisper-server provider; push-to-talk shares a running capture. - Transcribe saves each session's audio as transcribe-<time>.wav in Downloads (setting "Save Transcribe audio", on by default), written as it is captured so a crash leaves a playable file; a saved transcript uses the same stamp. - Calculator stops continuous listening when its window closes. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
1.9 KiB
Self-hosted Whisper transcription
The "Whisper server (self-hosted)" transcription provider sends voice audio to
any OpenAI-compatible Whisper server instead of a cloud service: vLLM, speaches
(faster-whisper-server), LocalAI and similar. It uses the batch endpoint
POST {url}/audio/transcriptions with a 16 kHz mono WAV. Push-to-talk
utterances are one request each; in Transcribe, each span ended by a pause is
one request. While a span is open its audio so far is re-sent every 1.5 s, so
text appears while you are still talking.
Server
Any server exposing /v1/models and /v1/audio/transcriptions works, e.g.
vllm serve openai/whisper-large-v3 --port 8004
Settings (Settings > Voice)
- Transcription Provider: Whisper server (self-hosted). Disabled until the URL is set.
- Whisper server URL: the API root, e.g.
http://host:8004/v1. A barehttp://host:8004gets/v1added. - Whisper server model: empty uses the first model the server lists.
- Whisper language: an ISO code such as
en, or empty to auto-detect. A wrong fixed language makes Whisper translate rather than transcribe. - Whisper server key: optional bearer token.
iOS: plain http
iOS App Transport Security blocks plain http:// to IP addresses (including
Tailscale's 100.x addresses) unless the app's Info.plist has an exception for
that host. Either serve the API over https (for example with tailscale serve)
or add your server to NSExceptionDomains in App_Resources/iOS/Info.plist
before building:
<key>192.0.2.10</key>
<dict><key>NSExceptionAllowsInsecureHTTPLoads</key><true/></dict>
Transcribe on iOS
Transcribe needs a cloud or Whisper-server provider on iOS (Apple's recognizer
only handles short utterances). With "Save Transcribe audio" on (Voice
settings), each session's audio is kept as transcribe-<time>.wav in Downloads,
next to transcript-<time>.txt when the text is saved.