Audio Pipeline Architecture: STT, TTS and Metrics#
These diagrams describe the implemented Audio integration as of 2026-10-14. They follow the C4 model at System Context, Container and Component levels only. Flow diagrams describe runtime behavior; there is no Code-level diagram.
Scope and Notation#
The system of interest is ViPPET. Browser operators and headless automation use its public API. Audio Analyzer, Text to Speech, Model Download and Metrics Manager are independently deployable supporting software systems, even when installed in the same Docker Compose stack.
A C4 container is an application or data store, not necessarily a Docker container. The browser SPA and its Nginx web server are separate C4 containers; Nginx serves the SPA from the
vippet-uiDocker image.Each Component view zooms into one ViPPET container. Components describe existing responsibilities, not proposed services or new source files.
Relationships in C4 diagrams describe dependencies/calls; response data is summarized in their labels. Flow diagrams show response direction explicitly.
C4 notation is rendered using Mermaid
flowchart: every box identifies its type, technology where relevant, and responsibility. Blue boxes belong to ViPPET; gray boxes are dependencies outside the view’s system/container boundary. Runtime diagrams usesequenceDiagramandflowchart. This avoids the overlapping labels of Mermaid’s experimental native C4 layout.Unrelated video pipelines, LLMs, chat history and kiosk-core are out of scope. STT and TTS are independent conversions, not an automatic chained conversation.
C4 Level 1: System Context#
flowchart TB
operator["Operator<br/>[Person]<br/>Runs Audio pipelines in the browser"]:::person
automation["Automation client<br/>[External software system]<br/>Runs Audio pipelines headlessly"]:::external
vippet["ViPPET<br/>[Software system]<br/>Audio catalog, jobs and metrics"]:::internal
asr["Audio Analyzer<br/>[External software system]<br/>Transcribes recordings"]:::external
tts["Text to Speech<br/>[External software system]<br/>Synthesizes speech"]:::external
models["Model Download<br/>[External software system]<br/>Downloads and exports Voice models"]:::external
telemetry["Metrics Manager<br/>[External software system]<br/>Collects platform telemetry"]:::external
operator -->|Uses web UI| vippet
automation -->|Uses public Audio HTTP API| vippet
vippet -->|Recording to transcript| asr
vippet -->|Text to audio| tts
vippet -->|Requests Voice model installation| models
vippet -->|Subscribes to platform metrics| telemetry
classDef person fill:#08427b,color:#fff,stroke:#052e56
classDef internal fill:#1168bd,color:#fff,stroke:#0b4884
classDef external fill:#666,color:#fff,stroke:#444
The operator uses the ViPPET UI, while automation uses the same ViPPET Audio API without a browser. Direct upstream API access is possible through published service ports, but bypasses the ViPPET proxy and its controls.
C4 Level 2: Containers#
flowchart TB
operator["Operator<br/>[Person]"]:::person
automation["Automation client<br/>[External software system]"]:::external
subgraph vippet[ViPPET - System]
direction TB
spa["Browser UI<br/>[Container: React / TypeScript]<br/>Audio catalog, execution, Jobs, notifications, model installation and metrics"]:::internal
web["UI web server<br/>[Container: Nginx :80]<br/>Serves assets and proxies API / SSE"]:::internal
api["Backend<br/>[Container: FastAPI / Python :7860]<br/>Catalog, process-local jobs and artifacts"]:::internal
spa -->|"Assets, API requests and SSE<br/>HTTP; HTTPS at deployment edge"| web
web -->|"/api/v1/voice/*, /api/v1/jobs/audio/* and model APIs<br/>HTTP :7860"| api
end
asr["Audio Analyzer<br/>[External software system]<br/>Whisper Base / OpenVINO"]:::external
tts["Text to Speech<br/>[External software system]<br/>SpeechT5 / OpenVINO"]:::external
downloader["Model Download<br/>[External software system :8000]<br/>OpenVINO download and export jobs"]:::external
modelstore[("Shared Voice model storage<br/>[External data store]<br/>shared/models/output/voice")]:::external
audiostore[("Managed Audio storage<br/>[External data store]<br/>shared/audio input and output")]:::external
telemetry["Metrics Manager<br/>[External software system]<br/>SSE, Telegraf and hardware collectors"]:::external
operator -->|Browser interaction| spa
automation -->|"Catalog and managed jobs<br/>HTTP JSON / multipart"| web
api -->|"POST /v1/audio/transcriptions<br/>HTTP multipart :8010; JSON response"| asr
api -->|"POST /v1/audio/speech<br/>HTTP JSON :8011; WAV response"| tts
api -->|"Start and poll model jobs<br/>HTTP JSON :8000"| downloader
api -->|"Reads catalog and installed state"| modelstore
api -->|"Reads registered STT input; atomically writes and serves TTS WAV"| audiostore
downloader -->|"Writes exported OpenVINO artifacts"| modelstore
asr -->|"Loads Whisper artifacts read-only"| modelstore
tts -->|"Loads SpeechT5 artifacts read-only"| modelstore
web -->|"GET /metrics/stream<br/>HTTP / SSE :9090"| telemetry
classDef person fill:#08427b,color:#fff,stroke:#052e56
classDef internal fill:#1168bd,color:#fff,stroke:#0b4884
classDef external fill:#666,color:#fff,stroke:#444
Nginx streams Voice request bodies without imposing a separate upload-size limit and disables response caching. The backend preserves upload metadata and streams the spooled file to Audio Analyzer, which owns input validation. The backend retains response-size and deadline limits. It forwards only known file-validation messages from bounded Audio Analyzer error responses; all other upstream details remain hidden. Environment HTTP proxy settings are not used for these calls.
Deployment and Storage Boundaries#
The current Compose file publishes
8010:8010and8011:8011without a loopback host address. Network reachability depends on the host/firewall; these bindings are not restricted to localhost by this configuration. Protect direct access with deployment-level access control and TLS.The Models page starts ViPPET background jobs for Whisper Base and SpeechT5.
ModelManagerforwards their OpenVINO requests to Model Download, polls the returned job and tracks installed state. SpeechT5 installs one FP16 artifact.Model Download exports device-neutral OpenVINO artifacts on CPU under
shared/models/output/voice. Audio Analyzer and Text to Speech mount the shared model tree read-only and compile the selected artifact for the runtime device when they load it.ASR keeps runtime cache, chunks and storage in
voice_asr_cache,voice_asr_chunksandvoice_asr_storage. Recordings/transcripts can persist in its storage volume; clear-on-startup is enabled, not a per-request retention guarantee. Exit-time chunk cleanup is disabled because the chunks path is a volume mount; failed or interrupted runs can therefore leave chunks behind. TTS keeps runtime cache and storage invoice_tts_cacheandvoice_tts_storage, butPERSIST_OUTPUTS=falsedisables output persistence.ViPPET stores the registered STT recordings and every completed managed TTS job artifact in the mounted
shared/audiotree. TTS runs use UUID-named files undershared/audio/output. Audio job metadata and STT transcripts are process-local. Uploaded or recorded managed STT input is copied to a UUID-named file in a private manager-owned temporary directory and removed after success, failure, cancellation, registration failure, or shutdown.make cleanremoves generated TTS artifacts but preserves only the managed default STT input. Browser results and per-conversion timings remain in React state; blob URLs are revoked during cleanup.Clients use the ViPPET API through Nginx. Run requests return
202, then clients poll process-local job state.Hardware overrides determine the default service devices and which device nodes are mounted. Each Audio variant selects among compatible, visible devices. Telemetry reflects the whole host and can include unrelated workloads on those devices.
C4 Level 3: Browser UI Components#
flowchart TB
web["UI web server<br/>[Container: Nginx]<br/>Voice API and SSE proxy"]:::external
subgraph spa[Browser UI - Container]
direction TB
catalog["PipelineCards<br/>[Component: React]<br/>Shared cards in the Audio tab of Pipelines"]:::internal
voice["VoiceConversion<br/>[Component: React]<br/>Route-selected STT or TTS workflow"]:::internal
variant["PipelineVariantSelect<br/>[Component: React]<br/>Route-backed Audio device variant selection"]:::internal
recorder["Recording adapter<br/>[Component: Web Audio]<br/>captureWav prepares local PCM WAV"]:::internal
audio["VoiceAudio<br/>[Component: Web Audio / Recharts]<br/>Waveform and native audio playback"]:::internal
timings["VoiceMetrics<br/>[Component: React]<br/>Request and service round-trip timings"]:::internal
jobs["Jobs / Audio tab<br/>[Component: React / RTK Query]<br/>Oldest-first Audio job list polled every 2 seconds"]:::internal
detail["AudioJobDetail<br/>[Component: React / RTK Query]<br/>Polls status and displays transcript or WAV link"]:::internal
notifications["Toaster / shared toast<br/>[Component: Sonner]<br/>Audio run lifecycle notifications"]:::internal
stream["MetricsProvider / useMetricsStream<br/>[Component: EventSource]<br/>Shared SSE subscription and reconnect"]:::internal
store["Metrics state<br/>[Component: Redux Toolkit]<br/>Current samples and connection state"]:::internal
dashboard["MetricsDashboard<br/>[Component: React / Recharts]<br/>useMetrics and useMetricHistory"]:::internal
cards["MetricCard<br/>[Component: React]<br/>Shared numeric presentation"]:::internal
voice -->|"Uploaded or recorded STT<br/>Async capture and AbortSignal"| recorder
voice -->|Renders selected route variant| variant
variant -->|Updates route parameters| voice
voice -->|Blob URL props| audio
voice -->|Timing props| timings
voice -->|Lifecycle events| notifications
voice -->|Always mounts below VoiceMetrics in right rail; no video metrics| dashboard
jobs -->|Opens selected Audio job| detail
stream -->|Dispatches Redux actions| store
dashboard -->|Reads Redux selectors| store
dashboard -->|Renders platform values| cards
end
catalog -->|"GET /api/v1/voice/pipelines"| web
catalog -->|"Opens first variant"| voice
voice -->|"All STT: start and poll managed job; JSON recording or multipart file"| web
voice -->|"All TTS: start job with input/voice, poll and fetch artifact"| web
jobs -->|"GET /api/v1/jobs/audio/status"| web
detail -->|"GET /api/v1/jobs/audio/{job_id}/status until terminal"| web
stream -->|"SSE subscription"| web
classDef internal fill:#1168bd,color:#fff,stroke:#0b4884
classDef external fill:#666,color:#fff,stroke:#444
The route selects one STT or TTS pipeline view; there are no operation tabs.
STT sends a selected predefined recording as JSON, or an uploaded or recorded
file as multipart, to the managed run endpoint. Every UI STT and TTS
conversion uses a managed job polled through
GET /api/v1/jobs/audio/{job_id}/status; TTS retrieves its persisted artifact
after completion.
The Audio tab on the shared Jobs page polls oldest-first operational summaries.
Its detail view polls until COMPLETED or FAILED, then displays
the transcript or managed WAV link when available. VoiceConversion publishes
lifecycle notifications through the application-level Sonner toaster. These
notifications complement, rather than replace, inline errors and result panels.
VoiceMetrics does not read global service /v1/performance values. On desktop,
it and the always-visible platform MetricsDashboard share the right-hand rail;
on smaller viewports, that rail stacks below the active Voice workflow.
MetricsProvider is mounted at application level, so the dashboard does not
create another SSE subscription. The dashboard’s local history is created on
mount and discarded on unmount; its hook keeps a 60-second window with updates
no more often than once per second.
C4 Level 3: Backend Components#
flowchart TB
web["UI web server<br/>[Container: Nginx]<br/>Forwards Voice HTTP requests"]:::external
automation["Automation client<br/>[External software system]<br/>Uses the public ViPPET API"]:::external
subgraph api[Backend - Container]
direction TB
voiceroutes["Voice pipeline routes<br/>[Component: FastAPI / Pydantic]<br/>Catalog, recordings, 202 starts and artifact response"]:::internal
jobsroutes["Audio Jobs routes<br/>[Component: FastAPI / Pydantic]<br/>List, status and stop for Audio jobs"]:::internal
audiodependency["Audio job dependency<br/>[Component: FastAPI dependency]<br/>Provides the shared manager instance"]:::internal
conversion["Voice conversion execution<br/>[Component: Python / wave]<br/>Validation, upstream calls and request timing"]:::internal
adapter["Upstream service adapter<br/>[Component: httpx / asyncio / perf_counter]<br/>Bounded reads, errors, timeout, cleanup and timing"]:::internal
assets["AudioAssetsManager<br/>[Component: Python / YAML / wave]<br/>Local recordings and managed paths"]:::internal
audiocatalog["AudioPipelineManager<br/>[Component: Python / YAML]<br/>Strict preset definitions"]:::internal
audiojobs["AudioPipelineJobManager<br/>[Component: asyncio]<br/>Locked process-local state, private STT staging, retention and atomic TTS artifacts"]:::internal
modelapi["Model routes / ModelManager<br/>[Component: FastAPI / Python]<br/>Catalog, background jobs and installed state"]:::internal
catalog["Voice model catalog<br/>[Component: DB-backed models / model_variants]<br/>Seeded from vippet/models/*.yaml; requests, variants and install state"]:::internal
voiceroutes -->|"Start with JSON recording, JSON TTS, or multipart STT"| audiodependency
voiceroutes -->|Read artifact metadata| audiodependency
jobsroutes -->|Read snapshots and cancel| audiodependency
audiodependency -->|Shared instance| audiojobs
audiojobs -->|Execute managed STT or TTS| conversion
conversion -->|Async call, bounded response| adapter
voiceroutes -->|Lists pipeline definitions| audiocatalog
audiojobs -->|Resolves pipeline and variant| audiocatalog
audiojobs -->|Reads registered STT WAV; publishes TTS WAV| assets
modelapi -->|Reads download requests and required variants| catalog
modelapi -->|Persists variant and aggregate install state| catalog
end
asr["Audio Analyzer<br/>[External software system]<br/>Transcription service :8010"]:::external
tts["Text to Speech<br/>[External software system]<br/>Synthesis service :8011"]:::external
downloader["Model Download<br/>[External software system]<br/>OpenVINO plugin :8000"]:::external
modelstore[("Shared Voice model storage<br/>[External data store]<br/>OpenVINO artifacts")]:::external
audiostore[("Managed Audio storage<br/>[External data store]<br/>Registered STT input and UUID TTS output")]:::external
web -->|"Catalog, managed starts and artifact"| voiceroutes
web -->|"/api/v1/jobs/audio/*"| jobsroutes
automation -->|"Managed jobs"| web
web -->|"Model list, install and job status<br/>HTTP JSON"| modelapi
adapter -->|"POST /v1/audio/transcriptions<br/>HTTP multipart; JSON response"| asr
adapter -->|"POST /v1/audio/speech<br/>HTTP JSON; WAV response"| tts
assets -->|"Managed input read and atomic output write"| audiostore
voiceroutes -->|"Completed TTS FileResponse"| audiostore
modelapi -->|"POST downloads; poll jobs"| downloader
modelapi -->|"Checks required artifacts"| modelstore
downloader -->|"Exports into voice target path"| modelstore
asr -->|"Loads model read-only"| modelstore
tts -->|"Loads model read-only"| modelstore
classDef internal fill:#1168bd,color:#fff,stroke:#0b4884
classDef external fill:#666,color:#fff,stroke:#444
The Voice routes, conversion execution and upstream adapter reside in the Voice
router module. The Jobs router lists, reads and stops jobs through the same
AudioPipelineJobManager provided by dependency injection; neither router
imports the other.
AudioPipelineJobManager, AudioPipelineManager and AudioAssetsManager are
separate Python components in the same backend process.
The job manager guards its job and task maps with an asyncio.Lock. It returns
list snapshots oldest first by creation time and retains every active job plus
at most 500 terminal jobs. Evicting an older terminal TTS job removes its
managed artifact. Uploaded audio is first copied to a UUID-named file in a
manager-owned temporary directory and deleted on every exit path, then opened
for the validated conversion path. Predefined-recording STT opens the
registered WAV; TTS atomically publishes a UUID-named artifact.
Jobs expose service timing in service_round_trip_ms.
Model routes and ModelManager remain separate from the Voice router but run
in the same backend container.
Flow: Install Voice Models#
sequenceDiagram
autonumber
actor Operator
participant UI as Models page / browser
participant Web as Nginx
participant API as ViPPET ModelManager
participant Catalog as Models DB
participant Download as Model Download
participant Store as shared/models/output/voice
participant Service as Audio Analyzer or Text to Speech
Operator->>UI: Install Whisper Base or SpeechT5
UI->>Web: POST /api/v1/models/download
Web->>API: Forward model names
API->>Catalog: Resolve requests, variants and current install state
API-->>Web: 202 Accepted with ViPPET job ID
Web-->>UI: Forward response
API->>Download: POST /api/v1/models/download?download_path=voice
Note over API,Download: Each catalog model starts one OpenVINO export
Download->>Store: Stage and publish complete OpenVINO artifacts
loop Until the external job completes or fails
API->>Download: GET /api/v1/jobs/{job_id}
Download-->>API: Processing, completed or failed
UI->>Web: Poll ViPPET model job status
Web->>API: Forward status request
API-->>Web: Download progress
Web-->>UI: Forward status response
end
API->>Store: Verify required artifacts
API->>Catalog: Persist variant and install state
Note over API,Catalog: SpeechT5 is Installed when its FP16 artifact is complete
Note over Service,Store: Voice services must start after installation
Service->>Store: Load the selected artifact read-only
Service->>Service: Compile for configured or per-request device
Voice services do not download models during startup. They preload models, so starting them before installation makes their health checks fail until the required artifacts exist and the services restart. Model Download stages exports before publishing complete artifacts; subsequent starts reuse them.
Flow: Managed Speech to Text#
sequenceDiagram
autonumber
actor Client as Browser UI or headless client
participant Web as Nginx
participant API as Audio pipeline routes
participant Jobs as AudioPipelineJobManager
participant Assets as AudioAssetsManager
participant ASR as Audio Analyzer
alt Predefined recording
Client->>Web: POST .../speech-to-text/variants/{variant}/runs with JSON recording and language
Web->>API: Forward JSON request
API->>Jobs: start_job(pipeline, variant, recording)
else Uploaded or recorded input
Client->>Web: POST .../speech-to-text/variants/{variant}/runs with file and language
Web->>API: Stream multipart request without a separate size limit
API->>Jobs: Stage random temporary file and start_job(pipeline, variant, input)
end
Jobs-->>API: RUNNING job with UUID
API-->>Web: 202 Accepted with job_id
Web-->>Client: Forward start response
Jobs->>Jobs: Set RUNNING in process-local state
alt Predefined recording
Jobs->>Assets: Resolve registered WAV
Assets-->>Jobs: Validated local path
else Staged input
Jobs->>Jobs: Open manager-owned temporary input
end
Jobs->>ASR: POST /v1/audio/transcriptions with WAV, language and device
ASR-->>Jobs: Transcription JSON
Jobs->>Jobs: Store transcript and timing; set COMPLETED; delete staged input
loop Until COMPLETED or FAILED
Client->>Web: GET /api/v1/jobs/audio/{job_id}/status
Web->>API: Forward status request
API->>Jobs: Read process-local job
Jobs-->>API: State, transcript and service timing
API-->>Web: Job JSON
Web-->>Client: Job JSON
end
Managed STT accepts either a JSON body with a registered recording and a
two-letter language, or multipart file and language fields for uploaded
and recorded audio. The route stages multipart input before returning 202; the
job owns and deletes that temporary input on every terminal path and shutdown.
The completed transcript and job metadata are process-local and disappear when
the backend restarts; no STT artifact is created.
Flow: Managed Text to Speech#
sequenceDiagram
autonumber
actor Client as Browser UI or headless client
participant Web as Nginx
participant API as Audio pipeline routes
participant Jobs as AudioPipelineJobManager
participant TTS as Text to Speech
participant Store as shared/audio/output
Client->>Web: POST .../text-to-speech/variants/{variant}/runs with input and voice
Web->>API: Forward request
API->>API: Validate 1-200 characters and supported voice
API->>Jobs: start_job(pipeline, variant, input, voice)
Jobs-->>API: RUNNING job with UUID
API-->>Web: 202 Accepted with job_id
Web-->>Client: Forward start response
Jobs->>Jobs: Set RUNNING
Jobs->>TTS: POST /v1/audio/speech with text, voice and device
TTS-->>Jobs: WAV body
Jobs->>Store: Write temporary file and atomically publish {job_id}.wav
Jobs->>Jobs: Store artifact path and timing; set COMPLETED
loop Until COMPLETED or FAILED
Client->>Web: GET /api/v1/jobs/audio/{job_id}/status
Web->>API: Forward status request
API-->>Web: Job JSON with artifact_url when complete
Web-->>Client: Job JSON
end
Client->>Web: GET /api/v1/voice/jobs/{job_id}/artifact
Web->>API: Forward artifact request
API->>Store: Open completed job artifact
Store-->>API: UUID WAV
API-->>Web: audio/wav + Cache-Control no-store
Web-->>Client: WAV artifact
Every TTS conversion started by the Audio pipeline UI follows this managed path. The browser creates a blob URL only after downloading the persisted artifact, then uses it for playback and download. Artifact retrieval, waveform decoding and playback are excluded from the displayed managed request duration. The proxy buffers the complete upstream body; TTS is not streaming playback or a time-to-first-byte measurement.
Flow: Conversion Timings and Telemetry#
flowchart TB
subgraph request[Per-conversion timings]
direction TB
BrowserStart[Browser performance.now before first fetch] --> HTTP[Voice run request through Nginx and backend]
HTTP --> ServiceStart[Backend perf_counter before upstream context entry]
ServiceStart --> ServiceBody[Connect, upload, queue, process and receive complete body]
ServiceBody --> ServiceMs[Calculate elapsed milliseconds]
ServiceMs --> Valid{Successful payload validation?}
Valid -->|Yes| JobField[service_round_trip_ms in completed job]
Valid -->|No| NoMetric[Job FAILED; panel enters failed state]
JobField --> Parsed[Browser reads completed job status]
Parsed --> RequestMs[Browser elapsed milliseconds]
RequestMs --> Panel[Persistent Voice performance panel]
JobField --> TimingCheck{Timing present?}
TimingCheck -->|Yes| Panel
TimingCheck -->|Missing| Unavailable[Show -- for service round trip]
Unavailable --> Panel
end
subgraph platform[Continuous host-wide telemetry]
direction TB
Host[CPU, memory, GPU and NPU] --> Collectors[Telegraf and hardware collectors inside Metrics Manager]
Collectors --> Manager[Metrics Manager]
Manager --> Proxy[Nginx proxies SSE /metrics/stream]
Proxy --> Stream[MetricsProvider / useMetricsStream EventSource]
Stream --> Redux[Redux latest metric samples]
Redux --> Dashboard[MetricsDashboard with useMetrics and local useMetricHistory]
Dashboard --> Charts[Platform metrics section; no video FPS or pipeline latency]
end
Request duration: browser first-fetch start through the completed managed job status, including polling. TTS artifact retrieval occurs after this interval. The value remains browser-local.
Service round trip: backend adapter start through complete upstream body reception and local response construction; excludes browser transfer and subsequent route payload validation/context cleanup. Includes transport, queueing and service processing, not only model inference.
The intervals use independent monotonic clocks. No cross-machine timestamp subtraction or global last-request variable is needed.
The Voice performance panel shows only the request-scoped timings returned in the completed job.
Platform charts are live system-wide telemetry, not a frozen snapshot of a conversion and not resource attribution to a particular STT/TTS request.
Voice does not query the services’ global
last_msor/v1/model-infoand does not report model inference time, chunk or segment counts, effective device, end-to-end conversational latency or time to first audio.
Flow: Errors and Cancellation#
flowchart TD
Start[Start independent conversion; clear its previous result and timings] --> Active{Outcome}
Active -->|202 with valid job_id| Accepted[Own accepted job and show run started]
Accepted --> Poll[Poll Audio job status]
Poll -->|COMPLETED without transcript or artifact| Cancelled[Show run cancelled notification]
Poll -->|COMPLETED and still current| Apply[Apply transcript or download and apply TTS artifact]
Apply --> Complete[Show run completed notification]
Poll -->|FAILED or request failure| UIError[Display safe inline error and persistent failure notification]
Active -->|Input validation or start failure| UIError
Active -->|Local recording or capture error| LocalError[Display safe inline error; no job notification]
Active -->|Stop button| StopJob{Job already accepted?}
StopJob -->|Yes| StopApi[DELETE /api/v1/jobs/audio/job_id cancels the backend task]
StopApi --> Poll
StopJob -->|No| Discard[AbortController discards pre-acceptance work]
Active -->|Microphone Cancel| Abort[AbortController stops local recording]
Active -->|Start replacement| Supersede[Abort and silently discard superseded response]
Active -->|Navigate away| Unmount[Abort and silently discard on unmount]
Active -->|1210-second browser deadline| Deadline[Abort with timeout message]
Deadline --> UIError
Active -->|Backend or proxy failure| Status{Failure class}
Status -->|Invalid input| Input[400 or 422; oversized input 413]
Status -->|Upstream 400 / 413 / 422| Rejected[400 sanitized rejection]
Status -->|Upstream 429 or HTTP transport error| Unavailable[503 busy or unavailable]
Status -->|20-minute upstream deadline or httpx timeout| Timeout[504 timeout]
Status -->|Other upstream status, invalid payload or response too large| BadGateway[502 sanitized service failure]
Input --> UIError
Rejected --> UIError
Unavailable --> UIError
Timeout --> UIError
BadGateway --> UIError
Stop on an accepted job cancels the managed backend task through
AudioPipelineJobManager.cancel_job: the job moves to COMPLETED without a
result (or to FAILED when cancelling raises an error), the in-flight
request to the upstream service is cancelled, and staged input and any
uncommitted artifact are removed. It cannot guarantee that an already-started
upstream inference stops. Navigating away does not cancel a managed job, which
can still finish and persist its WAV. Backend contexts
close resources on return or exceptions; their total upstream deadline is 20
minutes, with a 5-second connection timeout. The browser and Nginx Voice
read/send timeouts are 1210 seconds, allowing ten seconds beyond the backend
deadline. Proxy-generated failures may differ from the backend’s status mapping
above.
Implementation References#
Voice workflow, pipeline variant selector, recording adapter, audio preview and performance panel.
Jobs page, Audio job detail, application layout and toaster, Voice API and upstream adapter, Jobs API adapter and Audio job dependency.
Audio pipeline manager, job manager and managed Audio assets.
Models page, model installation hook, model routes, model manager, Whisper catalog entry, SpeechT5 catalog entry and catalog DB seeding.
Nginx routing, Compose configuration and system telemetry architecture.