Deployment
Phala TEE CVMs, images, the TLS-passthrough ingress, and the deploy flow.
Production runs on Phala dstack TEE (Intel TDX). The authoritative, always-current reference is
DEPLOYMENT-GUIDE.md in the monorepo — this page is the orientation; go there for exact ids, tokens,
and rebuild recipes.
Golden rule. Never re-provision a CVM — it wipes the sealed volume. Always deploy in
place with phala deploy --cvm-id <vm_uuid>.
Topology
| Component | Where | Ports / URL |
|---|---|---|
Conclave CVM (conclave) | Phala CVM | :8000 API · :8087 diart WS · :443 ingress. Co-locates conclave-api + Redis + capture-diart + capture-ingress |
FPM / VFTE CVM (fpm-backend) | Phala CVM | :8085 (reached only by Conclave) |
| DiariZen GPU worker | External GPU box (RTX 3090) | Dials out to Conclave /api/diarize/jobs/claim over cloudflared |
| Conclave dashboard | Vercel (Root Dir frontend) | *.vercel.app |
| FPM consent dashboard | Vercel | vftee.vercel.app |
| Auth | Supabase | verifies "Connect to Conclave" JWTs |
In-person WS routing (Option A)
Long-lived recording WebSockets were dying at the Phala gateway (~2–4 min). The cure:
browser ──wss://capture.conclavehq.org──▶ Phala gateway (raw SNI TLS-passthrough)
──▶ in-CVM HAProxy (dstack-ingress) terminates LE cert, TIMEOUT_CLIENT/SERVER=3600s
──▶ capture-diartImages & deploy flow
- Docker Hub:
prakharojha/conclave,prakharojha/capture-diarize-diart,prakharojha/fpm-backend. Build--platform linux/amd64. - Deploy:
edit deploy-tonight.env → scripts/stage-deploy.sh → build + push image (bump the LITERAL tag) → phala deploy --cvm-id → warm diart → smoke test. Alembic auto-applies on boot. IN_TEE=truein prod (real TDX quotes via/var/run/dstack.sock);falselocally.
Sizing
DiariZen ≈ 885 MB VRAM at batch=1 (flat across clip length) + 4–8 GB RAM; ~15 concurrent workers per GPU. diart ≈ 1 GB RAM on CPU. DiariZen weights are CC-BY-NC — must be swapped before commercial use.
Read Gotchas before touching prod. Full deploy status and the current hardening pass: Status and P0: diarization.
Source: DEPLOYMENT-GUIDE.md, BUILD-LOG-diarization-deployment.md.