Skip to content
r/LocalLLaMA

Update on a 12×32GB SXM V100 Cluster for Local Legal Drafting

Update on 12x32gb sxm v100 cluster / local AI for legal drafting

A lawyer runs a local legal-drafting pipeline across 16 GPUs, with Qwen3.5-122B-A10B reaching about 50 tok/s on four V100s, while a verifier blocks ungrounded citations, dates, and Bates numbers before any final document is used.

Why it matters: A lawyer built a local cluster from 12 V100s with 32GB of VRAM each, running Qwen3.5-122B on 4 cards at roughly 50 tokens/sec to draft legal documents, showing a workable local setup for professional use.

Read the original ↗Export Markdown