Skip to content
r/LocalLLaMA

21 GPUs benchmarked running a small TTS model, with 5GB peak VRAM

21 GPU's benchmarked running a small TTS model (vram peak: 5GB)

A Reddit user rented 21 GPUs on vast.ai to benchmark OmniVoice, a small TTS model with about 5GB peak VRAM, using xRT as the audio generation speed metric and averaging 3 voice-cloning runs with reference audio.

Why it matters: A Reddit user benchmarked 21 rented GPUs on a small voice-cloning TTS model, averaging three runs per card, as a buying reference for anyone building speech synthesis.

Read the original ↗Export Markdown