Skip to content
r/LocalLLaMA

I turned an Android phone into a Vulkan-accelerated local LLM node

I turned an Android phone into a Vulkan-accelerated local LLM node (GGUF + LiteLLM + Tailscale)

Reddit user GsxrGuy80s configured a Z Fold 6 as a GGUF inference node using Vulkan, LiteLLM, and Tailscale; the post discloses gpu_layers=89, an OpenAI-compatible endpoint, and fallback routing to larger local nodes.

Why it matters: A Reddit user turned a Z Fold 6 into a GGUF inference node with Vulkan acceleration and published the gpu_layers=89 setting, showing a concrete config path for running local models on a phone GPU.

Read the original ↗Export Markdown