Skip to content
r/LocalLLaMA

Using llama.cpp native tools for web RAG inside llama-server WebUI

How I do use the recent llama.cpp native tools to do web rag a.k.a. web_fetch (or anything else for the matter) directly from inside the llama-server's webui

A Reddit user describes using llama.cpp native tools for web RAG inside llama-server WebUI with a 7-step setup: enable get_datetime and exec_shell_command, then run wget through firejail, a separate Linux user, and an Alpine OCI VM sandbox.

Why it matters: A Reddit user laid out the exact steps for calling llama.cpp's native tools from inside llama-server's built-in web UI to do web retrieval, a reusable path for giving local models live data.

Read the original ↗Export Markdown