Skip to content
r/LocalLLaMA

Using llama.cpp native tools for web RAG inside llama-server WebUI

How I do use the recent llama.cpp native tools to do web rag a.k.a. web_fetch (or anything else for the matter) directly from inside the llama-server's webui

A Reddit user describes using llama.cpp native tools for web RAG inside llama-server WebUI with a 7-step setup: enable get_datetime and exec_shell_command, then run wget through firejail, a separate Linux user, and an Alpine OCI VM sandbox.

Why it matters: HKR-H/K/R all pass: the post gives a concrete local web-RAG recipe with sandboxing. It is a community tutorial, not a model or product launch, so the narrow reach and source authority keep it at the low featured band.

Read the original ↗Export Markdown