Skip to content
r/LocalLLaMA

Tool-Prune: prune 50+ tool schemas to candidates in 0.4ms, save 92% prompt tokens, zero deps

tool-prune: prune 50+ tool schemas down to candidates in 0.4ms (-92% prompt tokens, zero deps)

Tool-Prune is a lightweight utility that prunes 50+ tool schemas down to candidates in 0.4ms, saving 92% of prompt tokens with zero dependencies. The post body is blocked by Reddit, so no details on the pruning algorithm or test setup are disclosed. Useful for reducing input length when attaching many tools to a model.

Read the original ↗Export Markdown