Skip to content
AI HOT (Curated Pool)

Simon Willison releases llm-chat-completions-server plugin to expose local LLM models as an OpenAI-compatible API

llm-chat-completions-server 0.1a0 发布

Simon Willison built a plugin for his LLM tool that starts a local OpenAI Chat Completions-compatible API server. Once running, any model you have installed—including from other plugins—is available at the /v1/chat/completions endpoint. The plugin was built to test LLM 0.32rc1's new content-addressable log schema, which deduplicates repeated message parts so clients can keep sending the full conversation history without unbounded growth. GPT-5.6 Sol wrote the whole thing; Willison notes it knows the OpenAI API shape really well.

Why it matters: Simon Willison released a plugin for the LLM command-line tool that exposes locally installed models as an OpenAI-compatible endpoint any client can call.

Read the original ↗Export Markdown