Simon Willison releases llm-chat-completions-server plugin to expose local LLM models as an OpenAI-compatible API

llm-chat-completions-server 0.1a0 发布

Simon Willison built a plugin for his LLM tool that starts a local OpenAI Chat Completions-compatible API server. Once running, any model you have installed—including from other plugins—is available at the /v1/chat/completions endpoint. The plugin was built to test LLM 0.32rc1's new content-addressable log schema, which deduplicates repeated message parts so clients can keep sending the full conversation history without unbounded growth. GPT-5.6 Sol wrote the whole thing; Willison notes it knows the OpenAI API shape really well.

Why it matters: Simon Willison released llm-chat-completions-server, a plugin that exposes local LLM collections as an OpenAI-compatible /v1/chat/completions endpoint, built to test LLM 0.32rc1's content-hash log deduplication. Clear tooling innovation with a concrete mechanism, but it's a mi...