I built Semvec: A constant-cost semantic memory for LLMs, looking for testers
I built "Semvec": A Constant-Cost Semantic Memory for LLMs (Looking for testers!)
A developer released Semvec, replacing unbounded chat history with fixed-size semantic state. Its 48-turn benchmark claims about 76% token reduction, with identical input footprint at turn 10 and 10,000. It supports OpenAI-compatible LLMs, MCP, Claude Code, Cursor, and multi-agent shared state.
Why it matters: Swapping chat history for fixed-size semantic vectors cuts token use about 76% and keeps input cost flat as a conversation grows.