Mintlify uses ChromaFs to make AI document retrieval look like a file system

文档平台 Mintlify 发了一篇工程博客，讲了一件挺有意思的事：他们给自家 AI 文档助手造了一套假的文件系统，叫 ChromaFs，让 AI 以为自己在用 grep、cat、ls…

Mintlify routes its AI doc assistant’s grep, cat, and ls calls through ChromaFs into database queries, cutting session startup from 46s to 100ms and pushing marginal compute cost per chat near zero. Built on Vercel Labs’ just-bash, it maps pages to files and sections to directories; at 850,000 chats per month, replacing real sandboxes saves over $70,000 a year in compute. The real shift is retrieval design: not faster vector RAG, but model-led exploration of structured docs, and the post says this may not fit messy knowledge bases.

Why it matters: This is a substantive engineering write-up, not a routine product note. HKR-H/K/R all pass: the fake-filesystem angle is novel, the post includes hard numbers (46s→100ms, 850k chats/month, >$70k/yr), and it hits operator concerns around latency, cost, and retrieval design; strong