Skip to content
X · @dotey

Mintlify uses ChromaFs to make AI document retrieval look like a file system

文档平台 Mintlify 发了一篇工程博客,讲了一件挺有意思的事:他们给自家 AI 文档助手造了一套假的文件系统,叫 ChromaFs,让 AI 以为自己在用 grep、cat、ls…

Mintlify routes its AI doc assistant’s grep, cat, and ls calls through ChromaFs into database queries, cutting session startup from 46s to 100ms and pushing marginal compute cost per chat near zero. Built on Vercel Labs’ just-bash, it maps pages to files and sections to directories; at 850,000 chats per month, replacing real sandboxes saves over $70,000 a year in compute. The real shift is retrieval design: not faster vector RAG, but model-led exploration of structured docs, and the post says this may not fit messy knowledge bases.

Why it matters: Mintlify replaced vector RAG in its AI docs assistant with a fake filesystem that simulates grep, cat and ls through database queries, cutting session startup from 46 seconds to 100 milliseconds.

Read the original ↗Export Markdown