Skip to content

#RAG

0 today

May 28Thursday

The Verge · AI

CNN sues Perplexity over “verbatim” copycat articles

CNN sued Perplexity in a New York court on Thursday, alleging its AI answer tools generate “verbatim” copies of CNN work and provide users with information locked behind CNN’s subscription wall.

Why it matters: CNN sued Perplexity in a New York court, alleging its AI answer tool copies articles verbatim, bypasses paywalls and ignores crawler blocks, a case about where AI search ends and media licensing begins.

AI HOT (Curated Pool)

Mistral AI Releases Search Toolkit

Mistral AI released the public preview of Search Toolkit, an open source framework that combines data ingestion, retrieval, and evaluation behind shared interfaces for cloud, on-premises, or edge deployment.

Why it matters: Mistral open-sourced a preview of Search Toolkit, splitting a search system into data ingestion, retrieval and evaluation layers behind unified interfaces, deployable in cloud, on-prem or at the edge with swappable components.

May 27Wednesday

AI HOT (Curated Pool)

Perplexity open-sources Unigram tokenizer to reduce CPU usage

Perplexity open-sourced a rebuilt Unigram tokenizer that reduces CPU usage by 5-6x, targeting tokenization latency when small rerankers and embedding models run on GPUs in single-digit milliseconds.

Why it matters: Perplexity open-sourced a rewritten Unigram tokenizer that cuts CPU tokenization cost 5 to 6 times in reranking and embedding pipelines, so tokenization stops slowing down responses.

May 26Tuesday

r/LocalLLaMA

Update on a 12×32GB SXM V100 Cluster for Local Legal Drafting

A lawyer runs a local legal-drafting pipeline across 16 GPUs, with Qwen3.5-122B-A10B reaching about 50 tok/s on four V100s, while a verifier blocks ungrounded citations, dates, and Bates numbers before any final document is used.

Why it matters: A lawyer built a local cluster from 12 V100s with 32GB of VRAM each, running Qwen3.5-122B on 4 cards at roughly 50 tokens/sec to draft legal documents, showing a workable local setup for professional use.

May 25Monday

r/LocalLLaMA

The reason small-model agent stacks aren't the default is not whether they work

A Reddit post argues small-model agent stacks are not default for business reasons, not capability limits: Gemma 4 31B reaches 86.4% on tau2-bench, and DeepSeek V4-Flash output tokens are priced about 89x below Claude Opus 4.6. The operational risk is verification, because 7–9B models produced broken reasoning for roughly half to two-thirds of correct answers in a cited audit.

Why it matters: The post argues small-model agent stacks stay niche because of business risk and validation cost, not capability, citing Gemma 4 31B's 86.4% on tau2-bench and DeepSeek V4-Flash pricing.

May 24Sunday

r/LocalLLaMA

Using llama.cpp native tools for web RAG inside llama-server WebUI

A Reddit user describes using llama.cpp native tools for web RAG inside llama-server WebUI with a 7-step setup: enable get_datetime and exec_shell_command, then run wget through firejail, a separate Linux user, and an Alpine OCI VM sandbox.

Why it matters: A Reddit user laid out the exact steps for calling llama.cpp's native tools from inside llama-server's built-in web UI to do web retrieval, a reusable path for giving local models live data.

r/LocalLLaMA

Vision-capable LLMs vs. OCR for long-document QA with charts, images, and tables

The author tested Claude Sonnet 4.5 on 171 questions from 30 image-heavy MMLongBench-Doc PDFs, comparing native PDF vision use with OCR pipelines. Native PDF ranked fifth of six at 52.0% accuracy and cost $0.2552 per query, while LlamaCloud premium with full context reached 59.6% at $0.1885 per query.

Why it matters: A hands-on test compares reading chart-heavy PDFs directly against OCR-then-QA on 30 documents, with accuracy and per-query cost reported.

May 22Friday

Latent Space

[AINews] New AI Infra Unicorns: Exa, Modal, TurboPuffer

Latent Space summarized AI News for May 20-21, 2026, confirming TurboPuffer reached $100 million ARR and profitability, Exa raised a $250 million Series C at a $2.2 billion valuation, and Modal raised a $355 million Series C at a $4.7 billion valuation.

Why it matters: TurboPuffer confirms $100M ARR and profitability, showing that vector databases can sustain paying customers and offering a reference point for how similar infrastructure companies commercialize.

May 21Thursday

AI HOT (Curated Pool)

Context compression improves search efficiency and accuracy

Perplexity has deployed query-aware compression in production, reducing context tokens by up to 70% while improving search answer quality.

Why it matters: Perplexity uses query-aware compression in live search, cutting context tokens fed to the model by up to 70% while answer quality rises, a reference point for compressing without losing quality.

May 20Wednesday

TechCrunch · AI

You Can Now Talk to Your Gmail Inbox, as Seen at Google I/O 2026

Google expanded Gmail’s AI Inbox with conversational voice search, letting users ask Gemini to find details buried in email. The RSS snippet does not disclose rollout scope, supported languages, pricing, latency, or the retrieval mechanism behind Gmail search.

Why it matters: Google put voice conversation search into Gmail, so users can ask Gemini to pull specific details out of their mail.

May 19Tuesday

Xinzhiyuan · WeChat

CUHK and Zhejiang University Question Whether AI Agent Memory Is Just a Memo

CUHK and Zhejiang University researchers argue that mainstream Agent memory is retrieval-based memo storage, not true memory, citing an Ω(k²) case requirement for compositional tasks and a PoisonedRAG result where 5 adversarial texts reached a 90% attack success rate.

Why it matters: Researchers at CUHK and Zhejiang University argue that mainstream AI agent memory modules are just retrieval-style memo pads, and that multi-step compositional tasks need a number of cases growing with k², pushing cost up.

May 17Sunday

Hacker News front page

Show HN: Semble – Code search for agents that uses 98% fewer tokens than grep

MinishLab open-sourced Semble, a code-search tool for agents that combines Model2Vec embeddings, BM25, RRF fusion, and reranking; on a 63-repo benchmark, it used 98% fewer tokens than grep+read, reached 0.854 NDCG@10, and ran CPU queries in about 1.5 ms.

Why it matters: MinishLab's open-source Semble chains lightweight semantic embeddings, BM25 and reranking into one retrieval pipeline, scoring NDCG@10 0.854 across 63 code repos at about 1.5ms CPU per query.

May 16Saturday

QbitAI · WeChat

A new AI for 5 million doctors in China: exclusive journal partnership focuses on evidence sources

Alibaba Health launched the medical AI product Qinglizi for China’s 5 million doctors, with access to ten years of content from 70 BMJ Group journals and an evidence workflow constrained by PICO, GRADE, and review from more than 300 clinical experts.

Why it matters: Alibaba Health's Qinglingzi medical AI for doctors answers on a knowledge base of nearly a decade of full text from 70 BMJ journals, organized by PICO and GRADE.

May 15Friday

r/LocalLLaMA

Evaluated a RAG Chatbot: The Most Expensive Model Was the Worst Performer

The author evaluated a customer-support RAG bot and raised the quality score from 6.62 to 7.88 while cutting per-session cost from $0.002420 to $0.000509, using retrieval logging, LLM-as-judge scoring, chunk deduplication, stricter grounding, and a five-model sweep.

Why it matters: A builder used a model as judge to tune a customer-service RAG bot, lifting quality from 6.62 to 7.88 and cutting cost per session by nearly 80%, while the priciest model performed worst.

AI HOT (Curated Pool)

Databricks brings GPT-5.5 to enterprise agent workflows

Databricks made GPT-5.5 available through AI Unity Gateway for AgentBricks and Agent Supervisor API workflows; on OfficeQA Pro, it became the first model above 50% accuracy and reduced errors by 46% versus GPT-5.4.

Why it matters: Databricks connected GPT-5.5 through its AI Unity Gateway into agent workflows built on AgentBricks and the Agent Supervisor API, a concrete reference for teams planning model integration.

AI HOT (Curated Pool)

Granite Embedding Multilingual R2: Open Multilingual Embedding Model with 32K Context

IBM Granite released Granite Embedding Multilingual R2 on Hugging Face under Apache 2.0, with fewer than 100 million parameters, a 32K-token context length, and top same-scale retrieval performance on MTEB according to the post.

Why it matters: IBM open-sourced two Apache 2.0 multilingual embedding models on Hugging Face, with the 97M-parameter version scoring 60.3 on MTEB multilingual retrieval, a new reference point for lightweight multilingual search.

AI HOT (Curated Pool)

OpenEvidence reaches 65% of U.S. doctors, drawing attention to shadow AI use

OpenEvidence reaches 65% of U.S. doctors and recorded 27 million clinical uses in April; doctors registered on mobile with license numbers, while hospitals were initially unaware of the shadow AI adoption pattern.

Why it matters: OpenEvidence says it reaches 65% of US doctors, who signed up themselves with license numbers while hospitals did not know, showing tools spreading bottom-up.

r/LocalLLaMA

MOOSE-Star (ICML 2026): 7B Model and 108K-Paper Dataset for Scientific Hypothesis Discovery

MiroMind researchers released the MOOSE-Star collection with three 7B models and TOMATO-Star, a dataset of 108,717 NCBI papers. MS-IR-7B reaches 54.37% inspiration-retrieval accuracy, uses DeepSeek-R1-Distill-Qwen-7B as its base, runs at about 14GB fp16, and supports llama.cpp, vLLM, and SGLang.

Why it matters: MiroMind released three 7B MOOSE-Star models and the 108,717-paper TOMATO-Star dataset, with weights and data available for reuse in scientific hypothesis discovery.

May 14Thursday

AI HOT (Curated Pool)

OpenSquilla Open-Source Project Uses Smart Routing and Local Retrieval to Cut LLM Costs

OpenSquilla combines local model routing, vector retrieval, incremental sending, and cache hits to reduce transmitted tokens by more than 90%, while routing simple tasks to cheaper models and complex tasks to stronger models without spending tokens on the routing decision.

Why it matters: OpenSquilla runs model routing decisions locally, judging question difficulty without spending tokens, and cuts actual transfer volume below a tenth through incremental sending and cache hits.

May 13Wednesday

AI HOT (Curated Pool)

Open-source psql_bm25s speeds up PostgreSQL retrieval for multi-agent systems by 23x

The team open-sourced psql_bm25s, a native PostgreSQL access method for exact BM25 retrieval, and says it runs about 23x faster than pg_search on standard benchmarks.

Why it matters: A native Postgres access method that claims roughly 23x the speed of pg_search, letting teams keep search inside the primary database.

TechCrunch · AI

The AI legal services industry is heating up — Anthropic is getting in on the action

Anthropic introduced tools for law firms that cover five clerical workflows: document search and review, case law resources, deposition preparation, document drafting, and related tasks; the RSS snippet does not disclose pricing, launch timing, or model details.

Why it matters: Anthropic shipped five document automation tools for law firms, covering document search and review, case law lookup, deposition prep and drafting, showing how model makers enter professional services.

May 10Sunday

r/LocalLLaMA

We tried vectors, ASTs, and brute-force context stuffing for code retrieval; LLM semantic graphs worked best

ByteBell open-sourced a code indexing system that stores per-file LLM-generated purpose, summary, business context, entities, classes, functions, keywords, and imports in a Neo4j graph, then uses full-text search instead of vector similarity, with SHA-256 diffing to reindex only changed files and keep LLM calls proportional to churn.

Why it matters: ByteBell open-sourced its code index after testing vectors, ASTs and raw context stuffing, and landed on LLM-written semantics in a Neo4j graph queried by full-text search.

May 7Thursday

Computing Life · Share · Yage

Agent Filesystems: From Feeding Models Memory to Letting Models Browse Files

The article frames agent filesystems as a three-stage shift from raw context to memory systems to filesystem-as-context, covering design choices from Turso, Anthropic, Vercel, and Manus, and listing four overlooked blind spots.

Why it matters: The piece traces external agent memory through three generations, from filling the context window to vector databases to treating the file system as context.

May 6Wednesday

The Verge · AI

Google’s AI Search Summaries Will Now Quote Reddit

Google updated AI Search to include firsthand views from Reddit, social media, and forums in summaries. The post says a “perspectives” preview links queries to related online discussions; it does not disclose rollout scope or timing. For search teams, the key issue is how AI summaries cite and rank UGC sources.

Why it matters: Google updated AI search summaries to show first-hand previews from Reddit and other forums, forcing search teams to rethink how they cite and rank user content.

r/LocalLLaMA

An Open Benchmark for Testing RAG on Realistic Company-Internal Data

EnterpriseRAG-Bench released a 500k-document corpus for testing RAG on company-internal data. It simulates Redwood Inference across 9 sources and includes 500 questions over 10 retrieval failure modes. Baselines show BM25 beats vector search overall, while agentic/bash retrieval has the best completeness at higher cost and latency.

Why it matters: EnterpriseRAG-Bench tests internal-company RAG with 500k documents and 500 questions across 9 data sources and 10 retrieval failure modes; BM25 beat vector retrieval overall.

May 5Tuesday

Hacker News front page

Show HN: Airbyte Agents – context for agents across multiple data sources

Airbyte launched Airbyte Agents, using Context Store to index operational data for agents. Its public benchmark reports up to 80% fewer tokens for Gong and 90% for Zendesk versus vendor MCPs. The key point is pre-indexed context, not another MCP wrapper.

Why it matters: Airbyte's Context Store pre-indexes data from Slack, Salesforce and Zendesk so assistants skip repeated API calls, which Airbyte says cuts token use by about 90%.

May 4Monday

r/LocalLLaMA

Gemma 4 E2B runs well on an 8GB Android phone, powering a private voice notes app

A Reddit user ran Gemma 4 E2B locally on an 8GB OnePlus CE 5 and built a private voice notes app. Whisper Small 244MB transcribes, Gemma 4 E2B 2.4GB splits and tags, and a 10-15s note takes 12-15s end to end. Search uses query expansion, FTS lanes, RRF, and optional Gemma top-K reranking with a 15s fallback.

Why it matters: A Reddit user fit a 2.4GB Gemma 4 E2B and Whisper Small into an 8GB phone for a fully offline voice notes app.

May 3Sunday

r/LocalLLaMA

Upskill: skill registry your agent consults before it starts, with 10k+ indexed skills

Autoloops released Upskill, an open-source skill registry with 10k+ indexed skills for agents. Search combines Postgres full-text search, 1024-dim embeddings, and reranking by stars, installs, and feedback. LLM adversarial review blocked hundreds of skills at index time.

Why it matters: Autoloops open-sourced the Upskill registry, indexing over 10,000 skills an agent can search before starting a task, ranked by full-text, vector match and install feedback.

Apr 27Monday

Hacker News front page

TurboQuant: A First-Principles Walkthrough

TurboQuant walkthrough explains compressing AI vectors to 2–4 bits per coordinate. It uses random rotation to map high-dimensional coordinates to a fixed distribution, then reuses one codebook with no scale overhead, training, or calibration.

Why it matters: TurboQuant compresses high-dimensional vectors to 2 to 4 bits per coordinate, fixing the coordinate distribution with a random rotation and using a universal codebook instead of per-group scaling, with no training or calibration.

Apr 23Thursday

TechCrunch · AI

AI Overviews are coming to your work Gmail

Google is bringing AI Overviews to work Gmail to generate instant summaries across multiple emails. The RSS snippet confirms only cross-email summarization; the post does not disclose rollout timing, pricing tier, or model details. The key shift is aggregation beyond a single thread.

Why it matters: Google brings AI Overviews to enterprise Gmail, letting users pull project, invoice and travel details from across multiple emails in natural language and generate summaries instead of opening each message.

Apr 22Wednesday

X · @dotey

Google splits Gemini Deep Research into Deep Research and Deep Research Max

Google split Gemini Deep Research into Deep Research and Deep Research Max, with public preview starting today in paid Gemini API tiers. Both run on Gemini 3.1 Pro; one targets speed and cost, while Max runs longer with more compute and repeated search and reasoning. The update adds MCP support for sources such as FactSet, S&P, and PitchBook, plus files, code execution, and File Search; the post does not disclose pricing.

Why it matters: Google splits Gemini Deep Research into a standard tier built for speed and cost and a Max tier that spends more compute on repeated search and reasoning.

Apr 18Saturday

QbitAI · WeChat

RAG retrieves the right docs but still answers wrong? Saarland University team diagnoses why | ACL 2026

A Saarland University-led team introduced Disco-RAG, adding a 3-step “reading” layer between retrieval and generation, and says the paper was accepted as an ACL 2026 main-conference long paper. The post says it uses RST-based argument trees, cross-passage relation graphs, and outline generation with zero training; it reports gains on Loong, ASQA, and SciNews, but does not fully disclose the exact scores. The key claim is that many RAG failures come from reading and discourse understanding, not retrieval recall.

Why it matters: A Saarland University team traces RAG errors to document understanding in the generation step and proposes Disco-RAG, which builds argument trees with rhetorical structure theory and a cross-paragraph relation graph, with no extra training.

Apr 17Friday

TechCrunch · AI

Google now lets you explore the web side-by-side with AI Mode

Google said on April 16 that clicking a link in AI Mode on Chrome desktop now opens the web page side-by-side with AI Mode. The feature keeps search context and uses page context plus web information for follow-up answers; the post does not disclose rollout scope, timing details, or regional limits. The practical shift is that Google is merging search chat and site browsing into one workflow.

Why it matters: Chrome's AI Mode now keeps the chat and the page open together, so answers can draw on what you're reading.

Apr 7Tuesday

X · @dotey

Milla Jovovich and Ben Sigman release open-source AI memory system MemPalace, claim perfect LongMemEval score

Milla Jovovich and Ben Sigman released the open-source memory system MemPalace and claimed a perfect LongMemEval score. The project runs fully local with no cloud or API key, says AAAK compresses context 30x, and uses 19 MCP tools for retrieval. The key issue is evaluation: Penfield Labs says the “perfect” result measured retrieval only, not end-to-end QA, and AAAK dropped retrieval accuracy from 96.6% to 84.2%.

Why it matters: Milla Jovovich and a developer released MemPalace, an open-source memory system storing all conversations locally, but its LongMemEval claim only tests retrieval and its compression grammar cut retrieval accuracy from 96.6% to 84.2%.

Apr 4Saturday

X · @dotey

Mintlify uses ChromaFs to make AI document retrieval look like a file system

Mintlify routes its AI doc assistant’s grep, cat, and ls calls through ChromaFs into database queries, cutting session startup from 46s to 100ms and pushing marginal compute cost per chat near zero. Built on Vercel Labs’ just-bash, it maps pages to files and sections to directories; at 850,000 chats per month, replacing real sandboxes saves over $70,000 a year in compute. The real shift is retrieval design: not faster vector RAG, but model-led exploration of structured docs, and the post says this may not fit messy knowledge bases.

Why it matters: Mintlify replaced vector RAG in its AI docs assistant with a fake filesystem that simulates grep, cat and ls through database queries, cutting session startup from 46 seconds to 100 milliseconds.

Apr 3Friday

X · @claudeai

Microsoft 365 connectors are now available on every Claude plan

Anthropic made Microsoft 365 connectors available on every Claude plan, covering Outlook, OneDrive, and SharePoint. The post confirms plan coverage and supported apps; it does not disclose pricing, permission boundaries, regional limits, or admin requirements. The real signal is broad rollout across all plans, not a new standalone connector.

Why it matters: Anthropic moved the Microsoft 365 connector from a high-priced tier to every paid Claude plan, so Outlook mail, OneDrive documents and SharePoint files plug straight into the conversation.

X · @op7418

Karpathy shared how he builds a local AI knowledge base

Karpathy uses Obsidian and local Markdown to build a personal wiki, stores source material in a RAW folder, then has an LLM generate summaries, indexes, concept pages, links, and visualizations. The setup can answer questions over the wiki and write reports or new files, but the post also says AI-generated content can pollute the corpus and should be separated from trusted sources; the post does not disclose the model, scale, or automation details.

Why it matters: Karpathy published his full pipeline for turning raw material into a local Markdown wiki with an LLM, from summaries and indexing to asking questions and generating reports.

Feb 27Friday

36Kr (direct RSS)

From short video to long-form: Douyin is also handing news to AI

Douyin launched long-form posts in late 2025, raising the cap from 4,000 to 8,000 Chinese characters, and added “AI-selected news” summaries in its Hot topics tab. Long-form publishing is web-only for now, and the post says AI news will enter the main feed, but it does not disclose ranking weight, licensing scope, or fact-checking rules. The real issue is distribution and accountability: AI summaries and original articles will compete in the same traffic pool.

Why it matters: Douyin raised its long-post limit from the 4,000 characters tested in beta to 8,000, and AI-selected news auto-generates summaries and is about to enter the feed, competing for the same traffic as original long-form posts.

Feb 9Monday

36Kr (direct RSS)

Voice Ask is live: why is Xiaohongshu pushing search-by-question?

Xiaohongshu fully launched Voice Ask on Jan. 27, letting users long-press to speak on the search page and get structured answers distilled from in-app user experience posts. The post says it can handle 3-minute spoken queries, foreign languages, and dialects, but does not disclose the model, ASR stack, latency, or accuracy. The real shift is from 3-4 character keyword search to longer spoken questions, widening search intent capture and scenario coverage.

Why it matters: Xiaohongshu rolled out voice Q&A to all users, and answers to long-pressed voice questions on the search page are limited to real user experience on the platform rather than general encyclopedic results.

Jan 19Monday

Import AI (Jack Clark)

Import AI 441: My agents are working. Are yours?

Jack Clark says his research agents processed thousands of papers while he hiked or slept, and Claude finished site scraping, embeddings, local vector search, and a GUI in under one hour. The post confirms multi-agent retrieval, cross-checking, and report generation; it does not disclose model versions, cost, failure rate, or benchmark data. The point to watch is workflow friction dropping enough for AI to shift from single prompts to ongoing delegated work.

Why it matters: A concrete account of research agents running unattended, with the time saved and the tooling built around them.