Offline survival assistant – local LLM and Kiwix, runs from a USB stick
Survival AI(IA da Sobrevivência)是可从 USB 盘运行的离线生存助手,支持 Windows、Linux 和 macOS,结合本地语言模型与 Kiwix 资料库提供带来源引用的回答。
Survival AI(IA da Sobrevivência)是可从 USB 盘运行的离线生存助手,支持 Windows、Linux 和 macOS,结合本地语言模型与 Kiwix 资料库提供带来源引用的回答。
Box 在开发者大会上发布 Box Content Retrieval,将 Nvidia 的 Nemotron 嵌入系统集成进产品核心,让智能体基于嵌入元数据回答查询。Nvidia 生成式 AI 软件副总裁 Kari Briski 称查询速度提升 4 倍、错误减少 20%、token 用量减少 90%。该功能面向 Box Enterprise Advance 客户,将于明年初开始推送。
一位开发者发布 INTERNALS.md 交互式笔记,通过改动输入来理解 RLHF、注意力机制、LoRA 和 LLM 评测等概念。评测部分覆盖 82% 与 80% 的比较、exact match 与 F1、nDCG@k、pass@k、LLM as judge、Elo、RAG 与 Agent 评测、A/B 测试及数据污染等主题。站点默认不启用追踪,仅提供 Google Analytics 开关选项。
CaseCite 是采用 Apache License 2.0 的开源自托管法律研究平台,支持文档问答、合同审查、起草及案例与法官研究。文档、索引和聊天记录保存在自有部署中,但 AI 功能会向配置的服务商发送问题和相关文本;要让文档文本留在内网,需同时自托管聊天模型和嵌入向量模型。
Survival LLM 是免费开源的本地 AI 助手与应急资料库,联网完成安装后可离线回答问题,并展示来源文章及对应原文。它支持 Mac 和 Windows,按电脑内存下载适配模型,资料库包含医疗、应急、生存及维修指南和约 930,000 篇 Wikipedia 文章,完整资料库下载量为 9 GB,安装后占用 19 GB。
维基百科 WikiProject AI Cleanup 志愿者正在开发工具,识别并移除违反网站规范的 AI 生成内容,排查重点包括细微写作结构和不支持正文主张的引文。
WD 内部测量显示,一段 8 秒 AI 视频(用户拿到的是 3.97MB 的 720p 文件)在后端留下超过 500MB 关联数据,是输出文件体积的 130 倍。
Cohere 发布企业检索重排模型 Rerank 5 Pro 与 Rerank 5 Fast,分别面向重排质量优先和延迟、成本敏感的场景。
n8n 教程展示如何在一台 NVIDIA DGX Spark 上部署七个模型,通过 LiteLLM 的统一接口运行不调用云端 API 的 AI 工作流。实测模型栈占用 108GB 内存,发票字段提取关闭思考后从 12.1s 降至 0.59s,并提供模型版本锁定、服务配置与 n8n 接入步骤。并行生成图像时,单用户聊天速度下降 69%,四用户场景下降 65%,共享 GPU 的任务需要安排调度。
Harness Engineering 101 是从第一性原理讲解 AI 智能体构建的系列教程,以书籍形式发布,Version 1.0 标注为 2026 年 9 月。
A software engineer used AI to search millions of pages of historical archives, turning up a meteorite report, shipping records for 3 rhinos and 3 candidate volcanic eruption records. The pipeline combines semantic search, Jev for first-pass filtering, Claude Haiku for close reading and Claude Code to check the original scans, and was tested against known historical events. The main findings were checked against original pages and accessible catalogs, but no relevant expert has reviewed them yet. The author is open-sourcing the investigation workflow as the Antiquity toolkit.
Why it matters: A software engineer chains semantic search, low-cost model filtering and original-scan verification, then tests the pipeline on known events, offering a transferable method for large-scale archive research.
Docker Agent is a Docker CLI plugin that builds, runs and shares AI agents from declarative YAML, with no code to write. It handles automatic task delegation between multiple agents, built-in tools and MCP servers, and RAG with BM25, embeddings, hybrid search and reranking. Agents can be pushed to any OCI registry.
Why it matters: Defining agents in YAML and shipping them through OCI registries makes tool config and multi-agent workflows versionable and shareable.
Google DeepMind released EmbeddingGemma 2, built on the Gemma 4 architecture, which maps text, code, images, video and audio into one shared embedding space. The model has 740 million parameters, ships under the Apache 2.0 license, and supports an 8K token context window for fully offline cross-modal search and RAG. Text-only tasks need just 270M parameters, and output vectors can be cut from 768 dimensions to 128.
Why it matters: EmbeddingGemma 2 runs cross-modal retrieval on local devices, so text, image, audio and video search never has to send data to the cloud.
Stripe applied its coding agent experience to non-coding knowledge work. Kai, the internal platform, connects to over 1,000 internal tools so sales, finance, and legal teams can run deep research, generate artifacts, or prep compliance reviews. Within two weeks of launch, most of Stripe was using it; now 83% of employees are weekly active users, with near-full GTM coverage. Kai is not a single app but an API plus AgentStudio that lets domain teams build and govern their own agents, with security isolation baked into the execution layer.
Why it matters: Stripe's internal AI platform reached 83% weekly active users two weeks after launch, a concrete adoption number for enterprise AI.
Maksim Ilin pulls together LinkedIn, WEF, Stanford, PwC, and Bain data for a September 2026 snapshot of the AI labor market. AI Engineer is the most-hired role; Research Scientist at a frontier lab is the most prestigious, with median pay around $746K at Anthropic and $1.15M at OpenAI L5. The fastest-growing niches are agentic systems and Forward Deployed Engineering—postings for the latter jumped over 1,000% YoY. Prompt engineer has faded as a job title; the skill remains but dissolved into other roles. AI skills now command a 62% wage premium in the US. Bain projects more than 1.3M AI jobs in the US by 2027 against roughly 645K available workers. In Europe, over half of AI postings sit outside tech departments, and Germany shows seven AI-user roles for every AI-developer role. Entry-level hiring got harder: employment for 22–25-year-olds in AI-exposed occupations now trails the rest by 19%.
Why it matters: The author pulls LinkedIn, WEF and PwC data into one picture of 2026 AI hiring and pay, including roughly 1,550 new AI Engineer postings a week and a $176,000 median salary.
Klarna touted AI replacing 700 agents in 2024, then its CEO admitted quality dropped and started rehiring 14 months later. IBM, Ford, and Commonwealth Bank of Australia all pulled back after AI-driven cuts. The root cause: executives decide on average metrics, but damage hits the tail—the hardest 6% of cases, long-tail defects, ethical judgments. Meta's internal data shows code changes up 220%, user-facing features up only 36%, major incidents up 40%. Stanford research found a 19% employment gap for 22–25 year-olds in high AI-exposure roles, driven by reduced hiring, not layoffs. Salesforce cut 4,000 support roles yet hit record headcount the same year, hiring AI salespeople. The real shift: generation work gets cheaper, verification and judgment work gets more expensive and in higher demand.
Why it matters: It strings together cases at Klarna, IBM and Commonwealth Bank where AI cut staff and then rehired, and shows every pullback was triggered by collapsing quality signals, not missed cost targets.
Thomson Reuters spent $40M to post-train Alibaba's Qwen open-weight model on legal data, claiming domain scores that beat Anthropic Haiku 4.5. Compute cost was only $100-200K; the real spend went into 175 years of proprietary case law, hundreds of expert annotators, and a high-resolution eval system. Three years ago Bloomberg burned far more cash training a 50B model from scratch that never shipped. Harvey later used full-parameter RL on GLM 5.3 Flash and reported beating GPT-5.5 and Opus 4.8 Max on legal benchmarks. The post flags two caveats: domain injection caused measurable regression on math and coding, and Chinese open-source vendors are tightening commercial licenses, so license review must now precede any base-model decision.
Why it matters: Thomson Reuters spent $40 million post-training legal data on Qwen, of which raw compute was only $100,000 to $200,000; the rest went to case-law databases, expert labeling and evals.
calmrocks published a set of Colab notebooks on GitHub for AI engineers and forward-deployed engineers. They cover model APIs, structured output, tool calling, RAG, evals-as-the-spine, agent loops from scratch, tool design, guardrails, MCP, Skills, fine-tuning vs LoRA, prompt injection, LLMOps, and customer craft. Everything runs on the free Groq API with no frameworks. The post doesn't specify the number of notebooks or an update schedule.
Why it matters: calmrocks published a set of free Colab notebooks on GitHub covering RAG, agent loops, evals, fine-tuning and guardrails, all framework-free and portable to day-to-day engineering work.
Andrew Ng repositioned DeepLearning.AI around AI engineering skills. The team analyzed over 10,000 job postings, ran dozens of structured interviews and surveys, and landed on four capabilities: building and deploying AI applications, software engineering fundamentals, using coding agents, and shaping the build. The first stresses disciplined evals and error analysis loops. The second warns that vibe coders who don't understand tradeoffs will get poor results from their coding agents. The third requires knowing when to intervene and when to leave an agent alone, plus routines for trying new tools. The fourth covers product sense—when to ship an MVP fast and when to slow down. The post does not disclose course launch dates or pricing.
Why it matters: Andrew Ng relaunched DeepLearning.AI around AI engineering, drawing on more than 10,000 job postings and dozens of interviews to name four core skills.
This essay splits tech-world 'impressive' into two kinds: mechanisms that actually work, and one-liners that sound world-changing. ChatGPT pulled 100M users through 30-second self-demos; AutoGPT hit 100K stars with a grand sentence but was just a for-loop; GraphRAG looked brilliant on both fronts but collapsed under cost and marginal gains; MCP's 'USB-C moment' pointed at the wrong thing—the real value was crude but functional tool distribution. The author argues that sentences peaking at launch have a terrible track record, while post-delivery recognition carries real signal. In careers, practicing sentences pays fast, practicing mechanisms pays slow, and Gresham's law applies: good-sounding talk drives out boring truth.
Why it matters: The piece contrasts ChatGPT reaching 100 million users in two months with AutoGPT's 100,000 GitHub stars and quick collapse, unpacking two different kinds of impressive in tech.
A wave of Agent Web Search APIs appeared in 2026 not because search got easier, but because the delivery contract changed. Models need clean text and URL citations, not ad-filled SERPs, so crawling, retrieval, parsing, and compression can now be sold as separate layers. Serper proxies Google results, Exa narrows its index to high-signal domains, Tavily focuses on context refinement, and AWS repackages internal crawl infra as cloud services—replacing browser distribution with cloud runtime distribution. The hard engineering—web-scale crawling, anti-bot, freshness indexing—remains untouched. New moats are forming around model SDKs, MCP standards, and agent task success rates as ranking signals.
Why it matters: Agent Web Search APIs that appeared in 2026 sell crawling, retrieval, parsing and compression as separate pieces and deliver to models instead of people, and this maps that shift in the search supply chain.
OpenAI's internal data agent serves 3,500+ users across 600 PB of data with a single GPT-5.5 model and ~13 tools online. The real work happens offline: Codex reads pipeline code to infer table semantics, turning raw metadata into structured descriptions that online RAG retrieves. Engineer Emma Tang notes that giving the model less but more accurate context yields better results. Six context layers address four pain points: code holds true meaning, query history is noisy, metric definitions live in docs, and correction memory can go stale. Staleness is patched by live schema checks at runtime. The model still overconfidently miscalculated ChatGPT active users as 5 million. No accuracy or ablation data disclosed.
Why it matters: OpenAI's internal data agent serves 3,500-plus people across 600 PB, using Codex to pre-write pipeline business logic as structured descriptions that online RAG then retrieves.
UEmbed is a decoder-only multimodal embedding model that produces both sparse lexical vectors and dense semantic vectors in a single causal forward pass. It appends N learnable special tokens and partitions the vocabulary into N disjoint subsets; each token predicts sparse weights over its assigned subset, and the N subsets are concatenated into the full sparse vector. The authors release UEmbed at 2B, 4B, and 9B scales, all trained on public data. UEmbed-9B hits 71.8 (dense) and 71.0 (sparse) on MMEB-v2, outperforming RzenEmbed, and stays competitive with strong baselines on BEIR. The paper also demonstrates utility across effectiveness, efficiency, and agentic applications. The post doesn't disclose inference latency or memory footprint, so real-world cost is still an open question.
Why it matters: UEmbed has one decoder-only model emit sparse and dense multimodal vectors in a single forward pass, and publishes training recipes for 2B, 4B and 9B sizes.
OpenAI launched Presence on July 22, an enterprise voice and chat agent product targeting specific roles like customer service and outbound sales. Its core pitch is not model capability but productizing the feedback loop after agent failures: when a task gets stuck and escalates to a human, the system saves the full execution context, lets teams reproduce the failure in a sandbox, fix rules, run regression tests, and push code changes via Codex. This standardizes what field FDEs used to do manually—migrating on-site failures back into the product. Presence is in limited GA, non-self-serve, deployed case-by-case; OpenAI hasn't disclosed hosting details, data residency, or cross-vendor export for failure records and test suites. The article warns that if enterprises can't take these hard-won lessons with them, they face a new form of vendor lock-in.
Why it matters: OpenAI's Presence packages enterprise voice and chat agents with standard tooling for saving failed handoff context, reproducing it in a sandbox, patching rules and regression testing.
The author ran 200 addition problems on GPT Sol High and it missed one. The model doesn't calculate—it predicts the next likely digit. ChatGPT gets it right because a harness hands the problem to a Python script. The post walks through the same pattern for three other unsolved flaws: stale knowledge patched by RAG, limited context windows, and toxicity still baked into the model. The real progress isn't in the models but in the tooling wrapped around them.
Why it matters: A 200-problem addition test with one error shows models guess rather than compute, and the fix sits in the tooling around them.
The author, drawing on 18 months of sales and hands-on technical work, reports a near-100% failure rate for enterprise AI projects. Internal chatbots go unused because company documentation is poor and LLMs can't access what isn't written down. Customer-facing bots sound natural but silently drop requests—the author never got a callback from Mitsubishi in six months. Management avoids tracking real usage metrics while publicly claiming massive productivity gains. The core problem isn't just AI; most companies are bad at shipping software, and AI projects inherit all those failure modes plus the uncertainty of a novel method.
Why it matters: Drawing on 18 months of projects and about 300 practitioner interviews, the author documents a zero success rate for enterprise AI projects and lost customer-service requests.
Kingsoft Office announced WPS Comate at its 2026 AI Productivity Conference, positioning it as an AI work client for employees. It connects to an organization's data, systems, and workflows, calling role-based AI experts to deliver business outcomes rather than just text suggestions. The product has six modules: AI role expert, Skill ecosystem, automated tasks, team collaboration space, Wiki knowledge base, and an app marketplace. Local task mode keeps files on-device; cloud mode accesses WPS 365 data under enterprise authorization, with all operations traceable. Individuals can download and use it immediately; enterprises can phase in WPS 365 and Studio. The post does not disclose pricing or a launch date.
Why it matters: Kingsoft Office's WPS Comate shows how office suites are packaging AI agents around company data, systems and job roles.
More tools mean more noise in the context window. Anthropic's MCP sandbox cuts 150K tokens of tool definitions down to ~2K of high-signal input. Google ADK splits agent state into working context, session state, long-term memory, and file artifacts—intermediate outputs stay off-prompt by default. Manus reports a ~100:1 input-to-output token ratio in production; they keep raw files in a sandbox, stabilize tool-call formats for KV cache hits, and rewrite a todo.md at the window's end to fight lost-in-the-middle. Headroom compresses JSON and logs by 60–95%, but lacks large-scale validation on hard coding tasks. The takeaway: RAG is the foundation, but the real engineering is runtime information governance.
Why it matters: Anthropic shrinks tool definitions inside a sandbox, while Google ADK isolates intermediate artifacts by state layer to cut agent context usage.
Anthropic's Claude Tag puts a persistent AI teammate in Slack that can proactively chime in and retain channel context. Under the hood, ambient mode is still scheduled triggers hitting an HTTP endpoint, and memory is raw chat logs, not organizational knowledge. The real shift is governance: enterprises are assigning agents independent identities, permissions, budgets, and audit trails. Microsoft's Entra Agent ID treats agents as first-class directory citizens. Pricing is moving from per-seat to consumption-based. One Reddit user burned $41,952 in a month running persistent agents, 99.6% spent replaying context. Continuous learning isn't here yet—Gartner predicts over 40% of agent projects will be abandoned by 2027—but the direction is set: enterprise software's runtime object is shifting from apps to governed agents.
Why it matters: A look at how Claude Tag works under the hood, and why enterprises now authorize agents as their own identities with budgets and audit trails.
Anthropic launched Claude Tag, an always-on AI teammate inside Slack. It reads channel messages over time to build institutional knowledge, not just answer one-off questions. The play is clear: turn organizational context into Claude's long-term memory and embed the model into daily workflows. The post doesn't disclose pricing or launch date. Privacy and permission controls are mentioned only briefly—admins can configure them, but details are thin.
Why it matters: Anthropic's Claude Tag sits in Slack and reads channel history to build business and project context, so users can @ it without re-explaining background.
WeChat is gray-testing an AI assistant called Xiao Wei, accessible from the top-left corner of the home screen. The main entry can send messages and red packets to friends but cannot read chat history or post to group chats. A sub-entry inside group and private chats lets Xiao Wei read chat history and send group messages. It can create calendar reminders, to-do lists, summarize Moments, and answer questions by tapping into Official Accounts and Channels. Its Favorites feature only sees notes created by Xiao Wei itself. A built-in 'mini-tool' supports voice-driven creation of simple mini-programs—not publishable yet, but it can invoke third-party mini-programs.
Why it matters: WeChat is testing AI assistant Xiaowei, and the permission gap between its home entry and its in-chat entry is the most concrete detail here.
An ICML 2026 paper presents an ISR=1 answer-abstain gate for evidence-grounded QA, and ntkMirror implements it for local open-weight models with multiple evidence orderings, reporting 0.0–0.7% hallucination at about 24% abstention in the held-out audit.
Why it matters: An ICML paper gates abstention on answer instability across repeated evidence orderings, and ships a training-free open implementation.
A German district court ruled Google is directly liable for AI Overviews content after one overview wrongly linked two publishers to fraud, and the cited linked sources did not contain the statements.
Why it matters: A Munich court's preliminary injunction holds Google liable for false content in AI Overviews, on the logic that rewriting information in its own words makes it Google's own speech.
Google is upgrading NotebookLM to Gemini 3.5, letting users start a research project by asking topic questions and use Google Search to find relevant sources, while the RSS snippet does not disclose details about the cloud computer feature.
Why it matters: With Gemini 3.5, NotebookLM accepts a topic directly and has Google Search find the sources, moving the start of research from note sorting to picking a subject.
UIUC and Chroma released Harness-1, a 20B-parameter retrieval subagent trained with reinforcement learning inside a stateful search harness, reporting 0.730 average curated recall across 8 benchmarks, 11.4 percentage points above the next-best open-source subagent and behind only Opus-4.6.
Why it matters: Harness-1 from UIUC and Chroma uses reinforcement learning to train a 20B-parameter retrieval sub-agent that remembers its last action during search before deciding the next query.
Google Research and Google Cloud introduced the Cross-Corpus Retrieval framework as Agentic RAG for Gemini Enterprise Agent Platform, using a multi-agent workflow to plan, rewrite, route, and iteratively search multiple data sources, with up to 34% higher accuracy than standard RAG on factual datasets.
Why it matters: Google Research and Google Cloud split retrieval across multiple agents on the Gemini enterprise agent platform, beating conventional RAG by up to 34% accuracy on factual datasets.
NVIDIA released Nemotron-3-Ultra-550B-A55B-BF16 with 550B total parameters, 55B active parameters, a 1M-token context window, and minimum hardware listed as 8x H200, 16x H100, or 8x GB200/B200/GB300/B300.
Why it matters: NVIDIA's Nemotron-3-Ultra activates 55B of its 550B parameters per pass, carries a 1M token context, and needs at least 8 H200s to run.
The UK CMA requires Google to let website owners exclude content from AI Search features, including AI Overviews, and prevent that content from being used for fine-tuning Google’s AI models.
Why it matters: The UK competition regulator told Google to let publishers pull their content out of AI search overviews and block it from fine-tuning its models, giving content owners a say over how their data is used.
Yi Tay served as a modeling co-captain for Gemini Deep Think when it reached IMO gold-medal level, co-founded Reka AI in 2023, and returned to Google DeepMind after 639 days, while the article also notes his 2012 Trinity classical piano associate diploma.
Why it matters: Yi Tay was co-lead of modeling when Gemini Deep Think reached IMO gold-level results, co-founded Reka AI, and returned to Google DeepMind after 639 days.
Glean crossed $300 million in annual revenue and tripled its top line after tech giants entered enterprise AI search; the post does not disclose margins, customer count, or the specific budget-cutting mechanism.
Why it matters: Glean tripled revenue to $300M in a year, and with tech giants entering enterprise AI search its main pitch has shifted to helping customers cut AI budgets.