Skip to content

#部署/工程

11 today

Oct 29Thursday

AI HOT · Models

Mistral Large 4 (Le Chonk) lands on Hugging Face with open weights for a ~1T-parameter multimodal model

Mistral Large 4 (Le Chonk) is now on Hugging Face with open weights. It uses a multimodal, multilingual MoE architecture with text and image input and text output. The model has about 1T total parameters, 49B active parameters and a 1M-token context window, ships in official FP8 and NVFP4 versions, and its license restricts model-as-a-service businesses.

Why it matters: Open weights and several deployment paths let security teams set their own usage policy and runtime for vulnerability reproduction and patching work.

The Verge · AI

Anthropic files for Nasdaq listing, asking Wall Street to believe in AGI

Anthropic has filed its S-1 to list on Nasdaq. A Decoder interview breaks down the financials and the business risk of chasing AGI. A SemiAnalysis analyst traces where Anthropic's revenue comes from and how its customers spend, and notes that future growth depends on enterprise demand widening beyond coding.

Why it matters: It separates Anthropic's disclosed revenue and customer spending from the growth assumptions its listing case rests on.

MIT Technology Review · AI

We urgently need to monitor AI agents’ actions in real time

AI 智能体需要实时行动监控,但两位作者对四个广泛使用的智能体框架开展的研究发现,现有框架缺少支撑安全监督的关键记录。缺口包括持续有效的智能体身份标识、人类批准与干预记录,以及权限和记忆变更记录,妨碍识别未经授权的行动。作者主张通过 OpenTelemetry 等基础设施补足行动记录,同时指出,用于记录决策过程的 CoT 是否忠实反映模型决策、决策置信度能否可靠衡量,仍是开放研究问题。

The Verge · AI

AI has come for Arizona’s water

亚利桑那州居民围绕 AI 数据中心扩张发起跨党派反对行动,水资源短缺与地方经济回报成为争议核心。Beale Infrastructure 的 Project Blue 在图森拒绝土地并入后继续建设,并改用闭环空气冷却,开发商与反对者对其间接耗水影响存在分歧。

Hacker News front page

Bernstein – open-source governance layer for AI agents

Bernstein 是开源 AI 智能体治理层,v3.23.0 提供 53 个 CLI 适配器,采用 Apache 2.0 许可。它通过不含模型的确定性 Python 调度器并行运行智能体,按分解、隔离执行、验证、合并四阶段处理任务,仅合并通过验证的代码差异。

AI HOT · Products

OpenRouter 重建默认路由算法:TTFT 降低 16.9%,429 错误减少 67%

OpenRouter 更新默认服务商路由算法,将实际价格、延迟、吞吐量、可靠性和输出质量纳入选择,已启用模型的默认路由用户无需修改代码。一周实验显示,TTFT p50 降低 16.9%,吞吐量 p50 提高 16.3%,429 错误减少 67%,每请求成本增加 6.0%。会话仍固定到原服务商以保持缓存热度,用户也可通过 provider.sort 设置 price 保留低价优先路由。

AI HOT · Tips & opinions

OpenRouter tutorial: extracting tables from PDFs with an LLM

An OpenRouter tutorial sends a PDF plus a strict JSON schema to pull tables into rows with explicit data types. Field descriptions handle negative numbers in parentheses, footnotes and merged cells. Across 5 test PDFs, 2 of them scans, models that read the PDF directly extracted all 644 cells correctly, a result the post limits to this test set.

Why it matters: It pairs a strict row schema with field-level cleanup rules and catches dropped rows in otherwise normal responses using empty-result and truncation checks.

AI HOT · Industry

Alphabet Q3: annualized revenue hits $500B, Google Cloud revenue up 103%

Sundar Pichai posted Alphabet's Q3 results: annualized revenue run rate reached $500B and total revenue grew 25% year over year. Google Cloud revenue rose 103%, first-party model APIs handle nearly 32B tokens per minute, up 40% quarter over quarter. Search query growth was the highest in five years. He also cited Argon and Carbon as frontier leaders and the new world model Genie 4.

Why it matters: Alphabet's Q3 total revenue grew 25% year over year while Google Cloud revenue rose 103%, so cloud is growing faster than the company overall.

Hacker News front page

Big Tech's thirst for water is sparking a global resistance

加州大学研究估算,训练初版 ChatGPT 背后的大语言模型耗水 18.5 万加仑,超大规模数据中心每天可消耗 100 万至 500 万加仑水,相当于 1 万至 500 万人口城市的用水量。

Latent Space

Why Agents Love Supabase

Supabase 通过简化本地开发、提供声明式数据库结构和近数据库计算,减少 AI 智能体构建与运行应用的后端配置工作。无需 Docker 的本地运行环境已进入 alpha,声明式结构让智能体在 Git 中读取和修改目标数据库状态,处于 private alpha 的 Supabase Compute 支持在数据库附近运行容器。

AI HOT · Products

Microsoft opens Copilot harness through Foundry for multi-model agent development

Microsoft has opened the Copilot harness through Microsoft Foundry, giving developers and enterprises a fully managed way to build multi-model agents. The runtime orchestration layer, built by GitHub's engineering team, supports 20+ frontier models, bring-your-own-key, MCP, agent skills and plugins, and routes each task to a suitable model.

Why it matters: The managed Copilot harness lets developers cut the upkeep of the agent runtime layer while keeping their choice of model.

Hacker News front page

Converge (YC S23) Is Hiring a Founding Platform Engineer

Converge 正在纽约招聘首位平台工程师,负责为自动投放和扩展广告的 AI 智能体构建平台,薪资 $180K-$240K 加 0.3%-0.5% 股权。公司现有 13 人、3 名产品工程师,系统已处理 $6 billion 年收入规模、每月摄取 20 TB 数据、峰值 10,000 jobs/s。

AI HOT · Tips & opinions

How to keep coding with OpenRouter after Claude Code hits its usage limit

Once Claude Code hits its plan's usage cap, you can keep using Claude models through OpenRouter and pay per token, outside the five-hour and weekly windows. Spending is then bounded by your account balance and budget instead.

Why it matters: It sets up a separate shell function that routes Claude Code through per-token billing on OpenRouter, while keeping the original plan command for when the quota resets.

Hacker News front page

Nvidia Nemotron 3.5 Transcribe: open ASR for 40 languages

NVIDIA 发布开放权重模型 Nemotron 3.5 Transcribe,在一个 checkpoint 中整合语音转写、说话人归属、翻译和音频问答,支持 40 种语言转写、31 种语言与英语互译及 13 种语言的说话人归属。

Computing Life · Share · Yage

对话状态该由谁托管:SGLang 押注推理引擎的设计取舍

SGLang 的统一交互运行时将推理引擎的基本单位从单次请求改为持续会话,以统一实时语音的轮次、打断和历史截断规则。分析指出,原生全双工更依赖引擎内的会话控制,级联架构主要获得接口与评测便利,前台语音加后台委派所需的异步任务能力尚未完成。状态常驻引擎会增加迁移成本,SGLang 目前不支持断线恢复,评估锁定风险还需检查会话接口的私有扩展及状态能否导出重建。

Oct 28Wednesday

Hacker News front page

Harvey raised 500M for legal AI, I built the same and open sourced it

CaseCite 是采用 Apache License 2.0 的开源自托管法律研究平台,支持文档问答、合同审查、起草及案例与法官研究。文档、索引和聊天记录保存在自有部署中,但 AI 功能会向配置的服务商发送问题和相关文本;要让文档文本留在内网,需同时自托管聊天模型和嵌入向量模型。

The Verge · AI

Voters in Texas agree: They hate data centers

得克萨斯州数据中心建设遭遇跨党派反对,水电、土地和税收争议成为中期选举议题。8 月民调显示,57 percent 的得州居民反对建设数据中心,数十个团体组成 We the People Texas 联盟,推动停止或延缓项目。州长 Greg Abbott 已宣布暂停许可并审查用水用电,但联盟批评审查未覆盖自建电源项目,已有许可的项目也仍在建设。

Computing Life · Share · Yage

实时语音智能体架构解读:两个选择和一层委派

实时语音智能体可按组件拆分、轮次判断和后台委派,分为级联、轮次式、原生全双工、原生前台加委派四类架构。级联便于日志审查和组件替换,原生全双工侧重自然交互,GPT-Live 则将即时接话与后台复杂任务分开,应用负责函数执行、权限检查和用户确认。选型应从场景中不能牺牲的要求倒推,文中团队为手机语音助手选择原生前台加委派,为桌面本地指令入口选择级联。

Hacker News front page

Hex Raises $100M

Hex 完成 $100 million 融资,估值为 $1.2B,由 PeakXV 和 137 Ventures 领投。公司同时推出从头重写的 Hex 4.0,以普通代码为基础,强调数据工作的上下文、控制与治理。重写旨在解决旧架构中智能体工具膨胀、外部智能体接入受限,以及计算引擎难以支持高速、高并发迭代工作流的问题。

Latent Space

How Anthropic ships the #1 LLM in the World safely: Separating the Brain from the Hands

Katelyn Lesse 与 Angela Jiang 在 Latent Space 访谈中讲解 Claude Platform 的工程设计,涵盖 Opus 5.5 发布、API 扩展和可靠托管智能体的构建。访谈重点包括模型、执行框架与沙箱的解耦,以及隔离、凭据保护、网络控制和跨上下文窗口维持任务进度。新录制的导言补充了 Anthropic 的 S-1、改进与投资循环及平台意义。

Latent Space

How Anthropic ships Claude with Claude: splitting an agent's brain from its hands

Anthropic's engineering and product leads explain how they build their own products on shared Claude Platform components, and how they coordinate model releases, safety and scaling. Managed Agents separate session logs and the runtime framework from the code execution sandbox, so a sandbox failure doesn't kill the whole session. Service credentials are stored separately and attached through a proxy. The Opus 5.5 release also involved API integration changes to prevent knowledge distillation, and customers running evals in their own frameworks fed back anomalous behavior.

Why it matters: Anthropic separates agent sessions from execution sandboxes, treating state persistence, failure recovery and credential isolation as distinct architecture problems.

AI HOT · Tips & opinions

LangChain open-sources the runtime behind its Content Studio design agent

LangChain released the runtime framework for Content Studio, its in-house design agent, and explained how design judgment, production tools and review flow plug into Slack. Built on Managed Deep Agents, Content Studio turns a single prompt into videos, social images, UI recreations and slide decks, all built as code. It has shipped over 3,000 assets, including more than 80 slide decks.

Why it matters: LangChain turns designer feedback into skills and checks, then splits brand judgment from execution with storyboard approval and async sub-agents.

Hacker News front page

We let our cloud agents query prod (with OIDC, not secrets)

Formal 使用 OIDC 为云端编码智能体提供可审计、受策略控制的生产数据与云基础设施访问,生产访问保持只读且需人工审批。智能体可通过 Slack 申请短期数据库权限,批准后授权限定到具体会话和数据库,请求日志关联智能体及发起工程师。

AI HOT · Products

Replit Cloud Agents 向 Pro 与 Enterprise 客户开放企业代码库贡献

Replit Cloud Agents 已向所有 Pro 与 Enterprise 客户开放现有代码库贡献功能,非技术人员可用自然语言提出修改。智能体在隔离云沙箱中运行应用、测试并修复改动,向 GitHub 提交 PR 或向 GitLab 提交 MR,附上截图和视频,并根据审查反馈继续修改。

Computing Life · Share · Yage

DeepSeek 开源 DeepInfer:单模型推理引擎为何常比通用引擎快

DeepSeek 开源的 DeepInfer 仅支持 DeepSeek-V4.1-Flash 离线批量推理,文章解析其性能优势来源与开源范围。GPUStack 同机测试中,DeepInfer 总吞吐比 vLLM 高 25.2%,首字延迟却为 4.28 秒对 2.04 秒,双方均关闭投机解码且未充分调优。

Hacker News front page

Show HN: Specification First Agentic Development Plugin and Prove

spec-first 提供规范优先的 AI 智能体开发插件,每项变更先审查规范,再在独立分支和 worktree 中实现,通过项目检查后才能提交。流程涵盖 create-spec、review-spec、apply-spec 和 deliver-spec,并将决策记录与恢复状态保存在文件中,支持将一系列规范并行构建后合入一个 pull request。

Oct 27Tuesday

Latent Space

Coding From the Himalayas With an Offline AI Agent

Rittika Jindal 在笔记本上通过 OpenCode 和 Ollama 运行 Qwen3.5 9B,断网后完成费用计算程序的修复,原有 5 项测试全部通过。教程给出预下载模型与项目依赖、限制为本地服务、检查断网状态及逐次批准编辑和命令的流程,作者也独立重跑测试并确认测试文件未改动。实测仅涉及一行累加逻辑修复,CSV 报告和日志分析器练习尚未完成离线运行,不能据此判断大型仓库任务的表现。

TechCrunch · AI

Opera introduces a new web standard to let users deploy AI locally in their browser

Opera 推出 WebAI 网络标准,让用户直接在浏览器本地运行 AI 模型,无需依赖云端。该功能已在 Opera One 提供早期预览,需用户主动启用,Opera GX 和 Opera Neon 将随后支持;兼容模型包括 Google 的 Gemma 和 Mac 上的 Apple 端侧基础模型。WebAI 支持本地文本生成、内容分类和信息关联理解,相关数据留在设备上,模型性能取决于设备硬件。

TechCrunch · AI

Nvidia backs Indian startup helping companies run AI models with fewer GPUs

Nvidia 参与印度创企 Simplismart 的 1400 万美元 B 轮融资,后者估值约 1 亿美元,其软件可优化模型部署,让企业用更少 GPU 运行 AI 模型。Simplismart 称已帮 AI 视频平台 InVideo 将 GPU 服务成本降低 56%,客户还包括 HeyGen、Higgsfield 和 Ema。其年化收入运行率过去六个月增长 14 倍,超半数收入来自美国。

Hacker News front page

There are now 5 inference providers for abliterated DeepSeek

AllModels 为 abliterated DeepSeek 模型提供统一接入层,目前已有 5 家推理服务商可用,涵盖 DeepSeek V4.1 Flash Abliterated 与 GLM 5.3 等模型。平台通过单一 OpenAI 兼容 API 路由请求,支持自动故障转移、按价格择优以及仅向支持多模态的服务商转发图像请求。

Computing Life · Share · Yage

Cerebras 推理那么快,为什么公共 API 上没有 Kimi K3?

截至10月25日,Kimi K3 仅在 Cerebras 企业专属模型目录提供,文章推测其权重常驻片上的部署需求使公共按量供给难以划算。Cerebras 技术博客的简化计算显示,权重与上下文缓存合计需要59片晶圆,但这不是已披露的实际部署配置。公开渠道尚无 Kimi K3 的第三方速度测试,模型输出提速也不直接加速文件读写和命令执行等工具调用。