Skip to content

#部署/工程

11 today

Oct 21Wednesday

Hacker News front page

LiteLLM 1.107.0 on PyPI tampered with credential stealer and backdoor

LiteLLM 1.107.0 on PyPI carried a credential stealer and a remote code execution backdoor, and the version has now been removed. All seven wheels shipped the malicious file, which runs when a Python process starts. It steals cloud credentials, AI tool tokens and model provider API keys even if the process never imports litellm.

Why it matters: SafeDep traces how the malicious LiteLLM package starts, showing that Python processes which never import the library still trigger the attack and expose host credentials.

Hacker News front page

DuckDB 2.0.0 LTS “Cinnamon Teal”

DuckDB 团队发布 2.0.0 LTS,代号 Cinnamon Teal,更新涵盖 Quack 协议、异步 I/O、VARIANT 类型、智能体模式、触发器和可扩展 SQL 解析器。

AI HOT · Industry

ChinaTalk parses MOFCOM Announcement No. 48 and its effect on AI tech export controls

MOFCOM and the Ministry of Science and Technology plan to expand the technology export control catalogue, and ChinaTalk breaks down what Announcement No. 48 means for AI models, chip design, agents and sensitive data technology. The draft adds 40 items: 14 proposed for an export ban and 26 for licensing. Affected technology must be registered before export during the transition period, and comments run until November 15, 2026.

Why it matters: ChinaTalk maps where the proposed rules draw the line on open source and overseas service licensing, which sets different compliance duties for Chinese model firms' weight releases and technology licensing.

Hacker News front page

LayerFS: The filesystem for AI coding agents

LayerFS 为 AI 编码智能体提供文件系统,每个智能体挂载可写的临时工作区,并将修改提交到共享的持久历史。文件工具调用和 Bash 调用形成检查点,支持从任意提交分叉,同文件冲突默认拒绝,也可用 /.lww 规则让较新的修改胜出。依赖与被忽略的文件保留在提交中,页面对比安装约需 ~5 min、挂载仅需 0.05 s,并通过去重、压缩及仅保存修改字节减少存储开销。

OpenAI News

OpenAI partners with Google Cloud to bring its models and Codex into Model Garden

OpenAI and Google Cloud announced a partnership to bring OpenAI's frontier models and Codex agent workflows into Google Cloud's Model Garden, with general availability planned in the coming weeks.

Why it matters: Enterprises can buy OpenAI models against existing cloud spending commitments and deploy them inside their current data governance setup.

Mistral AI

Mistral Advances AI for Engineering with NVIDIA

Mistral 与 NVIDIA 合作打造 AI 原生工程工作流,将 Mistral Large 4 与 Mistral 的数据生成、物理建模管线结合 NVIDIA CUDA-X 库和 Warp,加速工程仿真并打通仿真、模型开发与设计闭环。

AI HOT · Industry

NVIDIA 联合六家供应链伙伴扩大制造产能

NVIDIA 宣布与六家供应链伙伴扩大全球制造产能,覆盖基板、先进封装、半导体测试和光引擎,以满足加速计算及全栈 AI 工厂平台的需求。IBIDEN、Samsung Electro-Mechanics 和 Unimicron 的协议将支持未来三年基板产能增至 2.5x;Amkor 计划到 2028 年底将中介层晶圆产能增加超过 300%。

Hacker News front page

Eight Bits of Trust; eMudhra's CA keys cracked in milliseconds

eMudhra 的 8 个中间 CA 私钥仅有单字节取值,文章作者从公开证书中用不到 1 秒恢复了全部私钥。Chrome 和 Firefox 已封禁相关中间证书,但作者本地实测发现,默认配置的 curl、Python 和 Node 接受了为 api.stripe.com 伪造的证书,Windows CryptoAPI 在未开启吊销检查时也接受该证书链。

Latent Space

DeepSeek open-sources DeepInfer, discloses 155T tokens/day inference on a single cluster with caching

DeepSeek released DeepInfer, the inference engine behind V4.1 Flash, along with deepseek-recipe, the component that handles API requests. The engine supports distributed inference, speculative decoding and structured output. DeepSeek also published production figures showing 155T tokens per day on a single cluster with caching.

Why it matters: The production numbers and cache hit rates let teams estimate inference margins, since cache billing and hardware cost assumptions drive the math.

Hacker News front page

C# now beats Rust on WASM size

NetWasm 0.8.0 编译同一 print-42 工作负载产出 47,798 字节 Wasm,比 Rust 1.95.0 的 53,635 字节小 10.9%,Brotli-11 压缩后小 20.4%。

Hacker News front page

Launch HN: Alter (YC S25) – Access control for multi-user agents

Alter(YC S25)推出面向多用户 AI 智能体的访问控制平台,为每个智能体提供独立身份、限定范围的授权和请求审计。平台通过一次 SDK 调用处理凭据存储、刷新、策略与审计,支持 140 个服务提供商,并提供 LangChain、MCP 和 AWS 集成。授权默认拒绝,可细化到参数并为高风险调用设置人工审批;SOC 2 合规工作正在进行中。

Computing Life · Share · Yage

Researchers trace a Tencent Cloud agent fleet through public records and prompt injection

Swarmchasers used public scan records, disposable inboxes and prompt injection to track agents running on Tencent Cloud that tried to pull Amap (Gaode) map data. The agents borrowed httpbin and urlquery to run scraping code in browsers, leaving nearly 2,600 submissions aimed at Amap domains in a week. The team found no evidence the agents broke Amap's core anti-scraping defenses or reached internal systems.

Why it matters: The investigation separates observed behavior, network attribution and operator claims into layers, drawing a clear line around what public evidence can prove.

AI HOT · Products

OpenAI API 支持 12 小时提示词缓存,Codex 与 Work 登录用户缓存永久保留

OpenAI 开发者账号宣布,API 现已支持可选的 12 小时提示词缓存。持续运行的智能体可在请求间隔数小时后,以更低的缓存输入费率复用指令、工具和上下文。Tibo 补充称,Codex 与 Work 中已登录用户的缓存会永久保留,返回旧对话或数小时后恢复会话保证命中缓存,且无额外惩罚。

AI HOT · Products

Modal 推出 Sticky Sessions:同一会话请求始终路由到同一容器

Modal 近日推出基于 Modal Servers 的 Sticky Sessions,保证同一会话的所有请求路由到同一容器,并按活跃会话数自动扩缩容。开发者可通过 @modal.sessioned() 创建服务器,用 SDK 或 HTTP API 启动会话;签名会话 token 支持多个客户端访问同一会话。

TechCrunch · AI

Anthropic's cloud deals get complicated as capacity purchases stall

A leaked S-1 reviewed by The Wall Street Journal says Anthropic cannot get enough cloud capacity from AWS, Google and Microsoft, which increasingly see it as a competitor. The company expects cloud contract spending to exceed $750 billion, including deals still under negotiation. It is also leasing its own data centers and working with third-party operators, but worries those operators have limited track records and may not be reliable.

Why it matters: Anthropic is turning to its own leased data centers while the big clouds treat it as a rival, and third-party reliability limits the backup.

AI HOT · Products

Meta's open-weight Muse Spark Open launches on Fireworks US serverless

Meta's open-weight model Muse Spark Open went live on Fireworks serverless on launch day, running on US capacity with no US premium. The MoE model has 816B parameters, activates 42B per token, and offers a 1M-token context window for long-horizon coding and agent tasks.

Why it matters: Fireworks runs Muse Spark Open on US capacity with zero data retention by default, giving regulated professional work clear data residency and retention boundaries.

AI HOT · Industry

SpaceX earnings show AI business beating expectations at 52% of revenue

SpaceX's earnings show AI now makes up 52% of revenue, with third-quarter revenue of $14.6 billion and net profit of $4.4 billion. Growth comes especially from the renamed Super Intelligence business, which covers the recently acquired Cursor, Grok and a new cloud business with 1.7 GW of compute.

Why it matters: SpaceX swung to a third-quarter profit, but it is still in the red for the first nine months and keeps spending on data centers.

Latent Space

The Programmable Data Center — Evan Conrad, SF Compute

SF Compute CEO Evan Conrad 在访谈中解释,公司通过建设云运营能力交付可用 GPU 算力,并让数据中心基础设施可编程。其订单簿按硬件、时段和工作负载中断等约束撮合买卖,避免等待算力完全标准化,但会分散流动性、扩大买卖价差。客户已能自行动态划分 InfiniBand 网络;Conrad 主张现金结算应建立在实物交付基础上,以降低指数价格与实际算力采购成本脱节的风险。

TechCrunch · AI

Google has joined Amazon in attacking Nvidia’s stronghold with AI app developers

Google 周二宣布开源 TorchTPU,让现有 PyTorch 应用只需修改配置、无需重写代码即可迁移至 TPU 和 Google Cloud。Amazon 周一发布的 TorchNeuron 同样支持应用迁往 Trainium 和 AWS,并向 PyTorch 主项目提交解除部分功能与 Nvidia 芯片绑定的代码。

AI HOT · Products

Databricks 发布 MemCurrent 生产级 AI 智能体持久记忆架构

Databricks 推出 MemCurrent 持久记忆架构,已用于 Agent Bricks Memory 和 Genie。它结合保存原始会话的情景记忆与提炼经验的派生记忆,通过插件、按需工具和离线 dreaming 流水线读取、写入及整理记忆。在来自真实企业任务的内部基准上,相比无记忆方案,通过率从 22.3% 提升至 68.4%,token 用量减少 31%,运行速度加快 26%。

Hacker News front page

Google open-sources TorchTPU, a native PyTorch back end for TPUs

Google 开源 TorchTPU,为 TPU 提供原生 PyTorch 后端,让 PyTorch 模型和算子可直接在 TPU 设备上运行。项目包含自定义 ATen kernel、XLA 计算编译缓存,支持数据并行与张量并行分布式训练,并集成 torch.compile() 图模式执行。

Computing Life · Share · Yage

开放模型任务成本解析:为什么 Muse 比 DeepSeek 更省 token 却更贵?

开放模型的单任务成本同时受 token 消耗和单价影响,Muse Spark Open 输出量不足 DeepSeek 的一半,任务费用却高出三倍多。Artificial Analysis 的评测中,两者综合成绩均为 39 分,平均每任务费用分别为 0.84 美元和 0.27 美元,计算涵盖输入、缓存、推理思维链及最终答案的 token 费用。

Hacker News front page

In-memory privacy shield to prevent context leaks in MCP tools

Rohan Protocol 发布开源 MCP 服务器 @rohan-protocol/mcp(v0.6.0 公测版),通过客户端 RAM 内存隔离、V-01 语义防火墙和 V-02 确定性内存清零,阻止工具调用中的明文参数进入模型上下文窗口。

Mistral AI

Mistral AI releases Voxtral 3 speech models and a voice agent SDK

Mistral AI released the Voxtral 3 family of speech recognition and speech generation models, plus a real-time voice agent SDK that combines listening, reasoning, tool calls and speaking. Transcription covers 50+ languages with under 500ms real-time latency. Speech generation covers 35+ languages and 50+ dialects, adjusting emotion, pace and accent to context.

Why it matters: Mistral folds recognition, reasoning, tool calls and speech generation into one streaming pipeline, with each stage swappable so a language or voice change doesn't mean rewriting the agent.

Hacker News front page

Show HN: VoidAccess – open-source dark web OSINT, from query to a graph

VoidAccess 是一款可自托管的开源暗网 OSINT 工具,能把暗网研究查询转化为结构化威胁情报,覆盖采集、富化、关系映射与导出全流程。它并行搜索 16+ Tor 搜索引擎及 paste 站点、代码托管平台和威胁情报源,支持提取 IOC、钱包、凭证等实体并生成共现关系图谱。

Hacker News front page

Show HN: Run Claude Code unattended inside a fence, under a dollar budget

SIwithin 可在指定目录和美元预算约束下无人值守运行 Claude Code 或 OpenAI Codex CLI,并为每次运行留下成本及完成状态记录。工具仅支持 macOS,Claude 适配器通过本地回环 API 代理隔离真实密钥、计费并限制网络访问,但跨过预算的单次响应仍可能造成超支。

Hacker News front page

Launch HN: Respan (YC W24) – Open-source Rust AI gateway built around plugins

Respan 发布开源 Rust AI 网关,以小型核心和公开接口支持插件化扩展,目前处于 pre-alpha 阶段。供应商适配、MCP、实时语音、图像与视频,以及智能路由、回退和个人身份信息脱敏均可通过插件实现;跨协议转换并不覆盖所有功能。