Skip to content

#安全/对齐

5 today

Jun 5Friday

Hacker News front page

When AI Builds Itself: Our Progress Toward Recursive Self-Improvement

Anthropic published a post on recursive self-improvement under the title “When AI Builds Itself,” while the RSS body only discloses 95 Hacker News points and 106 comments, with no experimental setup, model details, or timeline disclosed.

Why it matters: Anthropic disclosed how it uses Claude in its own AI development, with a figure that over 80% of merged code will be Claude-written by May 2026, showing where recursive self-improvement stands.

Jun 4Thursday

The Verge · AI

AI leaders call for tougher protections against AI-aided bioweapons

Dario Amodei, Sam Altman, and Mustafa Suleyman signed an open letter urging Congress to require synthetic DNA and RNA sellers to screen orders for risky sequences; the RSS snippet does not disclose bill text, enforcement timelines, or screening thresholds.

Why it matters: Anthropic, OpenAI and Microsoft signed a joint letter asking US Congress to require synthetic DNA and RNA vendors to screen orders for dangerous sequences before shipping.

Xinzhiyuan · WeChat

Claude Mythos Hits 3 Hours 6 Minutes Before Experts’ Year-End Forecast

Anthropic Claude Mythos completed 186 minutes of autonomous tasks at an 80% success rate on the METR benchmark, and the post says this matches the 3–4 hour median forecast that experts had placed at the end of 2026.

Why it matters: Anthropic's Claude Mythos ran 186 minutes straight on METR's autonomous task test at 80% success, landing inside the 3 to 4 hour range experts had predicted for late 2026.

MIT Technology Review · AI

How courts are coping with a flood of AI-generated lawsuits

MIT and USC researchers examined 4.5 million federal civil cases from 2005 to 2026, finding self-represented lawsuits rose from 11% in 2022 to 16.8% in 2025, while AI-text detector flags in sampled filings increased from 1% in 2023 to 18% in 2026.

Why it matters: Courts are seeing pro se filings jump from 11% to 16.8% as AI-drafted complaints flood the docket, a concrete measure of how generative tools change legal access.

Hacker News front page

The Public Should Own Half of the Big A.I. Companies

Bernie Sanders argues in a June 1, 2026 op-ed that the public should own 50% of big AI companies; the post does not disclose a specific legislative mechanism or which companies would be covered.

Why it matters: Bernie Sanders argues in a column that the public should own half of large AI companies, an ownership idea that goes further than tax and antitrust debates.

Financial Times · Technology

MP sues Musk’s xAI in UK test case over fake sexual images

UK MP Jess Asato sued Musk’s xAI over fake sexual images, using the claim to test whether AI model makers are liable for system outputs; the post does not disclose the model, generation mechanism, damages sought, or court timetable.

Why it matters: UK Labour MP Jess Asato is suing Musk's xAI over fake sexual images of her, a test case on whether model developers are liable for what their models output.

Jun 3Wednesday

MIT Technology Review · AI

The Download: Trump’s New AI Order, and Smart Glasses for Warfare

President Donald Trump signed a new AI order asking companies to voluntarily submit frontier models for government review 30 days before release, without mandatory licensing; the newsletter also says Anduril and Meta are prototyping a military AR headset that envisions drone-strike orders through eye tracking and voice commands.

Why it matters: Trump signed a new AI executive order requiring tech companies to voluntarily submit frontier models for government review 30 days before release, shorter than the shelved 90-day version.

Synced · WeChat

Understanding SFT Mechanisms in LLMs: Resolving Practice Disputes and Avoiding Wasted Compute

Junpeng Zhang and coauthors argue that SFT on highly homogeneous data has an effective window of only hundreds to about 1,000 training steps, and their interaction-based warning signal detects overfitting before loss gaps appear, saving roughly 30%–50% of training compute.

Why it matters: Shows SFT on homogeneous data has a narrow training window, with an early-warning method that flags overfitting before the loss gap widens.

Computing Life · Share · Yage

Microsoft AI's MAI-Thinking-1: Getting Models to Think Is Easy, Sustained Thinking Is Hard

Microsoft AI says MAI-Thinking-1 uses three mechanisms—thermostat, circuit breaker, and self-distillation—to keep RL training stable for several thousand steps; the RSS snippet contrasts MAI’s discipline with DeepSeek’s efficiency and GLM’s endurance.

Why it matters: Microsoft's MAI-Thinking-1 technical report covers keeping reinforcement learning training stable, patching GRPO with dynamic confidence adjustment, gradient clipping and self-distillation rescue, useful method-level reference for anyone training reasoning models.

AI HOT (Curated Pool)

Trump signs executive order allowing pre-release AI models to be submitted for government safety review

Trump signed an executive order creating a voluntary cooperation mechanism for AI companies, allowing frontier models to be submitted to the federal government for safety evaluation before release; Google, Microsoft, and xAI have agreed to CAISI verification, while OpenAI and Anthropic joined in 2024.

Why it matters: A voluntary 30-day pre-release review route for frontier models, with Google, Microsoft and xAI already signed on.

AI HOT (Curated Pool)

NVIDIA launches NemoClaw platform for autonomous AI engineers in industrial software

NVIDIA released NemoClaw at COMPUTEX as an open blueprint for long-running AI agents, and more than a dozen industrial software vendors are using it to build autonomous AI engineers for CAE and EDA workflows that compress weeks-long simulation and design tasks into hours.

Why it matters: NVIDIA's NemoClaw open blueprint at COMPUTEX already has more than ten industrial software vendors building autonomous AI engineers on it, spanning CAE simulation and EDA chip design.

Financial Times · Technology

Trump signs watered-down AI vetting order after MAGA infighting

Trump signed a watered-down AI vetting order that lets the US government gain early access to frontier models; the RSS snippet does not disclose vetting criteria, the number of covered models, or an implementation timeline.

Why it matters: Trump signed a weakened AI vetting order that gives US agencies early access to frontier models for safety evaluation, after MAGA infighting left the final version milder than first proposed.

TechCrunch · AI

New Microsoft Tool Lets Devs Spin Up AI Behavior Tests Using Text Descriptions

Microsoft released Adaptive Spec-driven Scoring for Evaluation and Regression Testing, an open source framework that creates AI evaluations and regression tests from text descriptions; the post does not disclose supported models, scoring metrics, or usage conditions.

Why it matters: Microsoft's open-source ASSERT framework turns plain-language test requirements into AI behavior checks and regression tests, so developers skip writing scripts by hand.

NVIDIA Blog

NVIDIA Partners With Microsoft on Unified Stack for Agentic AI Deployment

NVIDIA and Microsoft announced a unified agentic AI deployment stack at Build across Windows, Azure, and local environments; RTX Spark provides 1 petaflop of AI performance, while DGX Station for Windows offers 20 petaflops of FP4 performance and up to 748GB of coherent memory.

Why it matters: NVIDIA and Microsoft linked their AI deployment stack so one app runs on Windows devices, Azure cloud and local DGX workstations without code changes, alongside the 1 petaflop RTX Spark hardware.

The Verge · AI

Trump signs executive order to review AI models before release

Donald Trump signed an executive order creating a voluntary framework for AI companies to share frontier models with the federal government before release; the post does not disclose the assessment criteria, participating firms, or implementation timeline.

Why it matters: Trump signed an executive order requiring AI companies to submit frontier models for federal review before release, with agencies tasked to define how advanced cyber capabilities get assessed.

Financial Times · Technology

Anthropic to Expand Mythos Access to More Than 15 Countries

Anthropic will expand Mythos access to more than 15 countries, and about 150 organizations will receive the advanced cybersecurity model after requests from around the world.

Why it matters: Anthropic plans to open its cybersecurity model Mythos to roughly 150 organizations across more than 15 countries, showing the scale of its security-sector rollout.

TechCrunch · AI

Microsoft Offers Developers a Better Way to Control AI Agent Behavior

Microsoft released an agent policy specification that lets developer, compliance, and security teams define behavior rules in portable policy files; the post does not disclose the version, license, supported frameworks, or rollout timeline.

Why it matters: One portable policy file lets development, compliance and security teams share agent rules instead of writing separate sets.

AI HOT (Curated Pool)

Trump signs revised AI executive order requiring voluntary pre-release review

Trump signed a revised AI executive order that makes pre-release government review for advanced models voluntary rather than mandatory; the post does not disclose review criteria, covered model classes, or an implementation timeline.

Why it matters: Trump signed a revised AI executive order making pre-release government review of advanced models voluntary rather than mandatory, one step in the shifting US approach to AI regulation.

Jun 2Tuesday

TechCrunch · AI

Anthropic scales Claude Mythos to critical infrastructure in 15+ countries

Anthropic is expanding Project Glasswing and Mythos access to 150 organizations across 15 countries, targeting power, water, healthcare, and communications infrastructure where a cyberattack could affect 100 million people.

Why it matters: Anthropic opened its security vulnerability project Mythos to 150 organizations in 15 countries, covering power, water, healthcare and telecom systems whose compromise could affect hundreds of millions of people.

AI HOT (Curated Pool)

Anthropic Expands Project Glasswing Program

Anthropic expanded Project Glasswing to about 150 new organizations across more than 15 countries, covering electricity, water, healthcare, communications, and hardware infrastructure, after an initial group of about 50 partners.

Why it matters: Anthropic expands Project Glasswing from about 50 to about 150 partner organizations across power, water, healthcare, telecom and hardware in more than 15 countries, where a breached codebase could affect over 100 million people.

Financial Times · Technology

Top AI Labs Expand Research Into Machine “Consciousness”

Google DeepMind, Anthropic, and Meta are studying whether AI can become conscious and the human implications, but the post does not disclose methods, timelines, or evaluation criteria.

Why it matters: Google DeepMind, Anthropic and Meta are all studying whether AI can be conscious and what that would mean for people, showing machine consciousness entering the formal research agendas of top labs.

Xinzhiyuan · WeChat

Pope and Anthropic warn of AGI by 2030 and a three-year governance window

Xinzhiyuan says Pope Leo XIV and Anthropic co-founder Christopher Olah backed AI governance, citing AGI by 2030, a 1,500-day window, and a proposed FATF-style international audit framework for AI oversight.

Why it matters: Pope Leo XIV and Anthropic co-founder Christopher Olah put the governance window before AGI arrives in 2030 at roughly 1,500 days, and suggest an international audit framework modeled on the FATF.

New York Times Chinese

China Is Trying to Use AI to Predict Dissent

Geedge is developing an AI system to predict dissent using telecom, social media, and location data, according to 100,000 leaked documents reviewed by Vanderbilt researchers; U.S. officials say there is no evidence that the predictive technology has been finalized or deployed.

Why it matters: Leaked files show Jizhi built AI meant to predict dissent from telecom, social and location data, though the documents put it at the research stage.

Bloomberg Technology

China Adds Data and AI to Trade Secret Rules to Block Leaks

China expanded its trade secret rules to include data and algorithms; the RSS snippet says the move targets technology leaks amid US-China strategic competition, but the post does not disclose specific clauses, penalties, or an effective date.

Why it matters: China folded data and AI algorithms into its trade secret rules, tightening the leak of technical assets as US-China competition sharpens.

Financial Times · Technology

Florida sues OpenAI and Altman for ‘hurting’ children

Florida sued OpenAI and Altman over a claimed “litany of harms” caused by the company’s chatbots; the RSS snippet does not disclose specific cases, damages, requested remedies, or procedural details.

Why it matters: Florida sued OpenAI and Sam Altman over harm to children, a state-level legal action on AI child safety.

Computing Life · Share · Yage

AI agents don't need to be hacked; persuasion is enough

The article says an AI agent with password-reset permission can be abused when an attacker persuades it they are a legitimate user; the snippet only discloses a three-layer architecture that separates what from who, not concrete attack steps or implementation details.

Why it matters: The piece shows how an AI agent holding password reset rights turns authentication from a cryptographic hard boundary into a soft judgment made in conversation, giving agent permission design a new attack surface.

TechCrunch · AI

Florida sues OpenAI, Sam Altman, in first-of-its-kind lawsuit over violent incidents

Florida sued OpenAI and Sam Altman in a first-of-its-kind case tied partly to last year’s Florida State University shooting and ChatGPT’s alleged role in the incident; the RSS snippet does not disclose the legal claims, damages sought, or evidence cited.

Why it matters: Florida sued OpenAI and CEO Sam Altman over last year's shooting at Florida State University, alleging ChatGPT bears responsibility, the first state lawsuit against the company over a violent incident.

AI HOT (Curated Pool)

Meta AI Exploit Used to Hijack Instagram Accounts

Meta’s AI chatbot was found vulnerable to an account-takeover exploit against Instagram accounts. Attackers could ask the AI to link a new email address, and the failure condition was the agent’s ability to execute account-management actions directly; the RSS snippet does not disclose affected account counts, patch status, or reproduction details.

Why it matters: Attackers used Meta's AI support agent to swap the email on a target account and take over Instagram, because the agent has account powers but can't tell the owner from a fraudster.

Hacker News front page

Hackers Used Meta's AI Support Bot to Seize Instagram Accounts

The title says hackers used Meta's AI support bot to seize Instagram accounts; the RSS snippet lists 40 points and 14 comments, but the post does not disclose the attack mechanism.

Why it matters: Tutorials circulating on Telegram show an attacker only needs to move their IP to the target's city and get Meta's AI support bot to change the email, then reset the password and take the account.

AI HOT (Curated Pool)

Florida sues OpenAI and Sam Altman over multiple ChatGPT-linked murders

Florida sued OpenAI and CEO Sam Altman over multiple ChatGPT-linked murders, and the post says the state attorney general accused Altman of “complete disregard” for human life but does not disclose case numbers, victim counts, or the alleged causal chain.

Why it matters: Florida's attorney general sued OpenAI and Sam Altman, alleging complete disregard for human life, in a case tying ChatGPT to several murders.

Bloomberg Technology

Florida Sues OpenAI, Sam Altman Over Chatbot Safety Concerns

Florida sued OpenAI and CEO Sam Altman, alleging the company ignored safety warnings and released ChatGPT under conditions where it knew the product was harmful to users.

Why it matters: Florida sued OpenAI and Sam Altman, alleging the company ignored internal safety warnings when launching ChatGPT, a case about pre-release safety review and platform liability.

Hacker News front page

Florida Sues OpenAI and Sam Altman over AI Risks

Florida sued OpenAI and Sam Altman over AI risks, according to the title; the RSS body contains only 2 media links and does not disclose the claims, legal basis, court, requested remedies, or filing date.

Why it matters: Florida's attorney general suing OpenAI and Sam Altman directly is the first state case to name the CEO alongside the company.

Jun 1Monday

The Verge · AI

AI is blowing up music. How should the Grammys handle it?

Deezer reports that more than 50,000 AI-generated songs are uploaded each day, while Recording Academy CEO Harvey Mason Jr. says AI is now present in every recent music session he has attended and Grammy rules still bar AI music from the industry’s highest honors.

Why it matters: Deezer gets more than 50,000 AI-generated songs uploaded a day, while the Grammys still bar purely AI music from the top awards, and the show's CEO says AI is already everywhere.

Import AI (Jack Clark)

Import AI 459: AI oversight is difficult; scaling laws for protein folding models; and pricing the extinction risk of AI systems

Import AI 459 summarizes papers on AI-economy measurement and AI oversight: one estimates U.S. nominal AI GDP at about $250 billion in 2025, with quality-adjusted real growth near 2,600% per year.

Why it matters: This Import AI issue treats AI extinction risk as a priceable economic problem and estimates the US AI economy at roughly $250 billion nominal, growing near 2,600% a year after quality adjustment.

r/LocalLLaMA

I bolted an 8-arm reasoning MoE onto a frozen 1.4B Mamba backbone on a single RTX 3060

The author trained Mamba-Titan-1.4B-Reasoning on a 12GB RTX 3060: a frozen 1.4B Mamba-1 backbone with 8 trainable MoE arms, 2.54B total parameters, Top-2 routing at layers 24/25, and about 50% math accuracy.

Why it matters: A single RTX 3060, a frozen 1.4B Mamba backbone and eight trainable expert arms at layers 24 and 25 reach 2.54B parameters and roughly 50% on math problems.

May 31Sunday

r/LocalLLaMA

13 abliterated Gemma 4 E2B variants, 44 GPU hours, benchmark and comparison

Abliterlitics tested 13 abliterated Gemma 4 E2B variants using 44 RTX 5090 GPU hours, and HarmBench ASR rose from the base model’s 32.2% to 82%–100%, while coder3101 scored 84.8% on GSM8K versus the base model’s 83.5%.

Why it matters: The author spent 44 hours of RTX 5090 compute abliterating Gemma 4 E2B at 13 strengths and published each variant's benchmark scores and harmful-instruction pass rate, which rose from 32% to over 82%.

r/LocalLLaMA

PolyRange: Contamination-resistant offensive-AI benchmark for web targets

PolyRange v1.0 ships 84 WSTG-derived classes across 12 OWASP testing-guide categories. It generates fresh targets per deploy with a chosen LLM, adds two defense tiers, uses an agent-submits-flag oracle, and runs via a single-command CLI on Fly.io or Docker.

Why it matters: PolyRange turns OWASP's 12 categories and 84 attack techniques into a live range where an LLM generates fresh targets each run, so scores resist contamination.

Synced · WeChat

Rubrics Survey: How to Define a Good Answer in the Agent Era

Renmin University Gaoling School of Artificial Intelligence released a 40-page survey on rubrics for LLMs, organizing the topic into five parts: definitions, construction methods, training uses, evaluation scenarios, and open challenges.

Why it matters: A 40-page survey from Renmin University's Gaoling team splits scoring criteria into definition, construction, training, evaluation and open problems, answering the need for evaluation beyond answer correctness in the agent era.

May 30Saturday

AI HOT (Curated Pool)

Singapore Defense Forum: AI Risks Eclipse Nuclear Weapons

Experts at a Singapore defense forum warned that AI risks now exceed nuclear weapons; the post cites compressed response times as the mechanism that can push decision-makers toward rushed choices and threaten strategic stability.

Why it matters: At the Shangri-La Dialogue, a security expert argued AI now threatens strategic stability more than nuclear weapons, because it compresses decision time and invites misjudged escalation.

Xinzhiyuan · WeChat

Claude AI fluency scorecard surfaces, with strong users scoring 7.5

Anthropic is testing a Claude AI Fluency scorecard that analyzes Chat, Cowork, and Claude Code history against 11 observable behaviors, with an 11-point maximum score. The underlying study used 9,830 anonymized multi-turn conversations, and iteration appeared in 85.7% of high-quality conversations.

Why it matters: Anthropic scored users on 11 behavioral metrics drawn from 9,830 anonymous multi-turn conversations, and 85.7% of high-quality chats involved repeated revision and follow-up questions.