Skip to content

Safety & alignment

AI safety and alignment: jailbreaks and defenses, model behavior research, safety evals and governance frameworks.

Latest picks

301–320 of 615

May 16Saturday

Hacker News front page

Waymo Recalls 3,800 Robotaxis After They Drive Into Flood Waters

Waymo recalled 3,800 robotaxis after the vehicles drove into flood waters, according to the title; the RSS snippet does not disclose incident counts, affected software versions, recall scope details, or the fix mechanism.

Why it matters: Waymo recalled about 3,800 robotaxis over a software flaw that sends vehicles into flooded road areas while they are reading the road.

AI HOT (Curated Pool)

Yann LeCun interview: LLM limits, AI's future, and a new startup path

Yann LeCun discussed LLM limitations on the Unsupervised Learning podcast, covering his 2027 forecast, AMI’s bet on world models, his reasons for leaving Meta, and major disagreements with Geoffrey Hinton and Yoshua Bengio over Turing Award-era views.

Why it matters: Yann LeCun said on a podcast that the large language model path has a ceiling, and explained why he is betting on world models after leaving Meta, giving a direct account of the split from a key figure.

The Verge · AI

Google updates spam rules to include attempts to manipulate AI

Google updated its Search spam policy to classify attempts to manipulate generative AI responses in AI Overview or AI Mode as spam, and the RSS snippet names biased best-of listicles and recommendation poisoning as tactics while not disclosing the full enforcement details.

Why it matters: Google now treats deliberate attempts to skew AI Overview and AI Mode output as spam, naming biased recommendation lists and recommendation poisoning.

May 15Friday

AI HOT (Curated Pool)

UK agencies warn advanced AI models exceed professionals in cyberattack capability

The UK Treasury, Bank of England, and Financial Conduct Authority warned that the most advanced AI models can run cyberattacks faster, at broader scope, and lower cost than ordinary professionals; the snippet says Bank of England Governor Andrew Bailey named Anthropic’s Mythos, but does not disclose test methods or quantitative benchmarks.

Why it matters: The UK Treasury, Bank of England and FCA jointly warn that top AI models' cyberattack capability now beats ordinary professionals on speed, scope and cost, with Bailey naming Anthropic's Mythos.

Synced · WeChat

Amazon employees reportedly tokenmaxx to meet AI usage KPIs

Amazon required more than 80% of developers to use AI tools each week and created an internal token-consumption leaderboard. Employees reportedly used the internal MeshClaw agent to inflate usage, while Amazon has limited visibility of the statistics to each employee and their direct manager.

Why it matters: Amazon asks over 80% of developers to use AI tools weekly and runs a token-consumption leaderboard, so staff use the internal MeshClaw agent to hit the numbers.

Synced · WeChat

MemPrivacy Shows a Privacy Layer for AI Memory

MemTensor and HONOR open-sourced MemPrivacy for edge-cloud agent memory protection using local reversible pseudonymization; MemPrivacy-4B-RL reached 85.97% composite F1 on MemPrivacy-Bench, 50.47 percentage points above OpenAI privacy-filter, while the benchmark covers 200 users and more than 155,000 privacy items.

Why it matters: MemTensor and Honor open-sourced MemPrivacy, which swaps sensitive details in agent memory for reversible aliases locally, so the model only sees fake names and the real ones are restored when needed.

Xinzhiyuan · WeChat

Anthropic Translates Claude’s Internal Activations into Natural Language with NLA

Anthropic released Natural Language Autoencoder to translate Claude activation vectors into text; on Opus 4.6 it reached 60%-80% variance explained, and across 16 evaluations NLA detected unspoken evaluation awareness on 26% of SWE-bench Verified tasks.

Why it matters: Anthropic's NLA research turns Claude's internal activation vectors into natural language, explaining 60% to 80% of the variance in activation patterns on Opus 4.6.

Bloomberg Technology

Anthropic Spat With US Emerges as Risk Factor for Figma, Others

Anthropic is in a legal dispute with the US government over whether federal agencies will ban its AI models, and Bloomberg’s RSS snippet says the dispute has become a financial threat to Figma and other businesses.

Why it matters: The Anthropic dispute with the US government has reached the financial risk disclosures of companies like Figma, showing how policy risk from an AI model vendor carries into downstream firms' filings.

r/LocalLLaMA

I trained Qwen3.5 to jailbreak itself with RL, then used the failures to improve its defenses

The author built an RL-based automated red-teaming loop for Qwen3.5, raising defense rate from 64% to 92% while benign accuracy fell from 92% to 88%, and the attacker found 7 tactic families.

Why it matters: The author trained an attack model with RL to jailbreak Qwen3.5 automatically, clustering and penalizing repeated tactics to force out 7 distinct attack types, with fictional-writing prompts at 34%.

AI HOT (Curated Pool)

Two Scenarios for Global AI Leadership in 2028

Anthropic outlines two 2028 scenarios for US-China AI competition: if the US and allies expand their compute-chip advantage through export controls, theft prevention, and faster AI adoption, democratic states can maintain a 12-to-24-month technical lead.

Why it matters: Anthropic runs one variable, chip controls, to sketch two 2028 outcomes, and names talent and distillation attacks as how Chinese labs close the gap.

May 14Thursday

AI HOT (Curated Pool)

OpenAI Faces Class Action Over Alleged ChatGPT Query Privacy Leaks to Meta

A federal court in Southern California accepted a class action against OpenAI, with plaintiffs alleging that the ChatGPT website used Facebook Pixel to send query topics and cookies containing a Facebook unique ID to Meta in real time.

Why it matters: The suit claims ChatGPT's web tracking code sent user question topics and Facebook IDs to Meta in real time, testing whether question topics count as sensitive data.

MIT Technology Review · AI

The Shock of Seeing Your Body Used in Deepfake Porn

MIT Technology Review documents Jennifer and other adult content creators whose bodies were used in NCII deepfakes, with examples spanning Jennifer’s circa-2013 video and the 2017 Reddit “deepfakes” uploads involving celebrity face swaps.

Why it matters: MIT Technology Review follows adult content creator Jennifer after she found an old video face-swapped, her body intact and her face someone else's, putting non-consensual synthetic porn on one person's actual experience.

QbitAI · WeChat

Alexandr Wang Responds to LeCun, Manus, and Meta AI Rebuild

Alexandr Wang said Meta rebuilt its pretraining, reinforcement learning, and data stacks in nine months, while Muse Spark remains closed because it triggered safety checks in areas including biosecurity, cyber capability, and loss of control.

Why it matters: Alexandr Wang answers the LeCun and Manus disputes in an interview and confirms Meta rewrote three systems, pretraining, reinforcement learning and data processing, in nine months.

MIT Technology Review · AI

AI chatbots are giving out people’s real phone numbers

MIT Technology Review documents three cases where Gemini surfaced real personal phone numbers in customer-service or contact-info answers. DeleteMe says generative-AI privacy queries rose 400% in seven months, with 55% referencing ChatGPT, 20% Gemini, 15% Claude, and 10% other tools.

Why it matters: MIT Technology Review documented three cases where Gemini gave out real people's phone numbers as support lines, including an Israeli software engineer who got WhatsApp messages from strangers.

AI HOT (Curated Pool)

Meta AI chief announces Incognito Chat for WhatsApp and Meta AI

Meta’s AI chief announced Incognito Chat for WhatsApp and Meta AI, with conversation inference running inside the phone’s hardware secure enclave, no server logs generated, and session data permanently deleted after the chat ends.

Why it matters: Meta launched Incognito Chat on WhatsApp, where inference runs inside the phone's secure enclave, servers keep no logs and sessions are deleted on exit, unlike temporary chats that only clear history.

The Verge · AI

Mark Zuckerberg announces ‘completely private’ encrypted Meta AI chat

Mark Zuckerberg announced Meta AI Incognito Chat, saying it stores no conversation logs on servers and uses end-to-end encryption; the post does not disclose rollout scope, retention audit details, or the key-management mechanism.

Why it matters: Zuckerberg added an end-to-end encrypted incognito mode to Meta AI, where messages are not kept on servers after the session ends, which Meta says sets it apart from other chatbots.

May 13Wednesday

TechCrunch · AI

WhatsApp Adds an Incognito Mode in Meta AI Chats

WhatsApp added an incognito mode for Meta AI chats; Meta says these conversations are not saved, and messages disappear by default once the chat is closed.

Why it matters: Meta added an incognito mode to WhatsApp's AI chats, where conversations are not saved and vanish when the window closes, showing how a mainstream messaging app handles retention of AI chats.

OpenAI News

Building a Safe, Effective Sandbox for Codex on Windows

OpenAI built a secure sandbox for Codex on Windows. The RSS snippet discloses controlled file access and network restrictions, but the post does not disclose implementation details, performance data, or rollout conditions.

Why it matters: An OpenAI engineer explains why Codex on Windows had no sandbox, leaving users to approve every command or grant full access, and how the team built one from scratch.

New York Times Chinese

China Sought Access to Anthropic’s Latest Technology but Was Rejected

Chinese think-tank representatives asked Anthropic in Singapore last month to give Beijing access to Mythos, and Anthropic refused; the company has limited the vulnerability-finding model to the U.S. government and more than 40 organizations.

Why it matters: A Chinese think tank asked Anthropic to open its vulnerability-hunting model Mythos at informal talks in Singapore and was turned down; the model stays limited to the US government and just over 40 organizations.

AI HOT (Curated Pool)

OpenAI responds to TanStack npm supply chain attack and tightens security measures

OpenAI said its internal systems were not affected by the TanStack npm supply chain attack, revoked and re-signed related code-signing certificates, and required macOS users to update the app by June 12, 2026.

Why it matters: OpenAI confirmed the TanStack npm supply chain attack hit two employee devices and leaked some credentials, and told macOS users to update the app by June 12.