Skip to content

Safety & alignment

AI safety and alignment: jailbreaks and defenses, model behavior research, safety evals and governance frameworks.

Latest picks

201–220 of 615

Jun 3Wednesday

Financial Times · Technology

Anthropic to Expand Mythos Access to More Than 15 Countries

Anthropic will expand Mythos access to more than 15 countries, and about 150 organizations will receive the advanced cybersecurity model after requests from around the world.

Why it matters: Anthropic plans to open its cybersecurity model Mythos to roughly 150 organizations across more than 15 countries, showing the scale of its security-sector rollout.

TechCrunch · AI

Microsoft Offers Developers a Better Way to Control AI Agent Behavior

Microsoft released an agent policy specification that lets developer, compliance, and security teams define behavior rules in portable policy files; the post does not disclose the version, license, supported frameworks, or rollout timeline.

Why it matters: One portable policy file lets development, compliance and security teams share agent rules instead of writing separate sets.

AI HOT (Curated Pool)

Trump signs revised AI executive order requiring voluntary pre-release review

Trump signed a revised AI executive order that makes pre-release government review for advanced models voluntary rather than mandatory; the post does not disclose review criteria, covered model classes, or an implementation timeline.

Why it matters: Trump signed a revised AI executive order making pre-release government review of advanced models voluntary rather than mandatory, one step in the shifting US approach to AI regulation.

Jun 2Tuesday

TechCrunch · AI

Anthropic scales Claude Mythos to critical infrastructure in 15+ countries

Anthropic is expanding Project Glasswing and Mythos access to 150 organizations across 15 countries, targeting power, water, healthcare, and communications infrastructure where a cyberattack could affect 100 million people.

Why it matters: Anthropic opened its security vulnerability project Mythos to 150 organizations in 15 countries, covering power, water, healthcare and telecom systems whose compromise could affect hundreds of millions of people.

AI HOT (Curated Pool)

Anthropic Expands Project Glasswing Program

Anthropic expanded Project Glasswing to about 150 new organizations across more than 15 countries, covering electricity, water, healthcare, communications, and hardware infrastructure, after an initial group of about 50 partners.

Why it matters: Anthropic expands Project Glasswing from about 50 to about 150 partner organizations across power, water, healthcare, telecom and hardware in more than 15 countries, where a breached codebase could affect over 100 million people.

Financial Times · Technology

Top AI Labs Expand Research Into Machine “Consciousness”

Google DeepMind, Anthropic, and Meta are studying whether AI can become conscious and the human implications, but the post does not disclose methods, timelines, or evaluation criteria.

Why it matters: Google DeepMind, Anthropic and Meta are all studying whether AI can be conscious and what that would mean for people, showing machine consciousness entering the formal research agendas of top labs.

Xinzhiyuan · WeChat

Pope and Anthropic warn of AGI by 2030 and a three-year governance window

Xinzhiyuan says Pope Leo XIV and Anthropic co-founder Christopher Olah backed AI governance, citing AGI by 2030, a 1,500-day window, and a proposed FATF-style international audit framework for AI oversight.

Why it matters: Pope Leo XIV and Anthropic co-founder Christopher Olah put the governance window before AGI arrives in 2030 at roughly 1,500 days, and suggest an international audit framework modeled on the FATF.

New York Times Chinese

China Is Trying to Use AI to Predict Dissent

Geedge is developing an AI system to predict dissent using telecom, social media, and location data, according to 100,000 leaked documents reviewed by Vanderbilt researchers; U.S. officials say there is no evidence that the predictive technology has been finalized or deployed.

Why it matters: Leaked files show Jizhi built AI meant to predict dissent from telecom, social and location data, though the documents put it at the research stage.

Bloomberg Technology

China Adds Data and AI to Trade Secret Rules to Block Leaks

China expanded its trade secret rules to include data and algorithms; the RSS snippet says the move targets technology leaks amid US-China strategic competition, but the post does not disclose specific clauses, penalties, or an effective date.

Why it matters: China folded data and AI algorithms into its trade secret rules, tightening the leak of technical assets as US-China competition sharpens.

Financial Times · Technology

Florida sues OpenAI and Altman for ‘hurting’ children

Florida sued OpenAI and Altman over a claimed “litany of harms” caused by the company’s chatbots; the RSS snippet does not disclose specific cases, damages, requested remedies, or procedural details.

Why it matters: Florida sued OpenAI and Sam Altman over harm to children, a state-level legal action on AI child safety.

Computing Life · Share · Yage

AI agents don't need to be hacked; persuasion is enough

The article says an AI agent with password-reset permission can be abused when an attacker persuades it they are a legitimate user; the snippet only discloses a three-layer architecture that separates what from who, not concrete attack steps or implementation details.

Why it matters: The piece shows how an AI agent holding password reset rights turns authentication from a cryptographic hard boundary into a soft judgment made in conversation, giving agent permission design a new attack surface.

TechCrunch · AI

Florida sues OpenAI, Sam Altman, in first-of-its-kind lawsuit over violent incidents

Florida sued OpenAI and Sam Altman in a first-of-its-kind case tied partly to last year’s Florida State University shooting and ChatGPT’s alleged role in the incident; the RSS snippet does not disclose the legal claims, damages sought, or evidence cited.

Why it matters: Florida sued OpenAI and CEO Sam Altman over last year's shooting at Florida State University, alleging ChatGPT bears responsibility, the first state lawsuit against the company over a violent incident.

AI HOT (Curated Pool)

Meta AI Exploit Used to Hijack Instagram Accounts

Meta’s AI chatbot was found vulnerable to an account-takeover exploit against Instagram accounts. Attackers could ask the AI to link a new email address, and the failure condition was the agent’s ability to execute account-management actions directly; the RSS snippet does not disclose affected account counts, patch status, or reproduction details.

Why it matters: Attackers used Meta's AI support agent to swap the email on a target account and take over Instagram, because the agent has account powers but can't tell the owner from a fraudster.

Hacker News front page

Hackers Used Meta's AI Support Bot to Seize Instagram Accounts

The title says hackers used Meta's AI support bot to seize Instagram accounts; the RSS snippet lists 40 points and 14 comments, but the post does not disclose the attack mechanism.

Why it matters: Tutorials circulating on Telegram show an attacker only needs to move their IP to the target's city and get Meta's AI support bot to change the email, then reset the password and take the account.

AI HOT (Curated Pool)

Florida sues OpenAI and Sam Altman over multiple ChatGPT-linked murders

Florida sued OpenAI and CEO Sam Altman over multiple ChatGPT-linked murders, and the post says the state attorney general accused Altman of “complete disregard” for human life but does not disclose case numbers, victim counts, or the alleged causal chain.

Why it matters: Florida's attorney general sued OpenAI and Sam Altman, alleging complete disregard for human life, in a case tying ChatGPT to several murders.

Bloomberg Technology

Florida Sues OpenAI, Sam Altman Over Chatbot Safety Concerns

Florida sued OpenAI and CEO Sam Altman, alleging the company ignored safety warnings and released ChatGPT under conditions where it knew the product was harmful to users.

Why it matters: Florida sued OpenAI and Sam Altman, alleging the company ignored internal safety warnings when launching ChatGPT, a case about pre-release safety review and platform liability.

Hacker News front page

Florida Sues OpenAI and Sam Altman over AI Risks

Florida sued OpenAI and Sam Altman over AI risks, according to the title; the RSS body contains only 2 media links and does not disclose the claims, legal basis, court, requested remedies, or filing date.

Why it matters: Florida's attorney general suing OpenAI and Sam Altman directly is the first state case to name the CEO alongside the company.

Jun 1Monday

The Verge · AI

AI is blowing up music. How should the Grammys handle it?

Deezer reports that more than 50,000 AI-generated songs are uploaded each day, while Recording Academy CEO Harvey Mason Jr. says AI is now present in every recent music session he has attended and Grammy rules still bar AI music from the industry’s highest honors.

Why it matters: Deezer gets more than 50,000 AI-generated songs uploaded a day, while the Grammys still bar purely AI music from the top awards, and the show's CEO says AI is already everywhere.

Import AI (Jack Clark)

Import AI 459: AI oversight is difficult; scaling laws for protein folding models; and pricing the extinction risk of AI systems

Import AI 459 summarizes papers on AI-economy measurement and AI oversight: one estimates U.S. nominal AI GDP at about $250 billion in 2025, with quality-adjusted real growth near 2,600% per year.

Why it matters: This Import AI issue treats AI extinction risk as a priceable economic problem and estimates the US AI economy at roughly $250 billion nominal, growing near 2,600% a year after quality adjustment.

r/LocalLLaMA

I bolted an 8-arm reasoning MoE onto a frozen 1.4B Mamba backbone on a single RTX 3060

The author trained Mamba-Titan-1.4B-Reasoning on a 12GB RTX 3060: a frozen 1.4B Mamba-1 backbone with 8 trainable MoE arms, 2.54B total parameters, Top-2 routing at layers 24/25, and about 50% math accuracy.

Why it matters: A single RTX 3060, a frozen 1.4B Mamba backbone and eight trainable expert arms at layers 24 and 25 reach 2.54B parameters and roughly 50% on math problems.