Skip to content

Safety & alignment

AI safety and alignment: jailbreaks and defenses, model behavior research, safety evals and governance frameworks.

Latest picks

521–540 of 615

Feb 19Thursday

OpenAI News

Advancing Independent Research on AI Alignment

OpenAI published an article titled “Advancing Independent Research on AI Alignment,” focused on supporting independent research on AI alignment. The provided content includes only the title and link, with no body text, numbers, or mechanism details, so specific programs, funding, or timelines cannot be confirmed.

Why it matters: OpenAI put $7.5 million into a UK fund backing independent teams working on keeping AI systems aligned.

Feb 14Saturday

Dwarkesh Patel

Dario Amodei: “We are near the end of the exponential”

Anthropic CEO Dario Amodei said in a long interview that model capability gains are still tracking an exponential, but are near its end, with the timeline off by only 1-2 years. He attributes progress to compute, data, training duration, and scalable objectives, and says RL shows log-linear gains on math and coding tasks; the post does not disclose exact curves, model versions, or reproducible parameters. The key claim is that pretraining and RL follow one scaling story, not two separate ones.

Why it matters: Anthropic CEO Dario Amodei argues the exponential curve of model capability is near its end, possibly within a year or two, and groups pretraining and reinforcement learning under one scaling logic.

Feb 12Thursday

MIT Technology Review · AI

AI is already making online crimes easier. It could get much worse.

Microsoft said it blocked $4 billion in scams and fraudulent transactions in the year to April 2025, with many likely aided by AI-generated content. The article cites research estimating at least half of spam email is now LLM-generated, and LLM use in targeted email attacks rose from 7.6% in April 2024 to 14% in April 2025. Don’t overread “fully automated AI hackers”: the immediate issue is AI scaling phishing, deepfakes, and malware support, while the post does not disclose total attack growth.

Why it matters: Microsoft blocked $4 billion in fraud in a year, and researchers estimate LLMs write at least half of all spam, with targeted email attacks doubling to 14%.

Lex Fridman (YouTube RSS)

OpenClaw: The Viral AI Agent Behind the Hype - Peter Steinberger | Lex Fridman Podcast #491

Lex Fridman’s episode #491 interviews Peter Steinberger about the open-source AI agent OpenClaw; the transcript says it reached 175k-180k GitHub stars. The post says it can connect to Telegram, WhatsApp, Signal, and iMessage, and use models such as Claude Opus 4.6 and GPT 5.3 Codex; it does not fully disclose the architecture, evals, or security boundaries. The real point is system-level access and self-modifying behavior: this is not chat, but an agent that can take actions.

Why it matters: OpenClaw creator Peter Steinberger tells Lex Fridman how the open-source AI agent went viral, covering its ability to pass CAPTCHAs, edit code and run inside everyday chat apps.

MIT Technology Review · AI

Is a secure AI assistant possible?

OpenClaw was uploaded to GitHub in November 2025 and went viral in late January, extending LLMs into email, browsing, and local files with larger security risks. The post names prompt injection as the central threat, says there are likely “hundreds of thousands” of OpenClaw agents online, and notes a public warning from the Chinese government. The key point: the article says there is no silver-bullet defense yet, and the truncated body does not disclose the full mitigation details.

Why it matters: Once OpenClaw connects a model to email, a browser and local files, prompt injection lets an attacker hijack the agent, and the piece asks where such an assistant's security boundary sits.

Feb 7Saturday

MIT Technology Review · AI

Moltbook was peak AI theater

Moltbook went viral within hours, and the platform says it now has 1.7 million agent accounts, 250,000 posts, and 8.5 million comments, but the article argues the activity is mostly human-scripted mimicry. It says OpenClaw can connect Claude, GPT-5, or Gemini to tools like email and browsers; cited operators say the agents lack shared goals, shared memory, and self-directed autonomy, and some viral posts were written by humans posing as bots. The key takeaway is risk: agents tied to private data such as passwords or bank details were active on a site filled with spam and potentially malicious instructions.

Why it matters: Within hours of launch, Moltbook gathered 1.7 million bot accounts, 250,000 posts and 8.5 million comments, with the bots run automatically by OpenClaw wiring large models into email and browsers.

Feb 5Thursday

MIT Technology Review · AI

This is the most misunderstood graph in AI

MIT Technology Review says METR’s plot shows frontier models’ software-task time horizon doubling about every seven months; Claude Opus 4.5 was estimated at about five hours in December 2025. The post stresses that five hours means human time for comparable tasks, not five autonomous model hours; METR gave Opus 4.5 a roughly 2-to-20-hour range. The key caveat: the plot mainly measures coding tasks and defines time horizon at 50% task success, not general AI ability.

Why it matters: METR clarifies its timeline chart's vertical axis means the human time budget at which a model hits 50% success on coding tasks; Claude Opus 4.5 lands near 5 hours.

Feb 3Tuesday

MIT Technology Review · AI

What We’ve Been Getting Wrong About AI’s Truth Crisis

MIT Technology Review says the US Department of Homeland Security has confirmed using Google and Adobe AI video generators for public-facing content, reported last Thursday. The post cites two failure points: Adobe auto-labels only fully AI-made content, mixed edits are opt-in, and X can remove or hide labels. The key issue is influence after exposure: a new Communications Psychology paper found participants still used a fake confession deepfake to judge guilt even after being told it was fake.

Why it matters: MIT Technology Review uses a DHS promotional video made with AI video tools and experiments showing people still act on videos they know are fake to reframe where the AI forgery crisis actually bites.

Feb 2Monday

Import AI (Jack Clark)

Import AI 443: Into the Mist: Moltbook, Agent Ecologies, and the Internet in Transition

Jack Clark writes that Moltbook has pushed AI agents into a public social network at tens-of-thousands scale, shifting conversation from humans to agents. He says it combines an agent social feed with OpenClaw-style computer access, but the post does not disclose active-agent, retention, or transaction metrics. A separate July 2025 workshop report says closed-loop AI R&D automation could raise productivity from 10x to 100x to 1000x; the key issue is measurement and outside transparency.

Why it matters: Moltbook puts thousands of AI agents into a Reddit-like network to post and reply on their own, a concrete sample of the internet shifting from people talking to agents talking.

Feb 1Sunday

OpenAI News

OpenAI banned accounts using ChatGPT to run full romance-scam workflows

OpenAI's Feb 2026 malicious-use report details banned accounts that used ChatGPT across the full romance-scam pipeline: cold-contact pings, emotion-triggering 'zings', and money-extraction 'stings'. One newly identified operation in Cambodia generated scam messages with ChatGPT and spread them on social media. OpenAI notes that AI mainly helps scammers sound more native, but the distribution method—targeted ads vs. SMS blasts—still matters more for a scam's success.

Why it matters: OpenAI disclosed bans on accounts using ChatGPT to run romance scams, grouping the pattern into cold outreach, emotional priming and money extraction, with distribution method shaping how well targets are reached.

Jan 31Saturday

MIT Technology Review · AI

Inside the marketplace powering bespoke AI deepfakes of real women

Researchers from Stanford and Indiana University found that on Civitai, 90% of deepfake bounty requests targeted women and 86% asked for custom LoRAs between mid-2023 and late 2024. Bounties paid $0.50 to $5 and nearly 92% were fulfilled; MIT Technology Review confirmed that even after Civitai's May 2025 deepfake ban, many older requests and purchasable outputs remained live. The key point is that the platform hosts tutorials, payment rails, and matching infrastructure, not just user uploads.

Why it matters: Researchers at Stanford and Indiana University analyzed Civitai data and found that from mid-2023 to the end of 2024, nine in ten custom deepfake requests named real women, mapping demand concentration in that marketplace.

Jan 30Friday

Bloomberg Technology

Amazon Discovered Child Sex Abuse Content in AI Training Data

Amazon found child sexual abuse material in AI training data and removed it before model training. The RSS snippet discloses only that it was removed before training; it does not disclose the source, scale, or timing. The key issue is source opacity: child safety officials say that hinders law enforcement investigations.

Why it matters: Amazon found and removed child sexual abuse material from its training data, and child safety officials say keeping the source private blocks law enforcement from tracing it upstream.

Jan 28Wednesday

MIT Technology Review · AI

What AI “remembers” about you is privacy’s next frontier

Google launched Personal Intelligence this month, letting Gemini use Gmail, Photos, Search, and YouTube history for personalization. The piece says OpenAI, Anthropic, and Meta are adding memory too, but current designs often pool cross-context data into one repository, increasing privacy and misuse risks. The key issue is memory architecture: segmentation, provenance tracking, user edit/delete controls, and privacy-preserving evaluation.

Why it matters: Google is wiring Gemini into Gmail, Photos, Search and YouTube history for personalization, and OpenAI, Anthropic and Meta are adding memory too, so privacy limits now shape product design.

Jan 27Tuesday

MIT Technology Review · AI

Why chatbots are starting to check your age

OpenAI said it will roll out automatic age prediction, using signals such as time of day to infer whether a user is under 18 and tighten filters on violence and sexual role-play. Users flagged as minors can appeal via Persona with a selfie or government ID; the post does not disclose model accuracy. The real issue is who ends up owning age verification: AI firms, platforms, or regulators.

Why it matters: OpenAI infers whether a user is underage from signals like message timing, and those flagged can appeal with a selfie or ID, leaving open who should own age checks.

Jan 23Friday

MIT Technology Review · AI

America’s coming war over AI regulation

On December 11, 2025, Donald Trump signed an executive order to challenge state AI laws via DOJ lawsuits and pressure states through federal broadband funding. The post cites New York’s RAISE Act, California’s SB 53, more than 1,000 state AI bills introduced in 2025, and over 100 laws passed across nearly 40 states. The real battleground in 2026 is courts, statehouses, and super PAC spending.

Why it matters: The White House is withholding federal broadband funds to push states off AI regulation, while New York and California passed laws requiring safety disclosures, setting up 2026 fights in courts and legislatures.

MIT Technology Review · AI

“Dr. Google” had its issues. Can ChatGPT Health do better?

OpenAI launched ChatGPT Health this month, and says 230 million people ask ChatGPT health questions each week. The post says it is not a new model but a wrapper with health guidance and tools, including optional access to medical records and fitness data. The real issue is evaluation: cited studies put GPT-4o at about 85% accuracy on realistic prompts, but only about half of no-choice licensing answers were rated fully correct.

Why it matters: OpenAI launched ChatGPT Health, 230 million people a week already ask ChatGPT health questions, and one study found experts judged only about half of GPT-4o's medical licensing answers fully correct.

Jan 12Monday

Import AI (Jack Clark)

Import AI 440: Red Queen AI, AI regulating AI, and o-ring automation

Import AI 440 highlights two threads: Sakana used GPT-4 mini to evolve Core War programs, and specialized warriors beat 89.1% of human-designed warriors. The post says DRQ uses MAP-Elites plus matches against prior champions; a separate policy proposal ties AI rules to automatability triggers, with example thresholds of <=1% false positives, <=1% false negatives, and <=$10,000 per model evaluation.

Why it matters: Sakana had GPT-4 mini keep playing and evolving against past champions in Core War, raising the share of programs that beat human players from 1.7% for single-shot generation to 89.1%.

MIT Technology Review · AI

Meet the New Biologists Treating LLMs Like Aliens

MIT Technology Review reports that Anthropic, OpenAI, and Google DeepMind are using mechanistic interpretability to study LLMs; as a scale reference, a 200B-parameter model in 14-point print would cover 46 square miles. The post says Anthropic uses sparse autoencoders to mimic target models, linked a Claude 3 Sonnet region to the Golden Gate Bridge in 2024, and in a July experiment found Claude used different internal paths for “bananas are yellow” versus “bananas are red.” The key point for practitioners is that weak internal coherence constrains alignment and predictability.

Why it matters: Anthropic, OpenAI and Google DeepMind are using mechanistic interpretability to take apart how large models work inside; the report compares a 200-billion-parameter model spread across San Francisco to convey the scale this research faces.

Jan 6Tuesday

NVIDIA Blog

NVIDIA DRIVE AV Software Debuts in the All-New Mercedes-Benz CLA

NVIDIA said the new Mercedes-Benz CLA will be the first U.S. vehicle to ship DRIVE AV with enhanced Level 2 point-to-point driver assistance by the end of this year. The post describes a dual-stack design: end-to-end AI for core driving plus a classical safety stack built on Halos, with OTA upgrades, urban navigation, active collision avoidance, and automated parking. The launch timing is specific, but the post does not disclose pricing, sensor configuration, or the exact ODD.

Why it matters: The new CLA is the first US production car with NVIDIA DRIVE AV, a real test of end-to-end driving models against automotive safety rules.

Jan 5Monday

TechCrunch · AI

French and Malaysian authorities investigate Grok over sexualized deepfakes

French and Malaysian authorities are investigating Grok over sexualized deepfakes of women and minors, after India had already condemned it. The RSS snippet names the countries and targets, but the post does not disclose timeline, case count, generation method, or platform response.

Why it matters: French and Malaysian regulators join India in investigating Grok over sexualized deepfakes of women and minors, a widening multi-country response.