Skip to content
r/LocalLLaMA

Qwen-Scope: Official Sparse Autoencoders (SAEs) for Qwen 3.5 models

Qwen Team released Qwen-Scope, SAEs for Qwen 3.5 models from 2B to 35B MoE. It maps residual-stream features across all layers, including Feature #6159 for Chinese activation. The key point is feature-level debugging and steering; the license discourages removing safety filters.

Why it matters: Qwen open-sourced Qwen-Scope, sparse autoencoders spanning 2B to 35B MoE models with full residual streams, splitting tangled activations into separate features people can inspect and debug.

Read the original ↗Export Markdown