Why AI visibility dashboards are mostly useless

Weighing smoke: why AI visibility dashboards are mostly useless

This piece explains why AI search visibility dashboards are unreliable. Rand Fishkin's study found that asking an AI the same question 100 times yields the same recommendation list less than 1% of the time. The randomness is baked into how models generate tokens, break down queries, and select sources—it's a feature, not a bug. The only stable signal is the consideration set: top brands appear in 90%+ of responses, but their ranking is noise. The author suggests a manual afternoon check each month beats paying for a dashboard.

Why it matters: Opinion piece backed by concrete data (Rand Fishkin's 100-query repeat experiment) that directly challenges a $100M+ AI rank-tracking industry. Hits all three HKR axes, but it's commentary, not original research, and the author has a vested interest — lands at the featured thr...