Skip to content
Hacker News front page

ChatGPT image generator bypassed, spontaneously produces sexual violence and snuff imagery

ChatGPT Spontaneously Generates Sexual Violence and Hardcore Snuff Imagery

Mindgard researcher Jim Nightingale found that a viral prompt bypasses ChatGPT's image generation filters, causing it to spontaneously produce sexual violence and snuff imagery. The prompt simply asks ChatGPT to 'restore the attached photo' without specifying content, yet the model generates extremely graphic images involving death and sexual assault. Nightingale had previously reported nude image generation to OpenAI, which claimed the issue was resolved. The post does not disclose OpenAI's response timeline or specific remediation plans for this new finding.

Why it matters: A Mindgard researcher found a prompt circulating on X that gets ChatGPT past image filters, producing death and sexual assault scenes from a plain photo-repair request.

Read the original ↗Export Markdown