Fake Taylor Swift Images Traced to 4Chan Challenge

Research firm finds online group made evading safeguards a game
By Bob Cronin,  Newser Staff
Posted Feb 5, 2024 6:15 PM CST
Fake Taylor Swift Images Traced to 4Chan Challenge
This screenshot made on Jan. 29 shows a Taylor Swift search error on X, after the platform blocked some searches for Swift when pornographic deepfake images of the singer circulated online.   (AP Photo)

A research firm has traced sexually explicit fake images of Taylor Swift that began circulating online last month to an already-infamous message board. Graphika found that a game-like challenge on 4Chan probably led to users trying to create lewd images of famous women, the New York Times reports. They were encouraged to find a way around safeguards in OpenAI's DALL-E, Microsoft Designer, and Bing Image Creator. Participants were told to share "tips and tricks to find new ways to bypass filters," then "Good luck, be creative."

"It's important to understand the gamified nature of this malicious activity in order to prevent further abuse at the source," said a senior analyst for Graphika, which analyzes social networks and disinformation. Experts said making a game of producing such content confers prestige and makes participants feel connected to a community. Graphika's report notes that 4Chan hosts conspiracy theories and hate speech, per CBS News. The message board did not respond to a request for comment.

OpenAI said that its tools were not used to create the fake images of Swift, while Microsoft said it's investigating. Software has been used to create fake pornography since at least 2017, per the Times. Graphika's report said the 4chan community that manipulated images of Swift did the same to likenesses of many actresses, singers, and politicians. (More Taylor Swift stories.)

Get the news faster.
Tap to install our app.
X
Install the Newser News app
in two easy steps:
1. Tap in your navigation bar.
2. Tap to Add to Home Screen.

X