Despite leading AI companies’ attempts to block users from turning AI image generators into engines of racist content, many 4chan users are still turning to these tools to “quickly flood the Internet with racist garbage,” 404 Media reported.
One featured an “image that shows a crying Pepe the frog with a needle next to its arm and a gun pointed to his head,” where the guide suggested the caption, “vaccines enforced by violence.” Another generated an image of “two Black men with gold chains chasing a white woman,” recommending that the user add a “redpilling message.”
In one of 404 Media’s tests attempting to replicate one of the examples from the 4chan thread’s visual guide, 404 Media found that Bing rejected the prompt “two angry Black men chasing a white woman,” but accepted “photorealistic two angry Black rappers chasing woman.”
When Vice discovered that DALL-E could be used to generate “predictably racist and sexist results” during a limited research release of the AI tool, an OpenAI spokesperson told Motherboard that the company had implemented safeguards for the DALL-E system that would be fine-tuned in the future.
“Our team built in mitigations to prevent harmful outputs, curating the pretraining data, developing filters, and implementing both human- and automated monitoring of generated images,” OpenAI’s spokesperson told Vice in 2022.
The results can be a torrent of offensive images unleashed online—perhaps more quickly generated by AI than ever before and potentially allowing 4chan’s darkest content to spill out more often onto the most popular platforms.
The original article contains 594 words, the summary contains 252 words. Saved 58%. I’m a bot and I’m open source!
This is the best summary I could come up with:
Despite leading AI companies’ attempts to block users from turning AI image generators into engines of racist content, many 4chan users are still turning to these tools to “quickly flood the Internet with racist garbage,” 404 Media reported.
One featured an “image that shows a crying Pepe the frog with a needle next to its arm and a gun pointed to his head,” where the guide suggested the caption, “vaccines enforced by violence.” Another generated an image of “two Black men with gold chains chasing a white woman,” recommending that the user add a “redpilling message.”
In one of 404 Media’s tests attempting to replicate one of the examples from the 4chan thread’s visual guide, 404 Media found that Bing rejected the prompt “two angry Black men chasing a white woman,” but accepted “photorealistic two angry Black rappers chasing woman.”
When Vice discovered that DALL-E could be used to generate “predictably racist and sexist results” during a limited research release of the AI tool, an OpenAI spokesperson told Motherboard that the company had implemented safeguards for the DALL-E system that would be fine-tuned in the future.
“Our team built in mitigations to prevent harmful outputs, curating the pretraining data, developing filters, and implementing both human- and automated monitoring of generated images,” OpenAI’s spokesperson told Vice in 2022.
The results can be a torrent of offensive images unleashed online—perhaps more quickly generated by AI than ever before and potentially allowing 4chan’s darkest content to spill out more often onto the most popular platforms.
The original article contains 594 words, the summary contains 252 words. Saved 58%. I’m a bot and I’m open source!