In 2023, more deepfake abuse videos were shared than in every other year in history combined, according to an analysis by independent researcher Genevieve Oh. What used to take skillful, tech-savvy experts hours to Photoshop can now be whipped up at a moment’s notice with the help of an app. Some deepfake websites even offer tutorials on how to create AI pornography.

What happens if we don’t get this under control? It will further blur the lines between what’s real and what’s not — as politics become more and more polarized. What will happen when voters can’t separate truth from lies? And what are the stakes? As we get closer to the presidential election, democracy itself could be at risk. And, as Ocasio-Cortez points out in our conversation, it’s about much more than imaginary images.

“It’s so important to me that people understand that this is not just a form of interpersonal violence, it’s not just about the harm that’s done to the victim,” she says about nonconsensual deepfake porn. She puts down her spoon and leans forward. “Because this technology threatens to do it at scale — this is about class subjugation. It’s a subjugation of entire people. And then when you do intersect that with abortion, when you do intersect that with debates over bodily autonomy, when you are able to actively subjugate all women in society on a scale of millions, at once digitally, it’s a direct connection [with] taking their rights away.”

  • @nyan@lemmy.cafe
    link
    fedilink
    English
    167 months ago

    The real problem is that people automatically believe what they see online, no matter how ridiculous or outrageous, rather than thinking about probability and provenance and supporting evidence and all that stuff.

    Unfortunately, this problem is not likely to be solved any time soon, since we’ve had more than a quarter-century now (since the advent of image editing software) to work on it. Hell, even further back than that, a certain percentage of the population could be fooled into believing in UFOs by a blurry black-and-white photograph of pie plates suspended from fishing line. We’re never gonna fix this.

    • @WarlordSdocy@lemmy.world
      link
      fedilink
      English
      97 months ago

      The problem also goes both ways though. Not only does it create fake things but it makes it much easier to discredit real things by just claiming that it’s deep faked.