archive.is link

Earlier this year, WIRED asked AI detection startup Pangram Labs to analyze Medium. It took a sampling of 274,466 recent posts over a six week period and estimated that over 47 percent were likely AI-generated. “This is a couple orders of magnitude more than what I see on the rest of the internet,” says Pangram CEO Max Spero. (The company’s analysis of one day of global news sites this summer found 7 percent as likely AI-generated.)

  • @derbis@beehaw.org
    link
    fedilink
    3724 days ago

    How well does the “AI detection startup’s” product work? This is a big unsolved problem but I’d be hecka skeptical.

    • That is why I liked the comparison with articles from 2018. Then you have comparable texts in the same format and can more easily figure out differences in your analysis.
      If true, a jump from 3% to 40% is significant to say the least.

        • In 2018, 3.4 percent were estimated as likely AI-generated.

          For 2024, with a sampling of 473 articles published this year, it suspected that just over 40 percent were likely AI-generated.

          My numbers were from the Originality AI part.