• Fubarberry@sopuli.xyz
    link
    fedilink
    English
    arrow-up
    3
    ·
    1 day ago

    There’s also a “r” in the first half of the word, “straw”, so it was completely skipping over that r and just focusing on the r’s in the word “berry”

    • jj4211@lemmy.world
      link
      fedilink
      English
      arrow-up
      2
      ·
      4 hours ago

      It doesn’t see “strawberry” or “straw” or “berry”. It’s closer to think of it as seeing 🍓, an abstract token representing the same concept that the training data associated with the word.

    • catloaf@lemm.ee
      link
      fedilink
      English
      arrow-up
      3
      arrow-down
      1
      ·
      1 day ago

      It wasn’t focusing on anything. It was generating text per its training data. There’s no logical thought process whatsoever.