JOMusic@lemmy.ml to World News@lemmy.worldEnglish · 3 days agoOpen-source Deepseek R1 dethrones commercial AI, now allegedly being hit by cyberattackwww.cnbc.comexternal-linkmessage-square49fedilinkarrow-up1196arrow-down18cross-posted to: technology@lemmy.worldeconomy@lemmy.worldtechnology@lemmit.online
arrow-up1188arrow-down1external-linkOpen-source Deepseek R1 dethrones commercial AI, now allegedly being hit by cyberattackwww.cnbc.comJOMusic@lemmy.ml to World News@lemmy.worldEnglish · 3 days agomessage-square49fedilinkcross-posted to: technology@lemmy.worldeconomy@lemmy.worldtechnology@lemmit.online
minus-squarePieisawesome@lemmy.worldlinkfedilinkEnglisharrow-up2·1 day agoIt’s because LLMs don’t work with letters. They work with tokens that are converted to vectors. They literally don’t see the word “strawberry” in order to count the letters. Splitting the letter probably separates them into individual tokens
It’s because LLMs don’t work with letters. They work with tokens that are converted to vectors.
They literally don’t see the word “strawberry” in order to count the letters.
Splitting the letter probably separates them into individual tokens