misk@sopuli.xyz to Technology@lemmy.worldEnglish · 2 days agoFramework’s first desktop is a strange—but unique—mini ITX gaming PCarstechnica.comexternal-linkmessage-square256fedilinkarrow-up1622arrow-down110cross-posted to: framework@lemmy.mlsffpc@lemmy.worldhackernews@lemmy.bestiver.se
arrow-up1612arrow-down1external-linkFramework’s first desktop is a strange—but unique—mini ITX gaming PCarstechnica.commisk@sopuli.xyz to Technology@lemmy.worldEnglish · 2 days agomessage-square256fedilinkcross-posted to: framework@lemmy.mlsffpc@lemmy.worldhackernews@lemmy.bestiver.se
minus-squareToes♀@ani.sociallinkfedilinkEnglisharrow-up1·2 days agoWould 256GB/s be too slow for large llms?
minus-squareActers@lemmy.worldlinkfedilinkEnglisharrow-up1·14 hours agoMany LLM operations rely on fast memory and gpus seem to have that. Even though their memory is soldered and vbios is practically a black box that is tightly controlled. Nothing on a GPU is modular or repairable without soldering skills(and tools).
Would 256GB/s be too slow for large llms?
It runs on the gpu
Many LLM operations rely on fast memory and gpus seem to have that. Even though their memory is soldered and vbios is practically a black box that is tightly controlled. Nothing on a GPU is modular or repairable without soldering skills(and tools).
Huh?