- cross-posted to:
- hackernews@derp.foo
- cross-posted to:
- hackernews@derp.foo
AI one-percenters seizing power forever is the real doomsday scenario, warns AI godfather::The real risk of AI isn’t that it’ll kill you. It’s that a small group of billionaires will control the tech forever.
Uhh what? You can totally run LLMs locally.
Inference, yes. Training, no. Derived models don’t count.
I have Llama 2 running on localhost, you need a fairly powerful GPU but it can totally be done.
I’ve run one of the smaller models on my i7-3770 with no GPU acceleration. It is painfully slow but not unusably slow.
To get the same level as something like chat gpt?