ylai@lemmy.ml to AI Infosec@infosec.pubEnglish · 2 years agoAI hallucinates software packages and devs download them – even if potentially poisoned with malwarewww.theregister.comexternal-linkmessage-square3linkfedilinkarrow-up137arrow-down10cross-posted to: technology@lemmy.worldcybersecurity@infosec.pubopensource@lemmy.mltechnology@beehaw.orgtechnology@lemmy.zipartificial_intel@lemmy.mltechnology@lemmy.world
arrow-up137arrow-down1external-linkAI hallucinates software packages and devs download them – even if potentially poisoned with malwarewww.theregister.comylai@lemmy.ml to AI Infosec@infosec.pubEnglish · 2 years agomessage-square3linkfedilinkcross-posted to: technology@lemmy.worldcybersecurity@infosec.pubopensource@lemmy.mltechnology@beehaw.orgtechnology@lemmy.zipartificial_intel@lemmy.mltechnology@lemmy.world
minus-squareSyd@lemm.eelinkfedilinkEnglisharrow-up7·2 years agoSo could a bad actor train llms to inject malware into code in a way that wouldn’t be easily caught?
minus-squareBlazeDaley@lemmy.worldlinkfedilinkEnglisharrow-up3·2 years agoYes. https://www.anthropic.com/news/sleeper-agents-training-deceptive-llms-that-persist-through-safety-training
So could a bad actor train llms to inject malware into code in a way that wouldn’t be easily caught?
Yes.
https://www.anthropic.com/news/sleeper-agents-training-deceptive-llms-that-persist-through-safety-training