Jaden Norman@lemmy.world to Technology@lemmy.worldEnglish · 1 year agoAI agents wrong ~70% of time: Carnegie Mellon studywww.theregister.comexternal-linkmessage-square68linkfedilinkarrow-up1504arrow-down116cross-posted to: technology@lemmy.ml
arrow-up1488arrow-down1external-linkAI agents wrong ~70% of time: Carnegie Mellon studywww.theregister.comJaden Norman@lemmy.world to Technology@lemmy.worldEnglish · 1 year agomessage-square68linkfedilinkcross-posted to: technology@lemmy.ml
minus-squarelepinkainen@lemmy.worldlinkfedilinkEnglisharrow-up7arrow-down3·1 year agoWrong 70% doing what? I’ve used LLMs as a Stack Overflow / MSDN replacement for over a year and if they fucked up 7/10 questions I’d stop. Same with code, any free model can easily generate simple scripts and utilities with maybe 10% error rate, definitely not 70%
Wrong 70% doing what?
I’ve used LLMs as a Stack Overflow / MSDN replacement for over a year and if they fucked up 7/10 questions I’d stop.
Same with code, any free model can easily generate simple scripts and utilities with maybe 10% error rate, definitely not 70%