Track_Shovel@slrpnk.net to Lemmy Shitpost@lemmy.worldEnglish · 4 months agoHexadecimalslrpnk.netimagemessage-square115fedilinkarrow-up1133arrow-down11
arrow-up1132arrow-down1imageHexadecimalslrpnk.netTrack_Shovel@slrpnk.net to Lemmy Shitpost@lemmy.worldEnglish · 4 months agomessage-square115fedilink
minus-squaressillyssadass@lemmy.worldlinkfedilinkarrow-up6·4 months agoDon’t you need a beefy GPU to run local LLMs?
minus-squareMasterNerd@lemm.eelinkfedilinkarrow-up3arrow-down1·4 months agoDepends on how many parameters you want to use. I can run it with 8billion on my laptop.
Don’t you need a beefy GPU to run local LLMs?
Depends on how many parameters you want to use. I can run it with 8billion on my laptop.