Wilshire@lemmy.world to Technology@lemmy.worldEnglish · 1 year agoThe first GPT-4-class AI model anyone can download has arrived: Llama 405Barstechnica.comexternal-linkmessage-square47linkfedilinkarrow-up1104arrow-down110
arrow-up194arrow-down1external-linkThe first GPT-4-class AI model anyone can download has arrived: Llama 405Barstechnica.comWilshire@lemmy.world to Technology@lemmy.worldEnglish · 1 year agomessage-square47linkfedilink
minus-squareRandomLegend [He/Him]@lemmy.dbzer0.comlinkfedilinkEnglisharrow-up8·1 year agoIt’s available through ollama already. i am running the 8b model on my little server with it’s 3070 as of right now. It’s really impressive for a 8b model
minus-squareabcdqfr@lemmy.worldlinkfedilinkEnglisharrow-up0·1 year agoIntriguing. Is that an 8gb card? Might have to try this after all
minus-squareRandomLegend [He/Him]@lemmy.dbzer0.comlinkfedilinkEnglisharrow-up1·1 year agoYup, 8GB card Its my old one from the gaming PC after switching to AMD. It now serves as my little AI hub and whisper server for home assistant
It’s available through ollama already. i am running the 8b model on my little server with it’s 3070 as of right now.
It’s really impressive for a 8b model
Intriguing. Is that an 8gb card? Might have to try this after all
Yup, 8GB card
Its my old one from the gaming PC after switching to AMD.
It now serves as my little AI hub and whisper server for home assistant