lemmydividebyzero@reddthat.com to Technology@lemmy.worldEnglish · il y a 4 moisOpensource AI Must Winopensourceaimustwin.comexternal-linkmessage-square111linkfedilinkarrow-up1287arrow-down120
arrow-up1267arrow-down1external-linkOpensource AI Must Winopensourceaimustwin.comlemmydividebyzero@reddthat.com to Technology@lemmy.worldEnglish · il y a 4 moismessage-square111linkfedilink
minus-squareshortwavesurfer@lemmy.ziplinkfedilinkEnglisharrow-up4·il y a 4 moisI ran it on my 8GB RAM desktop.
minus-squaremabeledo@lemmy.worlddeleted by creatorlinkfedilinkEnglisharrow-up1·il y a 4 moisI mean if that’s all that would be loaded in memory, sure.
minus-squareZephyrXero@lemmy.worldlinkfedilinkEnglisharrow-up4arrow-down1·il y a 4 moisI got Qwen 3.5:9b running on my 8GB GPU the other day, and it still has some room left over
minus-squaremabeledo@lemmy.worlddeleted by creatorlinkfedilinkEnglisharrow-up2·il y a 4 moisI was talking about combined system RAM. People often overestimate what the average system specs are.
minus-squareZephyrXero@lemmy.worldlinkfedilinkEnglisharrow-up4arrow-down1·il y a 4 moisIf the model dumps over to system ram it gets super slow, you ideally want it to fit completely in your VRAM
I ran it on my 8GB RAM desktop.
I mean if that’s all that would be loaded in memory, sure.
I got Qwen 3.5:9b running on my 8GB GPU the other day, and it still has some room left over
I was talking about combined system RAM. People often overestimate what the average system specs are.
If the model dumps over to system ram it gets super slow, you ideally want it to fit completely in your VRAM