Wilshire@lemmy.world to Technology@lemmy.worldEnglish · 1 year agoThe first GPT-4-class AI model anyone can download has arrived: Llama 405Barstechnica.comexternal-linkmessage-square47linkfedilinkarrow-up1104arrow-down110
arrow-up194arrow-down1external-linkThe first GPT-4-class AI model anyone can download has arrived: Llama 405Barstechnica.comWilshire@lemmy.world to Technology@lemmy.worldEnglish · 1 year agomessage-square47linkfedilink
minus-squarebizarroland@fedia.iolinkfedilinkarrow-up2·1 year agoI have a home server with 140 gigs of RAM, it was surprisingly cheap. It’s an HP z6 with the 6146 gold xeon processor. I found a seller who was selling it with a low spec silver and 16 gigs of RAM for like 250 bucks. Found the processor upgrade for about $120 and spend another $150 on 128gb of second-hand ECC ddr4. I think the total cost was something like $700 after throwing a couple of 8 TB hard drives in. I’ve also placed a Nvidia 4070 in it, which I got doing some horse trading. How close am I on the specs to being able to run the 70b version?
minus-squareBaroqueInMind@lemmy.onelinkfedilinkEnglisharrow-up0·edit-21 year agoWhat’s the bus speed of the RAM? You might run it just fine but still bottlenecked there.
I have a home server with 140 gigs of RAM, it was surprisingly cheap. It’s an HP z6 with the 6146 gold xeon processor.
I found a seller who was selling it with a low spec silver and 16 gigs of RAM for like 250 bucks.
Found the processor upgrade for about $120 and spend another $150 on 128gb of second-hand ECC ddr4.
I think the total cost was something like $700 after throwing a couple of 8 TB hard drives in.
I’ve also placed a Nvidia 4070 in it, which I got doing some horse trading.
How close am I on the specs to being able to run the 70b version?
What’s the bus speed of the RAM? You might run it just fine but still bottlenecked there.