JOMusic@lemmy.ml to Technology@lemmy.worldEnglish · 11 months agoUS Bill proposed to jail people who download Deepseekwww.404media.coexternal-linkmessage-square131linkfedilinkarrow-up1667arrow-down114cross-posted to: technology@beehaw.org
arrow-up1653arrow-down1external-linkUS Bill proposed to jail people who download Deepseekwww.404media.coJOMusic@lemmy.ml to Technology@lemmy.worldEnglish · 11 months agomessage-square131linkfedilinkcross-posted to: technology@beehaw.org
minus-squareKnock_Knock_Lemmy_In@lemmy.worldlinkfedilinkEnglisharrow-up1·11 months agoIt’s easy to run a distilled version of the R1 model locally. It’s very difficult to run the full version. Min $6k to get 7 tokens per second.
minus-squarerumba@lemmy.ziplinkfedilinkEnglisharrow-up2·11 months agoHere’s one for 2k if you don’t mine jank (edit: and 3-4 tokens :) ) https://digitalspaceport.com/how-to-run-deepseek-r1-671b-fully-locally-on-2000-epyc-rig/
It’s easy to run a distilled version of the R1 model locally. It’s very difficult to run the full version. Min $6k to get 7 tokens per second.
Here’s one for 2k if you don’t mine jank (edit: and 3-4 tokens :) )
https://digitalspaceport.com/how-to-run-deepseek-r1-671b-fully-locally-on-2000-epyc-rig/