• Womble@piefed.world
    link
    fedilink
    English
    arrow-up
    3
    arrow-down
    2
    ·
    10 hours ago

    You almost certainly weren’t using a Deepseek model offline (unless you have 100s of GB of RAM/VRAM). You might have been using a small model distilled on Deepseek responses, but the smallest model made by Deepseek is about a 300B param model.

    • SteveTech@aussie.zone
      link
      fedilink
      English
      arrow-up
      6
      ·
      9 hours ago

      the smallest model made by Deepseek is about a 300B param model.

      This is not correct. DeepSeek has plenty of smaller models. I just had a scroll through their huggingface, and picked out a few: DeepSeek-V2-Lite (16B), deepseek-moe-16b-chat, deepseek-llm-7b-chat, but there’s quite a few more too.

      Though DeepSeek R1 is their flagship model, which is the one people usually think of, and that’s a 684B param model.