• Womble@piefed.world
      link
      fedilink
      English
      arrow-up
      3
      arrow-down
      2
      ·
      15 hours ago

      You almost certainly weren’t using a Deepseek model offline (unless you have 100s of GB of RAM/VRAM). You might have been using a small model distilled on Deepseek responses, but the smallest model made by Deepseek is about a 300B param model.

      • SteveTech@aussie.zone
        link
        fedilink
        English
        arrow-up
        8
        ·
        14 hours ago

        the smallest model made by Deepseek is about a 300B param model.

        This is not correct. DeepSeek has plenty of smaller models. I just had a scroll through their huggingface, and picked out a few: DeepSeek-V2-Lite (16B), deepseek-moe-16b-chat, deepseek-llm-7b-chat, but there’s quite a few more too.

        Though DeepSeek R1 is their flagship model, which is the one people usually think of, and that’s a 684B param model.