• SteveTech@aussie.zone
    link
    fedilink
    English
    arrow-up
    6
    ·
    9 hours ago

    the smallest model made by Deepseek is about a 300B param model.

    This is not correct. DeepSeek has plenty of smaller models. I just had a scroll through their huggingface, and picked out a few: DeepSeek-V2-Lite (16B), deepseek-moe-16b-chat, deepseek-llm-7b-chat, but there’s quite a few more too.

    Though DeepSeek R1 is their flagship model, which is the one people usually think of, and that’s a 684B param model.