• brucethemoose@lemmy.world
    link
    fedilink
    English
    arrow-up
    3
    ·
    8 hours ago

    You shouldn’t let that discourage you. VLLM is really finicky, but there are easier backends to use (though which one depends on your hardware).