Civilizational intelligence infrastructure must remain free to study, build, deploy, and run, not rented from closed institutions.
  • mabeledo@lemmy.worldEnglish
    2·
    2 months ago

    I was talking about combined system RAM. People often overestimate what the average system specs are.

    • ZephyrXero@lemmy.worldEnglish
      41·
      2 months ago

      If the model dumps over to system ram it gets super slow, you ideally want it to fit completely in your VRAM