• eleitl@lemmy.zip
    link
    fedilink
    English
    arrow-up
    1
    ·
    2 hours ago

    I only have an Radeon RX Vega 56 8GB HBM2, so limited to CPU-only. 64 GB memory there at least. Not upgrading unless hardware dies.

    • BlackLaZoR@lemmy.world
      link
      fedilink
      English
      arrow-up
      2
      ·
      47 minutes ago

      RX Vega 56 8GB HBM2, 64GB RAM

      That’s poor but not horrible. LMStudio has Vulkan compute backend option that works on almost any card. You can also do partial GPU/RAM split giving you total of 72GB and increased performance vs CPU only.

      • eleitl@lemmy.zip
        link
        fedilink
        English
        arrow-up
        1
        ·
        36 minutes ago

        Hmm, have to try it sometime when the hot phase at work is over. Thanks!