• ATDA@lemmy.world
      link
      fedilink
      arrow-up
      2
      ·
      5 days ago

      I’ve fiddled with a few models but my woeful home server gets like 20 words a min. Maybe my setup is the issue.

        • CharlesDarwin@lemmy.world
          link
          fedilink
          English
          arrow-up
          1
          ·
          5 days ago

          I hope to try out a local rig I have that I once used for mining a little bit and then later for folding@home - but I need more disk space on there. That host has the tiniest drive on it - 128G. Once I solve that problem, I hope things like ollama can make use of the cards I have in it…for now, I’m using a 2022 macbook and it seems to do okay-ish with some models anyway.

          I hope I never have to give one red cent to the likes of Altman.