• ATDA@lemmy.world
        link
        fedilink
        arrow-up
        2
        ·
        5 days ago

        I’ve fiddled with a few models but my woeful home server gets like 20 words a min. Maybe my setup is the issue.

          • CharlesDarwin@lemmy.world
            link
            fedilink
            English
            arrow-up
            1
            ·
            5 days ago

            I hope to try out a local rig I have that I once used for mining a little bit and then later for folding@home - but I need more disk space on there. That host has the tiniest drive on it - 128G. Once I solve that problem, I hope things like ollama can make use of the cards I have in it…for now, I’m using a 2022 macbook and it seems to do okay-ish with some models anyway.

            I hope I never have to give one red cent to the likes of Altman.