• Hubi@feddit.org
    link
    fedilink
    arrow-up
    1
    ·
    edit-2
    49 minutes ago

    Sure, but with a model of that size you are unloading layers in any case. I’m just saying you need 32 GBs of RAM at the minimum to be able to run it.