I use open source self hosted software everyday. I love the community and I would love to be able to contribute to some of these projects.

As far as code goes, I basically no nothing about how it works. I see the development section of the repos I use and again, I’ve go no idea how it works.

How can I teach myself how to offer small improvements to the projects I use?

  • Natanox@discuss.tchncs.deEnglish
    2·
    1 hour ago

    Phew, to run such a model - even just 27B quantized - at a reasonable speed requires some serious GPU Power.

    Best thing I have is a 7800 XT 16gb (so ROCm it would be), don’t think that’s realistic and I’d rather invest the necessary amount of money for new GPUs into sth. more useful like a small electric vehicle than a slop cannon 🥴. Happy to hear actual useful things can be retained after the bubble finally crashes though. Oh please, let it crash tomorrow… together with the housing market…