• 1 Post
  • 89 Comments
Joined 3 years ago
cake
Cake day: March 22nd, 2024

help-circle









  • I know.

    One can’t just bolt HBM onto something else, no matter how skilled the hacker is. It needs an interposer to connect it because the pin pitch is so small, and it needs a memory controller that supports it.

    EDIT: And if you’re talking about AMD using it in gaming GPUs or some other hardware, unfortunately the design pipeline is very long. If AMD decided to make a gaming HBM GPU right this second, and rushed it, it would take years to design it and get it in production.


  • The trailer is so wholesome.

    I will share some impulse thoughts:

    • I love the SDV-style NPCs. Personality, their style, their lives; that’s such a draw.

    • Love the look of resource gathering. Yes, I will mine some tin and chop some trees. Though I might suggest making these activities “interesting” with physics (like how trees will fall down and tumble in Valheim).

    • All the animations are gorgeous.

    • Love the variety of monsters. It feels alien.

    • I have more mixed feelings about the style of traits. I know many are fans of ‘oldschool’ RPG systems, but I’m personally not.

    • I’d prefer more of a ‘psyche’ and skill system like Rimworld or something.

    • Combat is down to user taste.

    • I’m sure many have told you this, but TBH, I’m unlikely to play a survival game like this if it’s just solo. But I’m not asking for networking; even if it had couch split screen, that’d be great. I could even stream the screen remotely.



  • Datacenter GPUs can’t game :(. As in, it’s literally impossible, as they are missing ROPs.

    The last generation that could is basically the Nvidia V100, and the datacenter equivalent of your Radeon VII. AMD removed the ROPs after the Radeon VII generation. The RTX 3000-generation Nvidia A100 can technically run a game if hacked to do so, but it performs extremely poorly because of a lopsided compute config.


    Now, if you are interested in GPU compute and self-hosting, maybe we can use them.

    But Nvidia learned to buy back and destroy GPUs during the last crypto bust, so I’m afraid they may do it again.


  • If I had a few billion for a TSMC factory, I would…

    This is what I’m referencing. The memory sits on the package with the processor, connected with thousands of microscopic traces, so fine it needs an expensive substrate rather than a typical PCB, and expensive equipment to assemble:

    The connectors are tiny, and made with immense precision. There are about a thousand reasons you can’t just transfer HBM once its been used, and besides; other memory controllers wouldnt’ support it.


  • HBM is only usable with chips co-designed for it, packaged on an interposer with microscopic traces. An enthusiast is not doing anything useful with it unless they own a few TSMC assembly plants.

    The CPU modules can be tricky, too.


    Now, some enthusiasts are already hacking. Go to the Level 1 Tech forums, and you’ll find a group trying to reverse engineer AMD Instinct GPUs designed for server motherboards, dealing with locked firmware, soldering stuff, you name it.

    …But you probably won’t like the end goal of the hacking: using them to run LLMs and other GPGPU stuff locally.






  • As the business? Like I said, I’d start with a text classifier, a small model quickly categorizes the input prompt. If it’s something off topic, I’d return some generic refusal reply, or maybe send the score to the LLM itself if it’s somewhat ambiguous.

    Chatbot UIs that give very quick refusals are using “filtering” models in just that way. There’s a whole world of language modeling that existed before LLMs, just for that sort of thing.

    Now, if I was the LLM provider? I dunno, but I would try to integrate it into the weights. There are some really interesting papers and hacks out there for prefiltering prompts that have nothing to do with system prompts.