Having run models locally, RAM use seems to be almost directly proportional to number of parameters. 8 Billion parameters requires approx 8GB of VRAM at 1/4 precision.

Therefore, if this pattern holds you somehow need 10 Terabytes of VRAM at 4K and 40 Terabytes at full precision.

I think I saw some estimates that Claude’s Opus models may be and Opus model equivalents may be at around 100B parameters (100-400GB VRAM).

TLDR its clear why RAM is so expensive.

Thanks. That’s very helpful.

Why is it supposedly illegal to do this? Being American is not a protected characteristic, no?

They do. I have had their M6 mouse for a few years.

It’s fairly good but after some time the side-ways scroll wheel failed for me. It also doesn’t track as well on some surfaces as my previous Logitech, but otherwise it’s good.

Sure enough, 32 out of the 35 students across two classes simply copied the question, pasted it into a chatbot, then copy and pasted its output into the answer window.

That’s an insanely high proportion. I don’t think I’ve ever cheated on an exam or assignment, so the concept seems kind of weird to me.

I wonder if some of the remaining people used AI but then reviewed the output and removed the weird stuff, or if they wrote it themselves.

If you’re looking for declarations, some languages use const, let or var followed by the name of said variable. That’s a little easier to find than having a type name at the start, so I don’t think what you’re saying gives the other approach an advantage. The indentation is also more consistent with these keywords, which helps.

I realise some languages (like Python) don’t use these sorts of keywords during declaration. For those languages it could indeed be a disadvantage.

As other users have said, we aren’t compilers.

Types are important for type safety, so you don’t access properties that don’t exist, can use polymorphism etc. However, having worked in both duck-typing and hard typing languages, I believe the most important part of a type is it’s name.

Classes are are arbitrary constructs we create to help us understand and manage code. They are inherently organisational structures.

That may sound like an argument FOR putting the name of the class first. “If I know it’s a ConnectionCredentialsQuery, I don’t need to know it’s name, the use-case is evident!” Classes often get reused though, like a CartesianPoint. You may create several instances of them. Which of the name and type below are more indicative of use?

CartesianPoint PlayerPosition; 

Types are, to some extent, implementation detail. The name tells you what the variable is for, which is more important.

Another point: You will always need to name variables well, because after declaration, whenever you see a variable, you will only see its name. You want to be able to fully understand what you are looking at without having to mouse over or go back to the declaration of a variable.

Additionally, many typed languages will allow you to use a syntax to altogether avoid declaring the type of a variable if derived from somewhere else.

var result = a + b;

var customer = new Customer();

Given that the type can be inferred, and therefore specifying it explicitly is optional, why make it the first thing you see? That means you need to move your eye back and forth when looking for the names of things. Which of these two are better for legibility:

var result = a + b;
CartesianCoordinate playerPosition;

const result = a + b;
let playerPosition: CartesianCoordinate; 

Finally, you say that types are more important because they are important to the compiler, but compilers don’t care about the order of these definitions. Compilers exist to allow us to write easier to read code. They exist to convert high level languages to low level byte code. They exist to enable more readable code.

Thank you for coming to my TED talk.

I bought a Hisense fridge and Hisense washer dryer a little under 5 years ago and they’ve been working flawlessly ever since.

Damn it I’m not in there

🎵 Well, some of us are cannibals who cut other people open like cantalopes 🎵

With EU customers, not reporting a breach within 72 hours of learning about it is actually illegal under GDPR.

https://gdpr-info.eu/art-33-gdpr/

Not sure how much trouble that can get you into though.

Yeah, it is effectively subsidized by VC right now.

I expect what will happen after the bubble bursts is that the only affordable models will be quite small ones, not the energy chugging behemoths we have now.

They’ve already started cranking up prices in enterprise.

This seems to be his view:

In the kernel community we do open source because it results in better technology, not because of religious reasons.

He doesn’t seem to subscribe to the idea that everything you use MUST be open source, as some more radical open source advocates do, but instead that more software SHOULD be open source.

I would definitely prefer if AI was open source and self-hosted (or at least E2EE if cloud hosted). Sometimes though the best tool for the job as things stand is closed source.

Aa for the legally dubious output, while AI can exactly replicate training data, it rarely does nowadays. It’s usually an amalgam of stuff.

I realize that some people really dislike AI, but this is an area where I’m willing to absolutely put my foot down as the top-level maintainer. Linux is not one of those anti-AI projects, and if somebody has issues with that, they can do the open-source thing and fork it. Or just walk away. AI is a tool, just like other tools we use. And it’s clearly a useful one.

I think broadly speaking what he says is reasonable. If you don’t want to use AI, then don’t, but I think it can be used somewhat responsibly.

I have all sorts of issues with AI tooling:

• the centralization of power
• the load it adds on maintainers because of the amount of slop bad developers (and non-devs) produce with it
• the environmental impacts of using larger models
• the data centers causing health risks
• the impact on the PC industry
• the degeneration of skills and knowledge.

That said, it’s a tool, and can be used to amplify good work too.

If you download this picture you get a 5MB ~14000x19000 pixel image that will slow down your whole PC when rendering.

Kind of links well to the lack of efficiency of AI so I think that’s part of the art.

Did Edna Mode tell you that? She was correct.

Not all heroes wear capes.

Yeah I can’t deny that. Platforming bigots is not something an organization like the BBC should do. Reality has a left-leaning bias, and the BBC over-corrects.

It’s not my first choice, clearly, but it’s ok on some topics. Others I don’t even bother to read what they have said.

The Telegraph is outright terrible. The only more right wing paper is probably GB News.

I’d focus on using left or center-left publications like The Guardian and The Independent.

There are some further left publications such as Novara Media and The Canary (they’re better on some issues where others are too cowardly, like Gaza or trans rights). Though I’m not sure how accurate they are on everything.

On some issues the BBC is fine too, just not Israel and trans rights.

My point being, we are stopping pretty low if we reach for the Telegraph.