dream_weasel

Easier said than done. That’s kind of the purpose of an individual neuron approach I think. I don’t see a way that a bulk retrain is reasonable because it takes a long time, uses a lot of resources, and also requires you to have your whole training corpus handy all the time. Your brain is not doing a wholesale rewrite for every new memory, and new memories often chain together. I don’t think you can just say “ah well, let’s update the RAG or do another supervised fine tune with LoRA or something”. At present, we just don’t really have the machinery in the models to do simultaneous learning, inference, and forward planning.

I’m not a neurologist or a philosopher so I think this may not be something I can speak intelligently about, but it seems to me that the question doesn’t really live in the function approximation, but in the gaps. Doing a single train of thought is the easy part. I think what you need is an “always online” feature to keep thinking and some way to be stateful (make memories) without constantly retraining the whole network or whole sets of layers.

This is, I think, the benefit of the parallelism and asynchrony of the “individual neuron” discussed in the book.

It isn’t, but that’s not how LLMs are built. If you want to go that route, you can read Jeff Hawkins 1000 brains.

The short and sweet is he argues you can’t get artificial general intelligence the way we make LLMs, you need to basically create neurons and let them connect and interact in novel ways.

Linear algebra in neural networks isn’t really that, despite the name.

its a it’s an epidemic / its a it’s endemic

It will make me drive in the wrong side?

suttle subtle*

Ah yes. Beginner.

It was worth the wait.

I heard Mormon teens use that turn of phrase for a different thing.

Sounds like something the Russia might say… 🧐

I AM THE CONCEPT OF TIME

Shredder is busy with the turtles I think.

I think it depends what you’re cooking. Of course it’s not cheaper to eat at home on the days that I’m busting out dry aged prime ribeye. But the days that I’m doing teriyaki chicken bowls on the grill over rice, that’s obscenely cheaper than like $15 per person fast food meals.

You’ll feel better and it’s likely to take you less time than ordering and waiting for something to show up. If you’re just doing pick up, it will save you 2/3 of the money you’re working doubles to make and then lighting on fire to eat fast “food”.

If you’ve got a rice cooker and a toaster oven I’ve got a couple of recipes less than 10 mins of actual work. I understand not wanting to work too hard at it too though.

Cheaper to eat at home.

Who growin they tiddies on they hands?

#powermoves

You’re one pope behind bro.

I would have expected what you got TBH. Some bonus points for being a lady breaking into the space.

when and*