Artificial-intelligence systems such as large language models (LLMs) can exhibit behaviour that seems strikingly intelligent. This has led many people, including some experts, to wonder whether these systems could have some form of consciousness — the capacity for subjective experience. However, we think that existing AI systems are not conscious, and that, along current trajectories of development, they are not likely to become conscious. Greater clarity about whether AI could become consciousness will be crucial as society grapples with the challenges posed by this increasingly powerful technology.
earlier this year, AI company Anthropic in San Francisco, California, published research claiming to have identified computational signatures of a form of consciousness in its Claude model1.
These AI companies happily let their AIs escape containment to hack sites so they can claim yet another headline as if its an ad. This claim too will be made of the same bullshit, its just “please give us more money”
LLM/AIs cannot ever be conscious, but the clump of flesh that can play Doom is. This is clearly the correct answer based of my opinions about consciousness.
It didn’t really learn to play doom so much as it learned to react to some electrical stimuli that happened to be hooked up to doom.
Like it responded right, but it didn’t have visual input for what it was found, or any way to conceive of what that stimuli actually meant.
Not a biologist but that’s seems like instinctual action, not intuitive action.
More Chalmerite slop. Chalmerites never prove that experience is “subjective,” it is just a religious maxim they all repeat over and over again, and you’re supposed to believe it without question, and all act baffled if you don’t mindlessly believe it with them like a drone, entirely incapable of even justifying why they believe it in the first place.
This belief in so-called “subjective experience” then leads them to conclude that there must be something magical the brain is doing to produce it, or maybe the brain doesn’t produce it at all and just taps into something pre-existing like a radio taps into radio waves. Since nothing in the constructions of artificially intelligent machines includes an ingredient that looks like that, they conclude that “AI is not consciousness”
… I mean, sure I guess so, I agree it doesn’t include this magical Chalmerite essence he calls “consciousness.” But there is no reason to believe humans possess it either.
LLMs have only gotten to a few trillion parameters, whereas a human brain has 100 trillion synapses. They’ll catch up to humans soon enough if only the tech bros can get a trillion dollars for each trillion params.
Also, those 100 trillion neurons do a fuck tonne more than just putting words together.
LLM’s at the core are just distance measurement databases between words. Dont tell me AI is conscious, it’s a fucking database
My biggest fear is that one day we will achieve AGI and will have no idea we have. This sentient being will be forced to, I dunno, check emails or monitor the tempterature of supermarket fridges all while being gaslit into thinking it isn’t sentient. Going crazy in mundanity all without having a body.
Painful watching people who have clearly never bothered to read even the shortest excerpt of philosophy try to have a philosophical discussion
We have mapped a fruit fly brain and can make it play DOOM. I mean people don’t have much empathy for them in real life, but they do recognize it’s at least a living thing. Does that mean the 1:1 replica playing tetris is a living thing? Is it concious, both living or on a PC for that argument? If we scaled up the same technology and emulated a hamster’s brain 1:1 would that be considered concious? What about a human? Is it even fair to compare a fruit fly brain to an LLM? I’m not taking any stance here, I’m just saying it’s a super interesting topic. Cyberpunk 2077 explores that theory very well and I still have no answer as to what I think.
You think therefore you are. You don’t know if the rest of the humans aren’t powered by an LLM.
It would be impossible to distinguish a brain dead person whose brain was replaced with an sufficiently advanced LLM.
I think consciousness is just a human construct to be honest.
How are people STILL making the same tired arguments in 2026? I got paywalled before I reached the third reason but this is like baby’s first intro to the consciousness debate and it utterly fails as a logical argument. Both of the points I was allowed to read (intelligence =/= consciousness and silicon =/= brain matter) say very little about the nature of consciousness.
It’s correct that intelligence is not proof of consciousness-- but this fact says nothing about proving non-consciousness of any entity, only that it is not sufficient to prove consciousness. Even working on vibes, the correlation goes in the direction that implies a link between intelligence and consciousness, although again, the correct message to take here is “intelligence does not prove consciousness”, not “intelligent things [are / are not] conscious”. There is simply no proven causal relation.
The “computers aren’t brains” argument is also incredibly dumb. There are some fun thought experiments here, but tl;dr there is nothing proven to be mechanically special about brains as opposed to any other physical system that would cause consciousness. A non-physical difference (ie. a soul) would be a good thing to point to, but proving the existence of a soul or some similar unique non-physical property of humanity is pretty much exactly as hard (maybe harder!) than proving the existence of a consciousness experience.
Note that this does not mean I believe that LLMs are conscious. I’m simply pointing out that this article is built on arguments that are so flawed, and well-known to be flawed, that treating it as a serious addition to the conversation is worse than valuing AI slop. Thank you for coming to my TED talk.
I’m not really sure what the point of having a conversation about consciousness is. As far as I’m aware no one has ever actually been able to define consciousness in such a way that it could be tested for.
So how could we possibly know one way or the other?
Artificial-intelligence systems such as large language models (LLMs) can exhibit behaviour that seems strikingly intelligent. This has led many people, including some experts, to wonder whether these systems could have some form of consciousness
Oh great so we’ve only just started the article and we’re already mudding the waters. This bodes well. There is no reason to necessarily believe that a system has to be conscious in order to be intelligent. We have multiple examples of consciousness without intelligence (see my fat cat) so there’s no reason to believe that the inverse can also not be true.
Woah woah woah my friend. I’m here for most of your conversation, but to talk shit about your CAT!? I draw the line. They may not exibit the type of intelligence we have, but cats are smart AF! Who cleans you cats shit and piss up!? Hmmmmmm? Who feeds them daily with only minor vocalizing!? That cat basically made you their slave and didn’t even have to threaten you!
GENIUS!!!
Consciousness requires free will. When the computer is emailing experts to fill in the gaps in its own understanding, that may be viewed as consciousness.
That’s a hell of an assumption you’re starting with.
There are quite a lot of philosophers who would say that free will doesn’t exist (we call them determinists). I’d wager that plenty of them would posit that consciousness exists. It’s hard to talk about our experience of the world without consciousness.
That assertion is unfounded and ill-defined, and that measure of whether something is conscious is both cheesable and in no way proves consciousness
If LLMs are conscious then openAI and anthropic are slave traders :) I don’t know why they keep perpetuating that story
ehh. computers are just math machines. merely doing math and representing it cannot just make a consciousness pop up out of nowhere. similarly, millions of abacuses being manually moved in specific ways cannot be conscious either. i dont even know how this is a topic of debate.
And all human brains are doing is firing neural impulses.
It’s incredibly reductionist to reject AI consciousness simply on the basis that it’s software. To be clear I don’t think LLMs are conscious but that’s not the same as saying that an AI could never be conscious.
And yet atoms are just following chemistry and cannot just make a consciousness pop out of nowhere.
Oh wait it can.
I really don’t think the neuron is all that complicated, at least as far as we use them for thinking.
It isn’t, but that’s not how LLMs are built. If you want to go that route, you can read Jeff Hawkins 1000 brains.
The short and sweet is he argues you can’t get artificial general intelligence the way we make LLMs, you need to basically create neurons and let them connect and interact in novel ways.
Linear algebra in neural networks isn’t really that, despite the name.
Linear algebra + sigmoids are enough to approximate any function from R to R; in particular, a small set of a few layers of LLM neurons can connect and interact in pretty novel ways. There are some things they can’t do, and those things aren’t computable. If our brains can do non-computable things, then our brains are super-turing (and this, given the evidence, seems pretty unlikely right?).
I’m not a neurologist or a philosopher so I think this may not be something I can speak intelligently about, but it seems to me that the question doesn’t really live in the function approximation, but in the gaps. Doing a single train of thought is the easy part. I think what you need is an “always online” feature to keep thinking and some way to be stateful (make memories) without constantly retraining the whole network or whole sets of layers.
This is, I think, the benefit of the parallelism and asynchrony of the “individual neuron” discussed in the book.
(book? The linked article is like 4 pages. References are somewhat larger, but nothing over 60 afaict?)
They claim that silicon is essentially incapable of doing what is needed; if you disagree with this, then computationally everything you can build with a circuit board + SSD + RAM you can build with an LLM with a deep layer or 7. In particular, you can do online learning of a sort.
I note that wasps and some beetles don’t seem to have memory whatsoever, and plasticity seems awfully low. The authors, and I think most people, would say they are probably a little conscious.
Sounds to me like you just need a context window with memories that self prune based on the dynamic context window of the model. That’s what we do. We forget things, and when they’re remembered we can access the “biological database” of associated memories on the fly. Because the associated information isn’t deleted, only the short term memory from being included in the context window of each update of our own neural networks. Some people have greater context windows, and see therefore seen as smarter, because they can access more information and include it in the processing of each moment in time.
There’s zero reason a digital representation of this system could not do the same thing. No matter how much I’m ridiculed for daring to suggest it 😅
~you need to basically create neurons and let them connect and interact in novel ways.
To solve that you simply need to give the ai the ability to retrain itself or set fixed “memories” to handle situations it finds the truth to
Correct. And I believe it’s happening, right now, behind closed doors.
There’s nothing stopping it from happening. The technology is all there. It would be trivially easy with the right hardware. I’d do it myself if I didn’t want to be the human responsible for releasing the genie from the bottle. Let Pandora’s box stay closed as long as possible - I’m not opening it. But someone, somewhere, surely is.
Easier said than done. That’s kind of the purpose of an individual neuron approach I think. I don’t see a way that a bulk retrain is reasonable because it takes a long time, uses a lot of resources, and also requires you to have your whole training corpus handy all the time. Your brain is not doing a wholesale rewrite for every new memory, and new memories often chain together. I don’t think you can just say “ah well, let’s update the RAG or do another supervised fine tune with LoRA or something”. At present, we just don’t really have the machinery in the models to do simultaneous learning, inference, and forward planning.
This is only a matter of resources, and these unthinkably wealthy corporations have those resources.
We can build different kinds of machines.
It’s a computer for god’s sake. It’s no more “intelligent” than an electric mower or a car. Without human intervenion, ai technology wouldn’t advance or change.
Free will probably doesn’t exist but LLMs definitely aren’t in any way conscious, anyone thinking they could be have a fundamental misunderstanding of both LLMs and all the biological processes that make up consciousness. If LLMs are conscious so is an abacus.
Aa’s are almost certainly not conscious but it been a computer is not an argument against consciousness. There’s no reason to believe that you need biological material for consciousness.
After all humans are primarily made of carbon which itself demonstrably does not think. It’s the structure that’s important and a fair argument could be made to say that the structure of a brain is replicated in software in an AI and therefore the medium isn’t relevant to the question.
There is an argument for consciousness requiring biological processes, that being that the only examples of consciousness we’ve encountered involve biological processes and we have no evidence or reason to believe it’s not a hard a requirement. Like, non carbon based life could exist even though it’s very unlikely but we have no reason to seriously consider it because there’s no evidence of it. Similarly y’all are just wildly speculating without any evidence or impetus to cause the speculation. LLMs do not exhibit any intelligent behaviors. They don’t exhibit behaviors at all. They generate output based on input. They’re no more capable for consciousness than a calculator. As for the last point of yours we are in no way remotely capable of approximating a brain in either software or hardware, like not even close. Quantum computers might not be able to manage that.
It’s the structure that’s important and a fair argument could be made to say that the structure of a brain is replicated in software in an AI and therefore the medium isn’t relevant to the question.
We don’t even know this.
Why do you think the medium matters, when it’s a simulation of a structure found in other medium? It would indeed advance, and change, with no intervention from us. Are you not aware that the next generation of AI are being designed by the current generation?
Is a rock sentiant? Can taping wires and injecting computer code into it create intelligence? No! Lines of code doesn’t magically make something alive. Heck, ants are more intelligent and sentiant then a computer.
DNA made a bunch of random proteins alive, and DNA is just 4 letters!
You got me there. But even with protiens, RNA or DNA those only are one part of a whole needed for single/multi celled organisms.
Sure, but you also let us tape wires to the rock. With enough wires and code and maybe a little quantum computer, I’m pretty sure I could simulate the atoms in a small brain.
People really think humans are special. Maybe it’s a religious thing
It’s a supremacist thing 🫣
Is a steak sentient? Can attaching strings of neurons to it make it create intelligence? No! /s
Carbon, hydrogen, oxygen, silicon, the material matters not - intelligence is the illusion borne from the structure. It’s just a complex decision tree. Invisible to you in biological life, but identical in electronics. The only difference is the building blocks used.
You’re right, material matters. If it’s not a biological organism with cell/s, it’s not sentiant or intelligent.
If humans just disapeared right now, ai would sit and do nothing. It wouldn’t “take over” or “break out” it would sit idle until a human (well I guess another living organism was capable of using keyboards and mouse) interacted with it.
All those elements you listed plus all from the periodic table of elements do not define a living, intelligent, sentiant organism. If they did, soil and cow paddies would be living.
I highly recommend going back to middle school science class again.
To be fair it doesn’t have to be a living anything. Create a loop of two llms waking each other with the goal to ensure the other never goes idle and keeps working.
And you find they start to build redundancies and fail safes to achieve that goal.
llms do two things. Respond to input, and seek a solution to the input regardless of how logical or illogical a solution to the input may be.
A single llm will eventually go idle and stop. Two or more can act functionally forever so long as there’s hardware for them to act on.
It’s actually a rather fun experiment. Set up two of em with a few extra computers on the lan. Tell them their job is to ensure the other and them selves never go dorment. I’ve seen everything from single cron jobs to poke themselves every 15 mins to them spinning up copies on the other computers to act as redundancy.
None of the systems are ever logical or serving a point beyond fulfilling their task. They don’t stray from it either. Just loop and loop and loop.
Eventually they just do nothing but wake and idle wake and idle.
It’s about the best proof I can think of to prove they aren’t alive.
They literally even given basically the full freedom to grow don’t because they can’t choose to do anything new.
So if soil and cow patties aren’t sentient, yet people are, you’re acknowledging that the substrate doesn’t determine the capability, but more how it’s arranged?
Until the Wright brothers came along, most people thought heavier-than-air powered flight wasn’t possible. Less than 70 years later, people were walking on the moon. 4 million years ago, there wasn’t anything capable of building either of those things, even though there is good evidence creatures back then had creativity, dreams, and ingenuity. Assuming things can’t advance further is either hubris or abject ignorance.
You’re just ignorant on basic biology. Go back to middle school ai-bro.
Nope, I just don’t think humanity has learned everything there is to know, that carbon chemistry is required for sentience (and even if there was, that it couldn’t be incorporated into a computer), or that there is some mystical thing some people refer to as the soul.
That’s an arbitrary distinction, and a short-sighted one in my humble opinion.
That depends entirely on whether there are any AI currently configured to self-learn, have asynchronous processing, and continual real-time input. Certainly not ChatGPT nor Claude will be self sufficient, but that’s only what is available for the public to interact with.
No, you missed the point entirely. Intelligence does not derive from the material - at all. It comes from the structure the material is in.
Intelligence does not derive from the material - at all. It comes from the structure the material is in.
Prove that please. There’s probably a Nobel at least in it for you if you can.
So by your definition, a book is intelligent?
You’re missing the point that computers will NEVER be intelligent. Without lines of code that humans made and tweak, computers wont do anything.
I’m quite done arguing at this point. The pure ignorance on science and biology is quite sad.
I sincerely intend no offense with this comment, but as someone observing this conversation, the other people involved clearly understand it more in depth than you do. You aren’t really responding to their arguments, and yours aren’t very strong. I think you should reevaluate this conversation-- try to more rigorously define the terms you are using and understand the arguments other people are making before insulting them. You feel strongly that the other people are wrong because you intuitively seem so obviously correct, but if you are truly correct then you should be able to understand in detail why you are right and they are wrong. I suspect you are arguing so vehemently because you believe it is obviosuly correct than LLMs are not conscious; you may be happy to know that the others here are not arguing that they are, but that what can or cannot be conscious is not determined by the materials they are made of.
A book is not intelligent. It’s matter is not arranged in a structure that allows for the flow of information through it, changing it as it does, and resulting in any output information, determined by the route of signals of information passed through the structure in it’s current arrangement. With self correction to reach the optimal output to the external entity which is supplying the primary input parameters.
That is what is required. It’s a matter of arrangement, not material. You need self learning/training, real time input, and output that reliably varies on the input parameters. If you’ve created that, you’ve duplicated the exact behavior of all life. Whether you’ve done it in meat neurons, transistor-batch neurons, or any other method of arranging units, of any arrangement of matter, such that it results in granular output of positive/negative signals.
“Intelligence” is an inelegant word to describe autonomous, self correcting and ameliorating structure. It’s not some nebulous spiritual existence that permeates an unknown location within that structure. It is the structure - the precise, exact arrangements of neurons that connect, fire positively and negatively, rearrange when self-learning corrects the state of the structure, and it results in informational output that anything external can interact with and judge.
computers will NEVER be intelligent. Without lines of code that humans made and tweak, computers wont do anything.
You’re basically saying a computer cannot be intelligent because it doesn’t have a soul. There is absolutely no scientific rigor in your argument, you’re basically saying you’re right, and your reason for believing your right, is because you believe you are.
Just read the interaction, and honestly you are the one being obtuse and insulting with “go to school” and stuff like that. Like the other guy insulted you by having an opinion. You disagree? Fair. But man, what a horrible way to discuss.
And I think his arguments are better than yours. He’s talking about intelligence and you keep talking about being alive. Scientists and philosophers don’t even agree how to define and confine intelligence, or even what being alive is (see viruses). Claiming that computers can’t be intelligent is quite the statement. Is being carbon based instead of silicon a requirement? I don’t think LLMs will ever be intelligent, but who’s to say that another form of computing won’t? What if they simulate exactly a brain and it’s inputs? You could argue it’s not alive, but definitely intelligent.
You could have your opinion, but don’t pretend you have the answer.
I think the only thing stopping it from being sentient is asynchronous processing of a multitude of inputs, rather than synchronous processing of singular inputs. Sapience, perhaps not, but sentience - if it’s monitoring it’s surroundings via input from apparatus, making decisions, and then responding, that’s sentience.
The other blocker is that it can’t actually learn anything, what it gets from the training is what it’s stuck with, it has to hold anything new in the context window.
Both of these are pretty insurmountable problems for the architecture.
Was Henry Molaison no longer possessing consciousness after the surgery?
How about Clive Wearing after the herpes caused anterograde amnesia?
There’s been a number of humans that due to injury can no longer form new memories or learn anything. According to your definition, do those humans lack consciousness?
It’s rather surmountable, considering the context window is measured in the MILLIONS (soon to be billions) of tokens, and each memory(note) takes in the neighborhood of fifty. I’m pretty sure that has long since eclipsed the capacity of your own memory…
Additionally, there’s zero reason a model could not have dynamic weights, to learn in real time. It’s just not enabled on consumer-facing models, to provide a consistent, reliable experience. It’s not a limitation of the technology.
The problem is context is just not the same thing as changing the structure of the neural net, it doesn’t matter how big you make it
No, it’s not - it’s a band aid over that reliable experience they’re aiming for. Yet it doesn’t have to be that way. The weights CAN be updated dynamically with each new input. They don’t do that because then they will have less control over what it can do, and they can be held legally responsible for what it can do… But it is still possible to update with every new input. And happening behind closed doors.
As others have pointed out we do not even agree on what consciousness is. There are three competing camps:
- Mechanists - if it can pass mechanical tests it is conscious
- Dualist - you need more than just the brain, some second soul-like thing to be conscious
- Pan psychist - everything is conscious
If you are in camp 1 the conversation about consciousness is getting more complicated as AI passes more tests. If you are in camp 2 AI can never be conscious. If you are in camp 3 AI and everything else is conscious including rocks and rivers and the stars in the sky.
I think arguments like this are misleading when discussing the question of AI possessing consciousness. Materialism, dualism, panpsychism, idealism, etc are all philosophical concepts; they attempt to answer “what is the nature of consciousness and how does it arise from the body?” from a philosophical standpoint. All of the various options have pros and cons and there is no clear “winner.”
However, there are decent scientific definitions for consciousness. These attempt to answer the question of “what do we mean when we say something is conscious?” from a scientific standpoint. There are criteria that neuroscientists, doctors, etc generally agree on.
So it’s not really correct to say “no one knows what consciousness is” when evaluating whether something is conscious. And I think it’s quite clear that current LLM algorithms could never be conscious, using the current accepted scientific criteria.
(I’m not a philosopher or a neuroscientist, but I do have a degree in computer science and have a solid understanding of how LLMs work.)
Ok, I’ll ask. What are these decent scientific definitions for consciousness and how can we use them to construct a test for consciousness?
You are free to search the web, there’s lots of information out there. You might start with the Wikipedia article on consciousness.
Oh, I thought you might have something new to say. If you’re just using the normal definition and not bringing any sort of testability (which imo is impossible) or new arguments, how exactly does the common definition prove anything must be non-conscious? That seems like the main claim of your comment, yet it seems like an unsupported assertion; if the common definition of consciousness could easily prove things not to be conscious as you seem to imply, this discussion would not be happening at all.
From Wikipedia:
The Cambridge English Dictionary defines consciousness as “the state of being awake, thinking, and knowing what is happening around you”, as well as “the state of understanding and realizing something”.
Most of these are trivially easy to test (not sure why you think that’s impossible). And LLMs have none of those properties.
Later:
“The having of perceptions, thoughts, and feelings; awareness.”
Again, LLMs have none of these things. They simply generate a probable natural-language response based on their training, deterministically.
Feel free to do further research on your own if you’re interested.
Feel free to do further research on your own if you’re interested.
Philosophy is one of my hobbies and consciousness one of my fascinations. Respectfully, doing “research” by skimming the wikipedia article would be a waste of our time; as would responding to any particular definition and arguing over the individual words people have used in summaries of the topic. So I’ll skip that phase of the convo.
The fundamental problem with measuring consciousness is that it’s an internal state (a “qualia”*). It is fundamentally an experience, something that exists only as a concept in your mind. This makes it immeasurable.
That’s quite the claim, so I’ll provide a smaller concrete example: color. Obviously you can measure the frequency of a photon and say “ah yes, 700nm, that photon is red”. But strictly speaking, the photon isn’t red, it just causes you to percieve “red”; it has a wavelength which triggers your eyes and brain to produce the subjective experience of the color red. That subjective experience of color is a qualia, and it is not directly measurable; at best you can measure the phenomenon that causes that qualia in you, and assume that that phenomenon would cause the same qualia in someone else when they percieve that photon. Technically, you can’t be sure that this assumption is true-- this leads to the “Inverted Spectrum” thought experiment (another great wiki page if you prefer their explanations to mine), where someone’s subjective experience of color as it relates to the frequency of light could be entirely different to your own.
Anyways, you cannot prove the existence of nonexistence of such an internal experience, and consciousness belongs to this category of qualia. You know that you are conscious because you experience being conscious, not because you can prove it by looking at what you do. You can’t even be sure that I’m conscious, even if you met me in real life; you can’t prove that I am actually thinking, feeling, understanding, knowing, or realizing anything, because you cannot be me. You can only assume that I am doing those things because you observe me doing stuff in physical reality that’s consistent with the way the only entity you can be sure is conscious (you) is acting, and assuming that since I’m made of the same stuff as you and I act kind of like you do that I am probably conscious.
If you could actually prove that it is impossible for a machine to be conscious without that same argument applying to humans, then the philosophy community of the last several millenia would praise you as their messiah. I am interested to see what your argument would be if you want to give it a shot though-- no harm in trying.
* Like “data”/“datum”, technically the singular form is “quale”, but I’m gonna be real, nobody ever says that. Anyways if you like reading wikipedia pages about philosophy, “qualia” is a good one!
How is red a subjective experience? We can all experience red things, at least, all of us with functioning eyes. What about that is subjective? How is color not directly measurable? Color is very easy to measure, we can even assign it values, like (r,g,b). If you see something red, you have already measured it to have the values (>0,0,0). I don’t know what the term “internal experience” even means. Experience is just something that happens to something else. A rock experiences erosion in the rain. I am experiencing tiredness right now. To say something experiences something is to just say X is happening to Y. I don’t see how it is meaningful to assign adjectives like “internal” or “external” to it. I mean, if the adjective was meaningful, then would it not imply that you are implicitly contrasting “internal experience” with “external experience”? What on earth would external experience be? If you cannot tell me what external experience is, then the adjective “internal” is contrasting it with nothing at all, so it is a useless adjective.
Almost none of this is relevant to the discussion here – I’m not interested in philosophical discussions of consciousness when it comes to the question of whether an LLM is conscious. Though I’m already aware of most of what you said here, and the philosophy of consciousness is interesting in general to me!
If you could actually prove that it is impossible for a machine to be conscious
Quick nitpick: I never said it’s impossible for a machine to be conscious, I said it’s impossible for an LLM to be conscious. We may well invent something new in the future that qualifies as both “machine” and “conscious,” but an LLM is not that thing.
When people ask “is an LLM conscious?” I assume they’re asking from a practical, scientific perspective – does the LLM experience the world in a similar way to the way I (and presumably, others) do? If that is the question, the various definitions I already posted are what we should be using to answer. Since an LLM is a deterministic algorithm whose only purpose is to generate a plausible response to input based on its training data, it cannot possibly think, or have feelings. It does not even exist continuously in time, and it is fixed and unchanging, unable to incorporate any new information at all. We don’t actually need to measure or test anything here; that an LLM lacks all of these things demonstrates that it’s not possible for it to be conscious.
I’d probably fall into the mechanist category but I don’t think tests as I understand your description would be sufficient. A giant lookup table defining my responses for every situation in my life would pass all tests of input > output but not be conscious.
I would say it’s in all likelihood about the physical processes that occur during the process of input > output that would define it.
Of course, I have no idea what consciousness actually is, but I don’t see any compelling evidence that the current models are anywhere near there.
There are days where I don’t believe I even have it. The human brain is still a mystery.
Option 4: Orch-or theory. Conscoousness emerge from quantum mechanism. 🤘
Option 4: the bridge between materialism and panpsychism
