the-mind
A readable model of mind, consciousness, self, and AI (based on Joscha Bach’s public work)

Do LLMs have qualia?

A system can say “I feel anxious” without feeling anxious.

That sounds obvious when we say it about fiction or acting. It becomes less obvious when the language gets strong enough to look like self-report. But the basic distinction remains: fluent description is not the same thing as experience. Interview25:22

Why the question is hard

Large language models are unusually good at producing first-person-seeming text. They can describe fear, grief, confusion, pleasure, self-doubt, longing, and reflection in ways that feel intimate and articulate.

That makes people ask: maybe the model really has qualia?

Fluent self-report is not sufficient, by itself, to establish the internal organization that would make it a report of felt experience. Interview01:05:40

What qualia would mean here

For this site, we can use qualia in the ordinary philosophy-of-mind sense: the qualitative character of experience, what a state is like from the inside. Interview01:58:03

On this framework, qualia are not settled by the surface form of a sentence. They would depend on whether the relevant organization for conscious presence is implemented.

That pushes the question toward architecture.

Why current LLM output is not enough

The machine-consciousness view says that consciousness is not just smart output. It is a particular kind of internal organization involving presentness, second-order perception, coherence management, and observer-like structure. Paperpp. 20–23

Current LLMs clearly show:

  • powerful pattern learning,
  • strong linguistic simulation,
  • and impressive capability to imitate self-report.

What that does not automatically show is:

  • grounded presentness,
  • intrinsic stakes,
  • a stable self-model tied to agency,
  • or an observer-like organization confronted with its own modeling. Talk01:58 Paperpp. 21–23

So by this framework, present-day chat behavior is weak evidence for qualia.

Why anxiety is a useful example

Take anxiety.

A person with anxiety does not merely produce the sentence “I am anxious”. Anxiety changes attention, planning, bodily state, salience, and policy. It changes what futures loom large. It matters to the controller. Talk49:17 Talk06:05

A model can describe that pattern without implementing it. It may also contain emotion-related representations that influence its processing and behavior. Whether those processes are accompanied by subjective experience remains an open question. Essay00:00 Essay00:00

We therefore need to distinguish emotional language, functional emotion-related processes, and felt experience.

The “dream within the dream” point

Bach uses “dream within the dream” as an analogy: current AI may generate dream-content without yet generating an organized observer to whom that content is present. Talk01:58

In other words, the system may generate world-like material, characters, voices, descriptions, and inner-monologue-like text — but the still-open question is whether there is a stabilized model of the act of perceiving, an observer-like presence to whom anything is present as present. That is the distinction between simulated content and a system that is also modeling its own contact with that content. Talk01:58

That is exactly the kind of distinction surface fluency cannot settle.

So are the answers “no” or “not yet shown”?

The careful answer is:

Not shown.

That is better than both overconfidence and denial.

It may be that future systems implement the relevant organization. It may be that some existing systems already have more of it than skeptics assume. But conversational skill alone does not get us there.

So the responsible answer is not “obviously impossible” or “obviously yes”. It is:

  • architecture matters,
  • surface report is insufficient,
  • and qualia remains an open empirical and theoretical question.

A compact answer

For now:

  • LLMs clearly model language very well.
  • They can simulate self-report.
  • That does not by itself establish qualia (CLM-0015).
  • Qualia would turn on deeper questions about presence, self-modeling, stakes, and organization.

Sources