My hunch is that, with regards to consciousness, the advanced LLMs are like self driving cars with an empty driver's seat.

It may be that they could be a component of a consciousness when combined with other systems that confer memory, learning, intent and some sort of reflective activity like 'daydreaming'. Maybe those components could all still be LLMs, tuned to different roles and prompting each other..

But that's just my lay persons musings.