You use words as labels so that we use our pre existing knowledge of the word to derive meaning from the label.
It's actually the reason LLMs work in the first place.
No one's going to let an LLM near anything important until then.