Indeed, the human brain has much more logical parts. They all run at sub-MHz speeds though, and don't seem to be using matrix multiplication (which is still worse than quadratic with the best algorithms we have).
Also, human brains do a lot more than language processing.
LLMs are definitely touching something very important about intelligence, much like counting sticks touches something very important about numbers. But the real power of numbers is unleashed with the invention of digits and positional notation, a different representation that makes things literally exponentially easier.
I hope there is a transition step from what we do now using billion-parameter models, to some better representations, more compact and thus more powerful.
Also I hope that ready-made logic and efficient numerical computation can be connected to the learning systems more directly, not taught painstakingly from first principles, much like vision is relatively directly wired into the human brain.
Also, human brains do a lot more than language processing.
LLMs are definitely touching something very important about intelligence, much like counting sticks touches something very important about numbers. But the real power of numbers is unleashed with the invention of digits and positional notation, a different representation that makes things literally exponentially easier.
I hope there is a transition step from what we do now using billion-parameter models, to some better representations, more compact and thus more powerful.
Also I hope that ready-made logic and efficient numerical computation can be connected to the learning systems more directly, not taught painstakingly from first principles, much like vision is relatively directly wired into the human brain.