Apple wants to vertically integrate. Their AI strategy until recently was to develop their own LLM models that were small enough to run on device. But massive scaling is what makes LLMs so powerful, so all their internal models were terrible and unusable.
Basically they bet that compute efficient LLMs were the future. That bet was wrong and the opposite came true.
Basically they bet that compute efficient LLMs were the future. That bet was wrong and the opposite came true.