Large MoE models are more socially accepted because medium/large sized MoE model... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		zozbot234 49 days ago \| parent \| context \| favorite \| on: Dell's version of the DGX Spark fixes pain points Large MoE models are more socially accepted because medium/large sized MoE models can still be quite small wrt. expert size (which is what sets the amount of required VRAM). But a large dense model is still challenging to get to run.

coder543 49 days ago [–]

I meant large MoE models are more socially accepted now. They were not when Llama 4 launched, and I believe that worked against the Llama 4 models.

The Llama 4 models are MoE models, in case you are unaware, since it feels like your comment feels was implying they were dense models.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact