Yes. Google was building custom HPC hardware 5-8 years before Nvidia decided to ... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		mike_d on June 13, 2024 \| parent \| context \| favorite \| on: How Meta trains large language models at scale Yes. Google was building custom HPC hardware 5-8 years before Nvidia decided to expand outside the consumer and "workstation" markets.

threeseed on June 13, 2024 [–]

Nvidia acquired Mellanox who know far more about custom HPC hardware than Google.

mike_d on June 13, 2024 | [–]

Mellanox and friends not being able to build fast enough switching gear at a reasonable price point was what got Google into the hardware game in the first place ;)

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact