Hardware

Dev gambles on ‘obviously fake’ $8K Grace Hopper system, scores $80,000 worth of hardware on Reddit for one-tenth of the cost — buyer’s haul includes 960GB of DDR5 RAM worth more than what he paid for the entire rig

Published

on

[ad_1]

Would you like to run 235B parameter LLMs at home, but your lowly $10,000 budget restricts you to “consumer GPUs that can barely handle 70B parameter models”? This was the situation developer David Noel Ng found himself in, until he stumbled across an “obviously fake” Nvidia Grace-Hopper platform being sold on Reddit, of all places. Ng took the gamble and, according to his blog post, it paid off royally. He’s managed, with a bit of tinkering and fixing up, to get an enterprise system that…

[ad_2]

Source link

Exit mobile version