DGX Spark

nvidia is being affected by the dram most likely. they dont make parts in house they actually buy them. if its short everywhere then nvidia cant buy their parts to make their new stuff they might sell the shovels but they are starting to get expensive to make. meanwhile apple jumped in to make custo

NVIDIA did - they call it the DGX Spark. I have one. 128 GB of LPDDR5X memory to the Grace Blackwell chip. $3999 retail. Apple could smash this thing to bits with an M6 with a bajillion neural cores and the same RAM. They could price it at $1999 and take the whole market. They’re already doing it wi

Post on over to r/localllama or check out the wiki there for setups. DGX sparks are not an inference powerhouse for the $$$$ you’d spend. It’s not an enterprise grade system for 1500 users either. It’s for local, personal prototyping on the same environment as you’d deploy when you deploy to a large

Those models perform a lot worse than the API you'd spend 100k/year on. And the inference speed is a single digit percent of it as well, uselessly slow. If you consider those aspects this is not a great purchase. Honestly better off just getting Nvidia's 100GB workstation GPUs for 7k a piece. Their

The "AMD effect" is happening when it comes to Nvidia DGX Spark. The legendary developer John Carmack put DGX Spark through its paces and he came away disappointed with the product: DGX Spark appears to be maxing out at only 100 watts power draw, less than half of the rated 240 watts, and it only se

I own a M4 Max MacBook Pro 128GB RAM with a 4TB SSD. I recently bought a DGX Spark. Then returned it a few weeks later. I thought I was buying a smaller, slower Blackwell AI datacenter for my home lab when I bought a Spark. I was wrong. It’s a poorly-supported ARM knockoff of the sm120 ecosystem cal

Neither. At a price similar to DGX Spark you can get 128GB Mac Studio with M4 Max. That's 546GB/s bandwidth, twice of the Nvidia/AMD solutions. Sure, it has poor ass storage out of the box (and paying premium for it at Apple store is stupid) but that you can just expand with any portable SSD that us

I can't tell if people are serious when they defend the reason for the DGX Spark existing. I honestly started laughing thinking you were joking about tough workloads training small models til you started comparing and adding defenses and I figured you are being serious... I'm not trying to be disres

If you’re going for PURE text generation, there simply is nothing that beats the m3 ultra mac studio. Ask ANYONE who says that the gb10 is better to show it and do a direct comparison. The nvidia people like to say that the mac people are just exaggerating the numbers on paper - thats not true at al

Long-term, it's not, and it cannot be. As it stands, the Nvidia DGX Spark systems, which would allow you to run the equivalent of ChatGPT 5.x on your desktop, are available for <$5000. That might seem absurdly expensive (and it is), but in a few years, that price will be down to <$2500. And in a dec