DGX Spark

Welcome to the club. The harder thing to resist is buying a second one. forums.developer.nvidia.com/c/accelerated-computing/dgx-spark-gb10/dgx-spark-gb10/721 awesome resource Current top-pick for single spark: Qwen 3.5 122B-A10B, Qwen 3.6 27B (with MTP) or even the 35B-A3B if speed matters more. htt

You wont buy it https://www.microcenter.com/product/699008/nvidia-dgx-spark

Post on over to r/localllama or check out the wiki there for setups. DGX sparks are not an inference powerhouse for the $$$$ you’d spend. It’s not an enterprise grade system for 1500 users either. It’s for local, personal prototyping on the same environment as you’d deploy when you deploy to a large

RAM prices have skyrocketed after OpenAI bought 40% of the memory wafers, and NVIDIA is producing less consumer GPUs. They want the compute concentrated in cloud datacenters under their control. Self-hosted local AI is the way to go – Mac Studio makes a 512GB model and there is DGX Spark and AMD Str

Believe me, I have been waiting for ROCm to be in a state where it is not painful for researchers to use, much less ready for consumers expecting the using the libraries off the shelf, but I have waited more than 10 years and ROCm is still about as matured as it was 10 years ago.The "good" news thou

but because it’s supposedly designed around AI workloads from the ground up But it's not. That's the wrong assumption. No matter how Nvidia spins it, DGX Spark is meant for prototyping and validating software that will be run on larger DGX-class or HGX-class clusters.

Best a Mac mini can do is 64GB. They can only use a Pro M SOC. To get a 128GB M4 Max SOC you need at least a Mac Studio (or a MacBook Pro). At that point it is hard to say no to the Nvidia DGX Spark @ $5k. That said wait until March 4th to see what new goodies Apple drops. I read rumors there could

If you’re going for PURE text generation, there simply is nothing that beats the m3 ultra mac studio. Ask ANYONE who says that the gb10 is better to show it and do a direct comparison. The nvidia people like to say that the mac people are just exaggerating the numbers on paper - thats not true at al

I'd love to show the entire desk, speakers, etc. but I'm afraid everything surrounding is a bit of a mess 'PC' is an Nvidia DGX Spark. Needed something with plenty of memory, strong CUDA support, & something small I can take with me for travel. It is a hair better than a 9950x in CPU performance & a

If you want long context processing, Mac is not a good choice. Actually, the worst among other choices, because of extremely slow reading speed. Note that this is different from the TG speed you mentioned. But for your use case, it is far more important, as others have mentioned. So Prefill speed (P