DGX Spark

Welcome to the club. The harder thing to resist is buying a second one. forums.developer.nvidia.com/c/accelerated-computing/dgx-spark-gb10/dgx-spark-gb10/721 awesome resource Current top-pick for single spark: Qwen 3.5 122B-A10B, Qwen 3.6 27B (with MTP) or even the 35B-A3B if speed matters more. htt

RAM prices have skyrocketed after OpenAI bought 40% of the memory wafers, and NVIDIA is producing less consumer GPUs. They want the compute concentrated in cloud datacenters under their control. Self-hosted local AI is the way to go – Mac Studio makes a 512GB model and there is DGX Spark and AMD Str

Believe me, I have been waiting for ROCm to be in a state where it is not painful for researchers to use, much less ready for consumers expecting the using the libraries off the shelf, but I have waited more than 10 years and ROCm is still about as matured as it was 10 years ago.The "good" news thou

Best a Mac mini can do is 64GB. They can only use a Pro M SOC. To get a 128GB M4 Max SOC you need at least a Mac Studio (or a MacBook Pro). At that point it is hard to say no to the Nvidia DGX Spark @ $5k. That said wait until March 4th to see what new goodies Apple drops. I read rumors there could

I'd love to show the entire desk, speakers, etc. but I'm afraid everything surrounding is a bit of a mess 'PC' is an Nvidia DGX Spark. Needed something with plenty of memory, strong CUDA support, & something small I can take with me for travel. It is a hair better than a 9950x in CPU performance & a

If you want long context processing, Mac is not a good choice. Actually, the worst among other choices, because of extremely slow reading speed. Note that this is different from the TG speed you mentioned. But for your use case, it is far more important, as others have mentioned. So Prefill speed (P

Yeah, forgot to write that in. For sure, to me it seems like a no-brainer decision to make, more so to Nvidia than AMD. The die space contributing to the memory controllers IMO wouldn't really dent Nvidia's bank, although I suspect is a move they've done on purpose to keep customers on their DC prod

Might be time to spend 4-5k and buy a NVIDIA - DGX Spark and use it for development using models that are open sourced, this change/update will make AI system unusable going forward unless you host it yourself.

So I have both an 64GB M4 Max Studio and a DGX Spark (ASUS Ascent GX10); both have their strengths and weaknesses. The Mac Studio is the best all around option providing you aren’t using it to train or fine tune LLM’s. The Spark is faster than the Mac with prompt processing but slower at inference (

Have you looked into a DGX Spark at that cost? Might be better to offload to a separate device anyway, so you don't have conflicting use cases.