DGX Spark

NVIDIA did - they call it the DGX Spark. I have one. 128 GB of LPDDR5X memory to the Grace Blackwell chip. $3999 retail. Apple could smash this thing to bits with an M6 with a bajillion neural cores and the same RAM. They could price it at $1999 and take the whole market. They’re already doing it wi

Post on over to r/localllama or check out the wiki there for setups. DGX sparks are not an inference powerhouse for the $$$$ you’d spend. It’s not an enterprise grade system for 1500 users either. It’s for local, personal prototyping on the same environment as you’d deploy when you deploy to a large

Firstly you should understand that the Ryzen AI Max+ 395 chip is not intended to be an all-purpose AI chip. It comes with a lot of memory, but does not support CUDA, does not have a lot of compute, and most importantly does not have a lot of memory bandwidth. Not supporting CUDA means the options fo

It might not have lived up to the hype but it gets the job done. People also underestimate how much noise, power and heat a system with duel full height graphic cards put out. The Mac Studio and DGX Sparks give you very capable systems in a small convenient package. AMD Strix Halo is also an option

I own a M4 Max MacBook Pro 128GB RAM with a 4TB SSD. I recently bought a DGX Spark. Then returned it a few weeks later. I thought I was buying a smaller, slower Blackwell AI datacenter for my home lab when I bought a Spark. I was wrong. It’s a poorly-supported ARM knockoff of the sm120 ecosystem cal

Benchmarks speak louder than words: Dgx Spark: https://spark-arena.com/leaderboard Framework: https://kyuz0.github.io/amd-strix-halo-toolboxes/ (llamacpp) and https://kyuz0.github.io/amd-strix-halo-vllm-toolboxes/ (vllm) Apple Chips: https://omlx.ai/benchmarks The advantage of VLLM, which is NVIDIA-

If you’re going for PURE text generation, there simply is nothing that beats the m3 ultra mac studio. Ask ANYONE who says that the gb10 is better to show it and do a direct comparison. The nvidia people like to say that the mac people are just exaggerating the numbers on paper - thats not true at al

Exactly. Steam on the Snapdragon 8 Elite gen 5 will be 30-75% faster than the Steam Frame. Duct tape the fucker to your head. Easy. I'm more excited for Steam on the next Nvidia-ARM device (like the DGX Spark). If they launched a high-end one that could run steam, they would clean up. Steam should p

Honestly it's fairly niche. It's meant for local LLM development/testing when working with large datasets (that's why it comes with 200Gb/s networking). But it's actually pretty damn bad at actually running LLMs (as in, you can load a large model but it's really slow), you want a beefier workstation

At that price why buy it over the DGX Spark or one of the partner systems? You don't get access to the Nvidia software stack and no ConnectX-7 for clustering. The only benefit is the RYZEN AI Halo box can run Windows and seeing it's x86_64 it has uses outside of AI; but at $4k there are plenty of be