DGX Spark

NVIDIA did - they call it the DGX Spark. I have one. 128 GB of LPDDR5X memory to the Grace Blackwell chip. $3999 retail. Apple could smash this thing to bits with an M6 with a bajillion neural cores and the same RAM. They could price it at $1999 and take the whole market. They’re already doing it wi

Post on over to r/localllama or check out the wiki there for setups. DGX sparks are not an inference powerhouse for the $$$$ you’d spend. It’s not an enterprise grade system for 1500 users either. It’s for local, personal prototyping on the same environment as you’d deploy when you deploy to a large

It might not have lived up to the hype but it gets the job done. People also underestimate how much noise, power and heat a system with duel full height graphic cards put out. The Mac Studio and DGX Sparks give you very capable systems in a small convenient package. AMD Strix Halo is also an option

I own a M4 Max MacBook Pro 128GB RAM with a 4TB SSD. I recently bought a DGX Spark. Then returned it a few weeks later. I thought I was buying a smaller, slower Blackwell AI datacenter for my home lab when I bought a Spark. I was wrong. It’s a poorly-supported ARM knockoff of the sm120 ecosystem cal

Benchmarks speak louder than words: Dgx Spark: https://spark-arena.com/leaderboard Framework: https://kyuz0.github.io/amd-strix-halo-toolboxes/ (llamacpp) and https://kyuz0.github.io/amd-strix-halo-vllm-toolboxes/ (vllm) Apple Chips: https://omlx.ai/benchmarks The advantage of VLLM, which is NVIDIA-

Firstly you should understand that the Ryzen AI Max+ 395 chip is not intended to be an all-purpose AI chip. It comes with a lot of memory, but does not support CUDA, does not have a lot of compute, and most importantly does not have a lot of memory bandwidth. Not supporting CUDA means the options fo

Exactly. Steam on the Snapdragon 8 Elite gen 5 will be 30-75% faster than the Steam Frame. Duct tape the fucker to your head. Easy. I'm more excited for Steam on the next Nvidia-ARM device (like the DGX Spark). If they launched a high-end one that could run steam, they would clean up. Steam should p

Honestly it's fairly niche. It's meant for local LLM development/testing when working with large datasets (that's why it comes with 200Gb/s networking). But it's actually pretty damn bad at actually running LLMs (as in, you can load a large model but it's really slow), you want a beefier workstation

It competes with things like Nvidia DGX Spark, which has 273 GBs (and a lot less cores). It's not a bad product, the worst thing is that AMD's ecosystem is not as large as Nvidia's.

DGX is not for anything other than AI, and big models at that. It's a 5070ti speed wise. The 5070ti has 896GB/s memory bandwidth while the DGX Spark and the Minisforum S1 Max have 256GB/s memory bandwidth so it's literally 3.5x slower. You don't buy it for that. You buy it to run 200b parameter mode