DGX Spark

Unfortunately, you dropped $4k for an inference server with anemic bandwidth (273 GB/s). To put that in perspective, that's 24 GB/s less than Apple's M5 Pro chip. If you run a dense model like gemma4:31b with that bandwidth, you're gonna have a bad time. You need an MoE model with a quant optimized

Honestly it's fairly niche. It's meant for local LLM development/testing when working with large datasets (that's why it comes with 200Gb/s networking). But it's actually pretty damn bad at actually running LLMs (as in, you can load a large model but it's really slow), you want a beefier workstation

DGX is not for anything other than AI, and big models at that. It's a 5070ti speed wise. The 5070ti has 896GB/s memory bandwidth while the DGX Spark and the Minisforum S1 Max have 256GB/s memory bandwidth so it's literally 3.5x slower. You don't buy it for that. You buy it to run 200b parameter mode

Training using the full Nvidia professional stack absolutely justifies it for a certain demographic. You're not it. You aren't going to train anything on a 5070ti with 256GB/s memory bandwidth. Also training is done with Fp16 so 128GB RAM limits you to about 60B parameters. People doing training use

Actualmente lo unico que vale la pena son mac minis, el dgx spark de nvidia tiene una mierda de ancho de banda cualquier modelo te corre a 20 tokes por segundo