M5

also bought Bosgame M5 with 128G. its enough for testing and also running some "production" for example in n8n. There are another few important points: 1) electricity - i meter up to 80-100W when ollama running (had 3090 before and whole pc was 550+w), 2) compact size, 3) when you find you dont need

Crazy thought, what about a mini PC with 64/96gb of ram? I have a Gmtek k12 with 64gb of ram that's a dedicated server to host quite a few containers/applications. It does have Llama cpp for very basic agentic workflows. I got it for $1K USD which is significantly less than a Mac or 395+. If I didn'

It depends if you’re talking about dense models or MOE models. On 70B+ MOE models, you have benchmarks above that, and you won’t get better performance with a single GPU with 24 or 32GB of VRAM and the rest in RAM. The only time you’ll do better with GPUs is if your entire model fits in VRAM, includ

My recommendations stay the same really. Only posted UK links because that's my locale, and really only as examples for the kind of specs I'd personally put toward more recent emulation for performance, but these manufacturers sell worldwide and are generally very competitive. Basically any of the m

my suggestion is a minipc using Strix Halo. the 8060S gpu built in to the system runs about as well as a 4060 (so 1080p medium-to-high in most AAA games) GMKtec EVO-X2 AI Mini PC AMD Ryzen™ AI Max+ 395, $1699 (64gb) to 2699 (128GB)https://www.gmktec.com/products/amd-ryzen%E2%84%A2-ai-max-395-evo-x2-

The price gap between the Bosgame M5 and the Framework Desktop comes down to premium engineering versus mass production, even though they share the same AMD Ryzen AI Max+ processor. Framework charges a premium because you are paying for an elite, custom-engineered 4.5L chassis built around modularit