M5

The vast majority of the popular miniPCs are all Chinese manufacturers, which in itself isn't a bad thing necessarily, it just makes things like warranty claims a little trickier to handle if they don't have a proper presence in your country. Also common wisdom for all these mini PCs is to reinstall

also bought Bosgame M5 with 128G. its enough for testing and also running some "production" for example in n8n. There are another few important points: 1) electricity - i meter up to 80-100W when ollama running (had 3090 before and whole pc was 550+w), 2) compact size, 3) when you find you dont need

Crazy thought, what about a mini PC with 64/96gb of ram? I have a Gmtek k12 with 64gb of ram that's a dedicated server to host quite a few containers/applications. It does have Llama cpp for very basic agentic workflows. I got it for $1K USD which is significantly less than a Mac or 395+. If I didn'

The Ryzen 395+ and its internal 8060S GPU is leagues ahead of the 890M but for that price point you can build a proper SFF desktop that's still pretty damn small and will blow it out of the water. It won't be mini-PC sized but some of those cases are small enough to travel with. Also most of the Ryz

I thought about building a suitcase pc for my son before his next deployment. But there's sweet mini-pcs out there now with the AMD AI 395 Strix Halo that can game better than most gaming laptops. They use integrated graphics the 8060s, with similar performance to a 4070. Bosgame M5 AI Mini DesktopG

Mini pc suggestion: https://www.bosgamepc.com/products/bosgame-m5-ai-mini-desktop-ryzen-ai-max-395

LLM’s are the ceiling, being static models with finite context. It’s great tool, for sure - but it’s not the route to AGI. You’ll see it yourself, tinkering around with local deployments is great way to understand what’s going on behind the scenes, and where llm ends and typical programming starts.

my suggestion is a minipc using Strix Halo. the 8060S gpu built in to the system runs about as well as a 4060 (so 1080p medium-to-high in most AAA games) GMKtec EVO-X2 AI Mini PC AMD Ryzen™ AI Max+ 395, $1699 (64gb) to 2699 (128GB)https://www.gmktec.com/products/amd-ryzen%E2%84%A2-ai-max-395-evo-x2-

It depends if you’re talking about dense models or MOE models. On 70B+ MOE models, you have benchmarks above that, and you won’t get better performance with a single GPU with 24 or 32GB of VRAM and the rest in RAM. The only time you’ll do better with GPUs is if your entire model fits in VRAM, includ

Indeed - but the Minisforum offers better UEFI options to adjust the fan speed. If the MS-S1 Max delivered the same results as the Bosgame M5 in our volume measurements, it would be the best mini PC in our rating.