MS-01

Minisforum MS-01 Why this over the MS-A2? This has intel iGPU great for plex emby etc. Also you can use SR-IOV and slice the iGPU up and pass a slices to different VMs. You can do this with the AMD iGPU. I this box you get 3xNVMe 2xSFP+ Low profile PCIe slot (great for small gpu or HBA and run a who

My minisforum ms-01 can do all that. And more powerful. If you get a MINISFORUM N5 Pro AI NAS you can replace your PC and NAS all in one.

Forget local LLMs for the time being unless you want to experiment with a Strix Halo mini pc and that’s gonna cost you a lot more (minimum 2K). If you want to do LLMs with an Nvidia GPU, you need to spend far more than that just to match the VRAM (albeit faster than Strix Halo, which is still faster

Get a minisforum MS-01/02 it has 2 x 10gb (X710)sftp ports, and 2x 2.5 gbit utp. You can get with intel(01) or AMD (02) cpu's. It's small and performs perfectly. Only the battery fails after some time, so when it does not boot anymore. Just replace the battery, 3 min work. I use opnsense on proxmox.

I ran across two unopened sets of these when cleaning my computer room. I have a 6 node Proxmox cluster and originally was going to go with 96gb kits, but then the 128gb kits came out and I went with those. I also have boatloads of NVMe drives that are unopened as well. I wish I could still the the

running an llm in a 10-inch rack is a fun challenge. you're gonna want as much vram as you can fit. for that size, something like a Minisforum MS-01 with a decent gpu could work, though fitting a full-size card is tough. i've seen people have good luck with qwen 2.5 7b or 14b models - they run decen

The MINISFORUM MS-01 Mini Workstation Core i9-12900H is $470 on Amazon and it has two ports for 10gb and two 2.5gb nics. The processor is a bit overkill. They also have a MINISFORUM MS-01 Mini Workstation Core i5-12600H for $400.

for hyper-v with a handful of DCs and light VMs, three tiers that all stay quiet: top pick: Minisforum MS-01. i13900H or i9-13900H, dual 10GbE + dual 2.5GbE, dual m.2 NVMe + one u.2 slot, takes 96GB DDR5 SO-DIMM. idles around 15W, ramps to 40W under actual load. ~$700 barebones or $1100 with 32GB/1T

Oh nothing overkill at all. Just a Minisforum MS-01.

If other equipment is possible, you’ll be much happier running Immich on a minipc and let the NAS just be storage. I run Immich on a minisforum MS-01 and storage is a SMB mount on my Synology DS1521+.