Ryzen AI Halo

Unified RAM, that's basically it. If Apple Silicon didn't have unified RAM then no one would be using it for AI, they'd instead use AMD Strix Halo or Nvidia DGX chips, both of which have some advantages over AS, like token prefill speeds and CUDA access.

Da, uzeo sam si AMD Strix Halo miniPC sa 128 GB unified RAM (GMKTec EVO-X2), prilična je zvjerka i možeš alocirati do cca 100 GB RAMa za GPU. Napravio sam za probu web-baziranu igru u jedan dan crunchanja sa OpenCode i Qwen-3.6-35B-A3B. Dobro radi i dovoljno je brzo. Reda veličine 50 tokena/sec na p

Are you aware of the fantastic Strix Halo Toolboxes? Super easy to set up and work like a charm. The maintainer also has a truly outstanding YouTube channel. Absolutely worth watching. https://github.com/kyuz0/amd-strix-halo-toolboxes

I just wanted to say a huge thank you to you and your entire team for all the work you’ve been doing for the AMD Strix Halo community. It’s really great to see the constant progress of the SDK, as well as your active presence across all the different community niches around this hardware. It genuine

Pessoal confunde ARM como a única solução que a Apple usou e apresentou melhoras em chips mobile. Na vdd são um conjunto de fatores, como um sistema único integrado, com um hardware dedicado, memórias soldadas, etc. ARM até agora se mostrou uma solução muito boa pra eficiência energética, mas acho b

Unfortunately due to hardware limitations and software support for it, we likely don't support any GPUs older than RDNA 2 Update: We made support much better for better RDNA2, Gorgon Halo support + fixed AMD installing not detecting GPUs on Strix Halo / other AMD GPUs

https://github.com/kyuz0/amd-strix-halo-toolboxes All you need. Also check his other repos and follow his guides, then everything will be smooth. Go with his stack as well:Fedora + Toolboxes (you can select the backend inside the toolboxes)

Please don't use ollama. Use the Strix Halo toolbox- https://github.com/kyuz0/amd-strix-halo-toolboxes and use this to decide on which backend to choose- https://kyuz0.github.io/amd-strix-halo-toolboxes/

TLDR: Alex Ziskind tests AMD’s claim that two Ryzen AI Halo units can run a ~400B parameter model. The setup Ryzen AI Halo: Compact AMD mini-PC / AI box with a Strix Halo APU and 128 GB unified memory. AMD claims: 1 unit → up to ~200B models 2 units clustered → up to ~400B models (256 GB combined) W

Perhaps even better would be with AMD Strix Halo or Gorgon Halo. Similar SoC approach but with x64 instead or arm64.