Ryzen AI Halo

Unified RAM, that's basically it. If Apple Silicon didn't have unified RAM then no one would be using it for AI, they'd instead use AMD Strix Halo or Nvidia DGX chips, both of which have some advantages over AS, like token prefill speeds and CUDA access.

Da, uzeo sam si AMD Strix Halo miniPC sa 128 GB unified RAM (GMKTec EVO-X2), prilična je zvjerka i možeš alocirati do cca 100 GB RAMa za GPU. Napravio sam za probu web-baziranu igru u jedan dan crunchanja sa OpenCode i Qwen-3.6-35B-A3B. Dobro radi i dovoljno je brzo. Reda veličine 50 tokena/sec na p

Are you aware of the fantastic Strix Halo Toolboxes? Super easy to set up and work like a charm. The maintainer also has a truly outstanding YouTube channel. Absolutely worth watching. https://github.com/kyuz0/amd-strix-halo-toolboxes

I just wanted to say a huge thank you to you and your entire team for all the work you’ve been doing for the AMD Strix Halo community. It’s really great to see the constant progress of the SDK, as well as your active presence across all the different community niches around this hardware. It genuine

Pessoal confunde ARM como a única solução que a Apple usou e apresentou melhoras em chips mobile. Na vdd são um conjunto de fatores, como um sistema único integrado, com um hardware dedicado, memórias soldadas, etc. ARM até agora se mostrou uma solução muito boa pra eficiência energética, mas acho b

https://github.com/kyuz0/amd-strix-halo-vllm-toolboxesUse this. Its easy to use and well maintained but vllm is not as performant as llama.cpp with vulkan

Unfortunately due to hardware limitations and software support for it, we likely don't support any GPUs older than RDNA 2 Update: We made support much better for better RDNA2, Gorgon Halo support + fixed AMD installing not detecting GPUs on Strix Halo / other AMD GPUs

AMD Gorgon Halo Gorgon Halo is confirmed LPDDR5X-only. Gorgon Halo, sadly, is just Strix Halo (Zen5) rebranded. No new silicon honestly.

https://github.com/kyuz0/amd-strix-halo-toolboxes All you need. Also check his other repos and follow his guides, then everything will be smooth. Go with his stack as well:Fedora + Toolboxes (you can select the backend inside the toolboxes)

Yeah, AMD still does not have their shit together. They've tried to refocus the development efforts in the ecosystem into a more cohesive, stable process, titled "TheRock". https://github.com/ROCm/TheRock But look at the CI and Nightlies on any given day, and they're bound to be red. That is unaccep