Ryzen AI Halo

TLDR:"The performance advantage over the previous Arc Graphics 140T/140V iGPUs is around 70%. The advantage over the smaller Radeon 800 series iGPUs of AMD Zen 5 is also considerably high (between 50-80% depending on the benchmark). Although the Strix Halo GPUs are even faster (but not more efficien

Da, uzeo sam si AMD Strix Halo miniPC sa 128 GB unified RAM (GMKTec EVO-X2), prilična je zvjerka i možeš alocirati do cca 100 GB RAMa za GPU. Napravio sam za probu web-baziranu igru u jedan dan crunchanja sa OpenCode i Qwen-3.6-35B-A3B. Dobro radi i dovoljno je brzo. Reda veličine 50 tokena/sec na p

Unica vantagem dos Macs são a memoria unificadas. Só. Adoram falar que os processadores são magicos e não são, Intel e AMD tem processadores inclusive melhor em raw output por watt. Se você não usa LLM, não joga na bateria ta rasgando dinheiro. Ta pagando uma nota numa memoria que você sequer vai us

The latency change ain't caused by the interconnect or packaging, it's caused by the use of lpddr with really loose timings. Point here, the product focuses on bandwidth for the igpu and not cpu gaming perf. It's a mobile workstation design that focuses on raw compute and not games That's a sea of w

Especially for laptops, a single performant APU with unified memory like AMD Strix Halo or Apple M-series SoC seems to be way to go due to efficiency

Pessoal confunde ARM como a única solução que a Apple usou e apresentou melhoras em chips mobile. Na vdd são um conjunto de fatores, como um sistema único integrado, com um hardware dedicado, memórias soldadas, etc. ARM até agora se mostrou uma solução muito boa pra eficiência energética, mas acho b

APU even have the compute to do AI in a reasonabe amount of time It's not the worst. The thing is with bigger models, you ideally want the entire thing in memory. That's why you'll find articles about how this runs the bigger Deepseek models faster than a 5090 or whatever. I'm kinda tempted to get o

Ich habe das mal nicht AI-sloppen lassen, sondern gebaut :) Je nachdem, was Du brauchst kannst Du das Modell als Single User in der marginal schlechteren MoE Variante auf einem DGX Spark oder der ASUS Variante oder einem AMD Strix Halo laufen lassen. Anschaffungskisten zwischen 2500 und 4500 Euro. D

Owned or benchmarked most of these in the last 6 months. Practical take: 2x AMD R9700 (32 GB each, 64 GB total VRAM) - this is the best price/performance right now if you're okay tinkering. ROCm 6.4 + vLLM 0.7 with tensor parallelism gets you ~55 tok/s on Qwen3 32B FP8 with 64k context. Cross-GPU wo

TLDR: Alex Ziskind tests AMD’s claim that two Ryzen AI Halo units can run a ~400B parameter model. The setup Ryzen AI Halo: Compact AMD mini-PC / AI box with a Strix Halo APU and 128 GB unified memory. AMD claims: 1 unit → up to ~200B models 2 units clustered → up to ~400B models (256 GB combined) W