Prefill improvements: 119 -> 210 tok/s at 32k depth, sparse FA 8.16 -> 1.10 seconds - #2

Prefill improvements: 119 -> 210 tok/s at 32k depth, sparse FA 8.16 -> 1.10 seconds#2

Nathanw1014 merged 5 commits into

Nathanw1014:strix-halo-vulkanNathanw1014/llama.cpp:strix-halo-vulkanfrom

Mushoz:strix-halo-vulkanMushoz/llama.cpp:strix-halo-vulkanCopy head branch name to clipboard