You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
MODEL-MM-GLM53-FLASH: the compose — glm5_next_device.cpp and the remaining nine arms #3174
Glm5NextForConditionalGeneration (GLM-5.3-Flash) has three of eleven arms on a
device queue after W9c-3a (expert GEMM), W9c-2 (KDA recurrence, MoE router
topk), and W9c-3b (KV binding). The other eight still run on the interposed CPU
queue that Glm5NextHostForward constructs at glm5_next_forward.cpp:288. O43
discloses that, and this issue owns the wave that closes it.
Scope
Create glm5_next_device.cpp following kimi_linear_device.cpp's
single-queue, device-resident pattern. Move six arms from host to device where
providers exist on both CUDA and ROCm:
Activity
spec(MODEL-MM-GLM53-FLASH): W9c-3 compose wave — glm5_next_device.cpp…
spec(MODEL-MM-GLM53-FLASH): W9c-3 compose wave — glm5_next_device.cpp…