You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
serve: default llama-server path is relative to the 1bit executable; fails in the installed layout (/opt/1bit-llama) #581
On the 1bit OS live stick (candidate 5, 26 Oct), 1bit serve -m <gguf> --device hrx run by hand fails with
1bit serve: Qwen3-0.6B-Q4_K_M on hrx (hrx/llama/bin/llama-server)
1bit serve: backend 0 did not become ready
because the default server path is hrx/llama/bin/llama-server relative to the executable's directory (/bin/1bit in the image, a symlink into the packed build tree), while the image ships the server at /opt/1bit-llama/llama-server (on PATH). --llama-server /opt/1bit-llama/llama-server works. scripts/lemonade-hrx has the ONEBIT_HRX_LLAMA_SERVER override, which the image now sets for Lemonade (#580), but 1bit serve itself does not read it.
Suggested: when the executable-relative default does not exist, fall back in order to $ONEBIT_HRX_LLAMA_SERVER, /opt/1bit-llama/llama-server, then llama-server on PATH, and say which one was taken in the "on hrx (...)" line. Found by the hardware live-USB gate; the VM gate never exercises --device hrx.
Activity
serve: find the shipped llama-server; the SMU cap status tells the tr…