Skip to content

serve: default llama-server path is relative to the 1bit executable; fails in the installed layout (/opt/1bit-llama) #581

Closed

Description

@bong-water-water-bong

On the 1bit OS live stick (candidate 5, 26 Oct), 1bit serve -m <gguf> --device hrx run by hand fails with

1bit serve: Qwen3-0.6B-Q4_K_M on hrx (hrx/llama/bin/llama-server)
1bit serve: backend 0 did not become ready

because the default server path is hrx/llama/bin/llama-server relative to the executable's directory (/bin/1bit in the image, a symlink into the packed build tree), while the image ships the server at /opt/1bit-llama/llama-server (on PATH). --llama-server /opt/1bit-llama/llama-server works. scripts/lemonade-hrx has the ONEBIT_HRX_LLAMA_SERVER override, which the image now sets for Lemonade (#580), but 1bit serve itself does not read it.

Suggested: when the executable-relative default does not exist, fall back in order to $ONEBIT_HRX_LLAMA_SERVER, /opt/1bit-llama/llama-server, then llama-server on PATH, and say which one was taken in the "on hrx (...)" line. Found by the hardware live-USB gate; the VM gate never exercises --device hrx.

🤖 Generated with Claude Code

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions