Skip to content

RuntimeError: the engine exited before it was ready #172

Closed

Description

@perronemirko

bash ./setup.sh --family swift --model Q2_0 --context 262144 --vision no --yes --models-dir /home/<MYACCOUNT/llm_models/models --port 4332

=== Step 7: writing the start script ===
[ok] KV streaming on: the context's KV cache lives in RAM (3.6 GB), more experts fit in VRAM
[ok] start script: run-swift-q2_0.sh

All set.
API (OpenAI): http://127.0.0.1:4332/v1 (any API key; model name: anything)
API (Anthropic): http://127.0.0.1:4332/v1/messages
Next time: just run ./setup.sh (or run-swift-q2_0.sh) - it starts right away
[ok] GPU: GPU 0 (NVIDIA GeForce RTX 4090, 24 GB)


Starting swift-1.5-q2_0: it loads about 40 GB into RAM and locks part of it for the GPU.
While it does, YOUR PC CAN BE SLOW OR STOP RESPONDING FOR 1-3 MINUTES (longer the first time after a
restart). That is normal: please wait and don't close this window - the browser opens when it is ready.
Later, closing this window stops the model.

loading the model (the first start takes a minute or two) ...
[strata] starting the engine: reading the model's weights ...
Traceback (most recent call last):
File "/home//workspaces/AI/Strata/serve/server.py", line 1776, in
sys.exit(main())
File "/home//workspaces/AI/Strata/serve/server.py", line 1708, in main
engine = StrataEngine(cfg["exe"], engine_args(cfg), cwd=cfg.get("cwd"), log=cfg.get("log"), env=env)
File "/home//workspaces/AI/Strata/serve/server.py", line 189, in init
raise RuntimeError("the engine exited before it was ready" + (f" (see {log})" if log else ""))
RuntimeError: the engine exited before it was ready (see /home//workspaces/AI/Strata/strata-swift-q2_0.log)

cat /home//workspaces/AI/Strata/strata-swift-q2_0.log
"""
strata generate: native_experts.txt: layer 13 is missing or not contiguous
"""

Activity

  1. Niko1221 commented on Sep 30, 2026

    @Niko1221
    Owner

    This is #171: Swift 1.5's Q2_0 files split layer 13's experts across the two shards. The first setup run stopped there but left a partial native_experts.txt, so the next run skipped the pack step and the engine found only layers 0-12. 0.1.28 no longer offers Q2_0 for Swift. Please delete <data>/packs/swift-q2_0 and run-swift-q2_0.sh, then run ./setup.sh --family swift --model IQ2_XS (similar speed). We'll also make the pack tool leave no partial file behind. Closing as a duplicate of #171.

  2. added a commit that references this issue on Oct 1, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions