RuntimeError: the engine exited before it was ready #172
Description
bash ./setup.sh --family swift --model Q2_0 --context 262144 --vision no --yes --models-dir /home/<MYACCOUNT/llm_models/models --port 4332
=== Step 7: writing the start script ===
[ok] KV streaming on: the context's KV cache lives in RAM (3.6 GB), more experts fit in VRAM
[ok] start script: run-swift-q2_0.sh
All set.
API (OpenAI): http://127.0.0.1:4332/v1 (any API key; model name: anything)
API (Anthropic): http://127.0.0.1:4332/v1/messages
Next time: just run ./setup.sh (or run-swift-q2_0.sh) - it starts right away
[ok] GPU: GPU 0 (NVIDIA GeForce RTX 4090, 24 GB)
Starting swift-1.5-q2_0: it loads about 40 GB into RAM and locks part of it for the GPU.
While it does, YOUR PC CAN BE SLOW OR STOP RESPONDING FOR 1-3 MINUTES (longer the first time after a
restart). That is normal: please wait and don't close this window - the browser opens when it is ready.
Later, closing this window stops the model.
loading the model (the first start takes a minute or two) ...
[strata] starting the engine: reading the model's weights ...
Traceback (most recent call last):
File "/home//workspaces/AI/Strata/serve/server.py", line 1776, in
sys.exit(main())
File "/home//workspaces/AI/Strata/serve/server.py", line 1708, in main
engine = StrataEngine(cfg["exe"], engine_args(cfg), cwd=cfg.get("cwd"), log=cfg.get("log"), env=env)
File "/home//workspaces/AI/Strata/serve/server.py", line 189, in init
raise RuntimeError("the engine exited before it was ready" + (f" (see {log})" if log else ""))
RuntimeError: the engine exited before it was ready (see /home//workspaces/AI/Strata/strata-swift-q2_0.log)
cat /home//workspaces/AI/Strata/strata-swift-q2_0.log
"""
strata generate: native_experts.txt: layer 13 is missing or not contiguous
"""
Activity
Niko1221 commentedon Sep 30, 2026
This is #171: Swift 1.5's Q2_0 files split layer 13's experts across the two shards. The first setup run stopped there but left a partial
native_experts.txt, so the next run skipped the pack step and the engine found only layers 0-12. 0.1.28 no longer offers Q2_0 for Swift. Please delete<data>/packs/swift-q2_0andrun-swift-q2_0.sh, then run./setup.sh --family swift --model IQ2_XS(similar speed). We'll also make the pack tool leave no partial file behind. Closing as a duplicate of #171.A fatal CUDA fault in the prompt path exits at once instead of hangin…
A fatal CUDA fault in the prompt path exits at once instead of hangin…
A fatal CUDA fault in the prompt path exits at once instead of hangin…
Merge upstream/main (v0.1.30) into the fork
Merge upstream main (30ec18e, engine 0.1.30): the server's GPU sharin…
A fatal CUDA fault in the prompt path exits at once instead of hangin…
A fatal CUDA fault in the prompt path exits at once instead of hangin…
A fatal CUDA fault in the prompt path exits at once instead of hangin…
A fatal CUDA fault in the prompt path exits at once instead of hangin…
A fatal CUDA fault in the prompt path exits at once instead of hangin…
A fatal CUDA fault in the prompt path exits at once instead of hangin…
replay(githubproxy.fjygbaifeng.eu.org-eddoursul-Strata-custom): root from custom
replay(githubproxy.fjygbaifeng.eu.org-eddoursul-Strata-custom): tools from custom
replay(githubproxy.fjygbaifeng.eu.org-eelgaev-Strata-AC922-ac922): root from ac922
replay(githubproxy.fjygbaifeng.eu.org-lighttransport-Strata-glm53f): root from glm53f
replay(githubproxy.fjygbaifeng.eu.org-eddoursul-Strata-custom): root from custom
replay(githubproxy.fjygbaifeng.eu.org-eddoursul-Strata-custom): tools from custom
replay(githubproxy.fjygbaifeng.eu.org-eelgaev-Strata-AC922-ac922): root from ac922
replay(githubproxy.fjygbaifeng.eu.org-lighttransport-Strata-glm53f): root from glm53f