Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion docs/architecture.md
Original file line number Diff line number Diff line change
Expand Up @@ -55,4 +55,4 @@ Pinned versions of the third-party runtimes rocm-cli manages (from workspace-roo

### `engines/lemonade`, `engines/vllm` — inference engine adapters

`engines/vllm` follows full domain extraction: `runtime.rs` (TheRock/managed-runtime resolution), `install.rs` (ROCm/vLLM build-variant discovery, install execution, runtime-repair assessment), `process.rs` (spawn/env/path setup, readiness polling), `state.rs` (service state file I/O). `lib.rs` keeps only CLI/envelope dispatch and the few items shared across those modules. `engines/lemonade`'s `lib.rs` is **not yet modularized** — see EAI-7768.
`engines/vllm` follows full domain extraction: `runtime.rs` (TheRock/managed-runtime resolution), `install.rs` (ROCm/vLLM build-variant discovery, install execution, runtime-repair assessment), `process.rs` (spawn/env/path setup, readiness polling), `state.rs` (service state file I/O). `lib.rs` keeps only CLI/envelope dispatch and the few items shared across those modules. `engines/lemonade` follows the same pattern across six modules: `install.rs` (embeddable-runtime archive download/verify/extract, cache locking, manifest persistence), `backend_alignment.rs` (ROCm-SDK-to-llama.cpp-backend Tier 1 / Tier 2 / revert alignment, backend discovery/install/selection), `process.rs` (`lemond`/llama-server spawn, env/path setup, readiness and health polling), `runtime_dir.rs` (`XDG_RUNTIME_DIR` tier1/2/3 hardening for the spawned child), `direct_llama.rs` (Hugging Face checkpoint/GGUF resolution and the direct-llama-server serve path), `state.rs` (service state file I/O, device-policy/GPU-selection parsing, port/endpoint helpers). `lib.rs` keeps only CLI/envelope dispatch and the service-lifecycle orchestration that calls across those modules.
1,785 changes: 1,785 additions & 0 deletions engines/lemonade/src/backend_alignment.rs

Large diffs are not rendered by default.

Loading
Loading