Repository navigation
tools: add real-time web dashboard for hardware and engine monitoring - #22
Closed
code-martin wants to merge 1 commit into
Closed
code-martin wants to merge 1 commit into
code-martin wants to merge 1 commit into
Conversation
code-martin
force-pushed
the
feature/live-dashboard
branch
from
September 27, 2026 08:29
1b63f1a to
e7a2eee
Compare
Owner
|
I was just doing this, will push in about 2hrs. |
…toring - Provide standalone, zero-dependency live dashboard on port 8081 - Monitor GPU utilization, VRAM usage, PCIe mode, and temperature via NVML - Monitor CPU utilization, RAM, and NVMe disk throughput - Track active engine inference state, tokens/sec, and request history - Implement ThreadingHTTPServer with cached process metrics and live clock/uptime
code-martin
force-pushed
the
feature/live-dashboard
branch
from
September 27, 2026 08:49
e7a2eee to
a3b200c
Compare
Niko1221
added a commit
that referenced
this pull request
Sep 27, 2026
The browser page at http://127.0.0.1:8080 is now the Strata app, in the Strata design language (serve/web, same origin, no CDN): - Chat: streaming answers, collapsible thinking, Markdown with code copy, images when enabled, sampling/thinking settings, export, new chat. - Monitor: live model state (reading with progress / generating at tok/s), GPU load, VRAM, temperature, power, PCIe traffic, CPU, RAM, disk, the context fill and the last requests, each with a minute of history. - About: the model and engine settings, this PC, the API addresses. Server: GET /metrics (API key when set), /web/* app files, /fonts/* only when installed locally (not shipped; the page falls back to the system font). serve/telemetry.py reads NVML via ctypes and psutil (new setup dependency) with fallbacks. The engine prints an INFO line before READY (kv, expert slots, speculation); older servers ignore it and the server works with older engines. Based on the dashboard idea in PR #22 by code-martin. Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_0154bwiad8gY7wRehCXy27pN
Owner
|
Thanks a lot for this! The idea shaped v0.1.8, but I didn't merge the separate dashboard server. I built it into the main server instead, so there's one port and one process: The Monitor covers what your dashboard had: live state with prompt progress and tok/s, GPU util / VRAM / temp / power / PCIe gen and traffic (NVML via ctypes, like yours), CPU / RAM / disk, context fill, expert slots, KV mode and the request history, each with a minute of sparkline. It reads a new Credited you in the release notes and in docs/DETAILS.md. Closing this since the code itself isn't merged. If there's something from yours that the Monitor misses (per-disk NVMe load, for example), open an issue or a PR against |
MistVVK
referenced
this pull request
in MistVVK/XeStrata
Oct 3, 2026
The browser page at http://127.0.0.1:8080 is now the Strata app, in the Strata design language (serve/web, same origin, no CDN): - Chat: streaming answers, collapsible thinking, Markdown with code copy, images when enabled, sampling/thinking settings, export, new chat. - Monitor: live model state (reading with progress / generating at tok/s), GPU load, VRAM, temperature, power, PCIe traffic, CPU, RAM, disk, the context fill and the last requests, each with a minute of history. - About: the model and engine settings, this PC, the API addresses. Server: GET /metrics (API key when set), /web/* app files, /fonts/* only when installed locally (not shipped; the page falls back to the system font). serve/telemetry.py reads NVML via ctypes and psutil (new setup dependency) with fallbacks. The engine prints an INFO line before READY (kv, expert slots, speculation); older servers ignore it and the server works with older engines. Based on the dashboard idea in PR #22 by code-martin.
FlareP1
pushed a commit
to FlareP1/Strata
that referenced
this pull request
Oct 18, 2026
…the upstream ncols > 1 layout timed on sm_86, the exact one stays the default Comments only. The next commit puts this branch's kernel timings on its two models' shapes beside the pull request's decode numbers. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What
Adds a self-contained real-time monitoring web dashboard (
tools/dashboard_server.py) for Strata:http.server,urllib,json,subprocess,ctypes).python tools/dashboard_server.py --port 8081 --server http://127.0.0.1:8080.Preview
Features
PCIe 4.0 x16via NVML), and expert cache slots in VRAM./proc/diskstatson Linux) to monitor DirectStorage/SSD streaming during MoE expert offloading.Verification