You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I want to integrate this into a slim chat system, so I think it would be nice to be able to have the app output only the text from the model like a -q for "quiet" flag on run.
Reacted by Simon Willison, Hanusz Leszek and Loreto Parisi
Another option is just using fprintf(stderr, ...) everywhere except in that one particular case that prints tokens from the model. According to POSIX standard, stderr is not limited for errors, but can be used to print diagnostic output too.
One can use ./main ... 2>dev/null to suppress any diagnostic output
Activity
tinoargentino commentedon Mar 12, 2023
for testing purposes, you can just comment out all printfs in main.cpp, run make again, and run ./main
prusnak commentedon Mar 12, 2023
Another option is just using
fprintf(stderr, ...)everywhere except in that one particular case that prints tokens from the model. According to POSIX standard, stderr is not limited for errors, but can be used to print diagnostic output too.One can use
./main ... 2>dev/nullto suppress any diagnostic outputPR #48 does exactly this.
Merge pull request ggml-org#5 from anzz1/master
run sanitizers in release, otherwise too slow (ggml-org#5)
Merge pull request #5 from anon998/stop-stream
Merge pull request ggml-org#5 from danielgross/pleasantify-dx
Fix multi GPU on multiple amd architectures with rocblas_initialize() (…
ROCm Port (#1087)
Full cpu (ggml-org#5)
fix warning in ggml.c (ggml-org#5)
Koboldcpp-ROCm Port (ggml-org#399)
main : don't print special tokens with --grammar (#6923)
121 remaining items
fix(sycl): submit the G4 numerics test's kernel on the unified-cache …
docs(sycl): L2 quality round-2 comment fixes -- RUN_SERIAL precedent,…
feat: MoE expert cache — keep hot routed experts resident in VRAM (gg…
server: skip system-prompt-cache store on recurrent-only memories
Merge pull request ggml-org#5 from phase-5-moe-routing
strix-halo: fork overlay (docs + findings + model-search tooling)
strix-halo: log post-rebase MMQ re-port re-bench (2026-05-14)
strix-halo: add "Where this fork stands" headline bench to README
strix-halo: test routed-MoE ncols picker vs static J=48 (PR ggml-org#…
server: skip system-prompt-cache store on recurrent-only memories
server: skip system-prompt-cache store on recurrent-only memories
common : Fix corrupted memory error on json grammar initialization (g…
reasoning-budget: add multi-point budget mechanism (intro, soft warni…
server: skip system-prompt-cache store on recurrent-only memories