Repository navigation
Choosing a graphics card #51
Description
Currently, only GPU0 is being used. It is necessary to identify and select the graphics card to use. GPU0, GPU1...
My example: GPU0 – rtx4060, GPU1 – rtx5070.
I used "set CUDA_VISIBLE_DEVICES=1" to override the graphics card:
@echo off
set CUDA_VISIBLE_DEVICES=1
cd /d "F:\LLM\Strata-main\Strata-main"
".venv\Scripts\python.exe" serve\server.py --engine strata --config strata-iq3_xxs.json --port 8080 --open
pause
At the same time, GPU0 data is used for monitoring.
Activity
itguy327 commentedon Sep 28, 2026
+1, I tried setting the cuda visible and then running start-here.bat but it still insists on pointing at my 4060
Choosing the GPU (#51): --gpu N, setup picks the one with the most VRAM
Niko1221 commentedon Sep 28, 2026
Thanks - added in v0.1.17: setup lists every NVIDIA GPU and uses the one with the most VRAM (your 5070), or the one you pick with
START-HERE.bat --gpu 1(numbered asnvidia-smishows them). The engine and the image encoder getCUDA_VISIBLE_DEVICESwithCUDA_DEVICE_ORDER=PCI_BUS_ID, so the number means the same card everywhere (CUDA's default order is "fastest first" and can differ), and the Monitor now shows that card. For your install: runSTART-HERE.bat --setuponce (it saves the choice), or start withSTART-HERE.bat --gpu 1. Please reopen if it picks the wrong card.itguy327 commentedon Sep 28, 2026
Thank you
Choosing the GPU (#51): --gpu N, setup picks the one with the most VRAM
Choosing the GPU (Niko1221#51): --gpu N, setup picks the one with the…
Choosing the GPU (Niko1221#51): --gpu N, setup picks the one with the…