Skip to content

cuda12 #3

Closed
Closed

Description

@vpezhgorski

can you add the experimental --cuda 12 support from strata?

Activity

  1. VecSzn commented on Oct 10, 2026

    @VecSzn
    Collaborator

    Strata's --cuda 12 is already in PolyStrata for Qwen3.8-Flash-Next, the installer is the same. The engine for the 4 added models gets compiled on your PC; it built successfully with CUDA 12.8 on Linux, on Windows I've only built it with 13.0 so far. What card and driver do you have? Then I can check what's missing for your setup.

  2. vpezhgorski commented on Oct 11, 2026

    @vpezhgorski
    Author

    Which model? [1]: 6
    [ok] model: Qwen3.6-35B-A3B

    [X] Qwen3.6-35B-A3B's engine is built for RTX 20 cards and newer: there is none for Pascal / Volta cards or --cuda 12
    use an RTX 20 card or newer, without --cuda 12

    Setup stopped. Fix the item above and run it again - everything already done is kept and skipped.

    gtx 1070 8gb

  3. VecSzn commented on Oct 12, 2026

    @VecSzn
    Collaborator

    This is in 0.1.42-poly.3 now. Update PolyStrata and run START-HERE.bat again. On a GTX 1070 setup picks CUDA 12 by itself, so you don't need to add --cuda 12.

    Before that, install the CUDA Toolkit 12.9 from https://developer.nvidia.com/cuda-toolkit-archive (it can sit next to CUDA 13). Setup can't install that one for you. If the Visual Studio Build Tools are missing, setup installs them itself.

    There's no ready-made CUDA 12 engine, so setup compiles strata-poly on your PC and the first run takes longer.

    I don't have a Pascal card. It builds for Pascal with CUDA 12.9 on Windows and with 12.4 and 12.8 on Linux, and the Pascal code gave the same answers when I ran it on a newer card. If something breaks, paste the end of the setup output here and I'll look at it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions