Repository navigation
invalid model file './models/llama-13b-4bit.pt' (bad magic) #81
Description
Downloaded from
magnet:?xt=urn:btih:36945b5958b907b3ab69e963ba0de1abdf48c16c&dn=LLaMA-HFv2-4bit&tr=http%3a%2f%2fbt1.archive.org%3a6969%2fannounce&tr=http%3a%2f%2fbt2.archive.org%3a6969%2fannounceReacted by Olof Larsson
Reacted by lin72h
Activity
thement commentedon Mar 13, 2023
Those are weights for torch library. Llama.cpp uses different format and afaik it is not loadable yet.
gjmulder commentedon Mar 13, 2023
You need to run
python3 convert-pth-to-ggml.pyandquantizeon the torrent*.pthfiles to convert them into the correct format as per the instructions in the README.mdacheong08 commentedon Mar 13, 2023
I just downloaded the original files and quantized them. Worked well
Automatically Generate Releases for Mac, Linux, Windows (ggml-org#81)
docs: add RDMA backend retrospective v5 report
docs: update experiments #71 (rejected), #81 (done), #84 (blocked)
vulkan: fix turbo3 build + coopmat FA after April upstream sync
vulkan: fix turbo3 build + coopmat FA after April upstream sync
Move scale fudge factors to quantization (ggml-org#81)
fix(nix): remove duplicate spirv-headers function arg (ggml-org#81)
Merge pull request ggml-org#117 from TheTom/fix/issue-81-nix-spirv-dupe
vulkan: fix turbo3 build + coopmat FA after April upstream sync
50 remaining items
rdna-boosts: block 05: flash-attention band, native quantized K/V and…
rdna-boosts: block 05: flash-attention band, native quantized K/V and…
rdna-boosts: block 05: flash-attention band, native quantized K/V and…
rdna-boosts: block 05: flash-attention band, native quantized K/V and…
rdna-boosts: block 05: flash-attention band, native quantized K/V and…
rdna-boosts: block 05: flash-attention band, native quantized K/V and…
rdna-boosts: block 05: flash-attention band, native quantized K/V and…
rdna-boosts: block 05: flash-attention band, native quantized K/V and…
rdna-boosts: block 05: flash-attention band, native quantized K/V and…
rdna-boosts: block 05: flash-attention band, native quantized K/V and…
rdna-boosts: block 05: flash-attention band, native quantized K/V and…
rdna-boosts: block 05: flash-attention band, native quantized K/V and…
rdna-boosts: block 05: flash-attention band, native quantized K/V and…
rdna-boosts: block 05: flash-attention band, native quantized K/V and…
rdna-boosts: block 05: flash-attention band, native quantized K/V and…