Repository navigation
Closed
Description
Git commit
Operating systems
Linux
GGML backends
CUDA
Problem description & steps to reproduce
Quants PQ2_0 and PTQ1_0 already supported in upstream. dd614c2
Rolling back commit #169 helped resolve the build error.
First Bad Commit
Compile command
cmake -B build -DGGML_CUDA=ON -DGGML_NATIVE=ON -DGGML_CUDA_FA=ON -DCMAKE_BUILD_TYPE=Release -DCMAKE_C_COMPILER=gcc-10 -DCMAKE_CXX_COMPILER=g++-10 -DCMAKE_CUDA_HOST_COMPILER=g++-10 -DCMAKE_CXX_STANDARD=17 -DCMAKE_CUDA_STANDARD=17 -DGGML_CUDA_ARCHITECTURES=86-real -DCMAKE_CUDA_FLAGS="-arch=sm_86" -DCMAKE_CUDA_ARCHITECTURES=86-realRelevant log output
/home/oem/beellama.cpp/ggml/src/ggml-quants.h:19:69: error: unknown type name ‘block_pq2_0’; did you mean ‘block_tq2_0’?
19 | GGML_API void quantize_row_pq2_0_ref(const float * GGML_RESTRICT x, block_pq2_0 * GGML_RESTRICT y, int64_t k);
| ^~~~~~~~~~~
| block_tq2_0
/home/oem/beellama.cpp/ggml/src/ggml-quants.h:20:70: error: unknown type name ‘block_ptq1_0’; did you mean ‘block_tq1_0’?
20 | GGML_API void quantize_row_ptq1_0_ref(const float * GGML_RESTRICT x, block_ptq1_0 * GGML_RESTRICT y, int64_t k);
| ^~~~~~~~~~~~
| block_tq1_0
/home/oem/beellama.cpp/ggml/src/ggml-quants.h:50:42: error: unknown type name ‘block_pq2_0’
50 | GGML_API void dequantize_row_pq2_0(const block_pq2_0 * GGML_RESTRICT x, float * GGML_RESTRICT y, int64_t k);
| ^~~~~~~~~~~
/home/oem/beellama.cpp/ggml/src/ggml-quants.h:51:43: error: unknown type name ‘block_ptq1_0’
51 | GGML_API void dequantize_row_ptq1_0(const block_ptq1_0 * GGML_RESTRICT x, float * GGML_RESTRICT y, int64_t k);
| ^~~~~~~~~~~~
/home/oem/beellama.cpp/ggml/src/ggml.c:695:37: error: ‘QK_PQ2_0’ undeclared here (not in a function); did you mean ‘QK2_0’?
695 | .blck_size = QK_PQ2_0,
| ^~~~~~~~
| QK2_0
/home/oem/beellama.cpp/ggml/src/ggml.c:696:44: error: ‘block_pq2_0’ undeclared here (not in a function); did you mean ‘block_tq2_0’?
696 | .type_size = sizeof(block_pq2_0),
| ^~~~~~~~~~~
| block_tq2_0
/home/oem/beellama.cpp/ggml/src/ggml.c:699:57: error: ‘quantize_row_pq2_0_ref’ undeclared here (not in a function); did you mean ‘quantize_row_tq2_0_ref’?
699 | .from_float_ref = (ggml_from_float_t) quantize_row_pq2_0_ref,
| ^~~~~~~~~~~~~~~~~~~~~~
| quantize_row_tq2_0_ref
/home/oem/beellama.cpp/ggml/src/ggml.c:703:37: error: ‘QK_PTQ1_0’ undeclared here (not in a function)
703 | .blck_size = QK_PTQ1_0,
| ^~~~~~~~~
/home/oem/beellama.cpp/ggml/src/ggml.c:704:44: error: ‘block_ptq1_0’ undeclared here (not in a function); did you mean ‘block_tq1_0’?
704 | .type_size = sizeof(block_ptq1_0),
| ^~~~~~~~~~~~
| block_tq1_0
/home/oem/beellama.cpp/ggml/src/ggml.c:707:57: error: ‘quantize_row_ptq1_0_ref’ undeclared here (not in a function); did you mean ‘quantize_row_tq1_0_ref’?
707 | .from_float_ref = (ggml_from_float_t) quantize_row_ptq1_0_ref,
| ^~~~~~~~~~~~~~~~~~~~~~~
| quantize_row_tq1_0_ref
gmake[2]: *** [ggml/src/CMakeFiles/ggml-base.dir/build.make:79: ggml/src/CMakeFiles/ggml-base.dir/ggml.c.o] Error 1
gmake[2]: *** Waiting for unfinished jobs....Reacted by Piggidragon
Metadata
Metadata
Assignees
Labels
No labels
Activity
Fix Bonsai quantization builds with non-MSVC compilers
Anbeeld commentedon Oct 12, 2026
Fixed on v0.4.8, please try it.