Was just gonna post about the same thing. I think T5 family should be supported by llama.cpp nowadays: ggml-org/llama.cpp#8141
Thanks city96 for excellent work!
Consider it done! #49 - more info in the PR.
Activity
jepjoo commentedon Aug 15, 2024
Was just gonna post about the same thing. I think T5 family should be supported by llama.cpp nowadays:
ggml-org/llama.cpp#8141
Thanks city96 for excellent work!
city96 commentedon Aug 20, 2024
Consider it done! #49 - more info in the PR.