This is a GGUF conversion of Google's T5 v1.1 XXL encoder model.
Modellquelle
Quellenbeschreibung
This is a GGUF conversion of Google's T5 v1.1 XXL encoder model.
The weights can be used with ./llama-embedding or with the ComfyUI-GGUF custom node together with image generation models.
This is a quant as llama.cpp doesn't support imatrix creation for T5 models at the time of writing. It's therefore recommended to use for the best results, although smaller models may also still provide decent results in resource constrained scenarios.
Verwandte Ressourcen
2 VerbindungenQuellen
1 QuelleVerifiziert 29. Juli
Modellartefakte
11 ArtefakteQuellenauszüge
2 Auszüge--- base_model: google/t5-v1_1-xxl library_name: gguf license: apache-2.0 quantized_by: city96 language: en --- This is a GGUF conversion of Google's T5 v1.1 XXL encoder model. The weights can be used with [`./llama-embedding`](https://github.com/ggerganov/llama.cpp/tree/master/examples/embedding) or with the [ComfyUI-GGUF](https://github.com/city96/ComfyUI-GGUF) custom node together with image generation models. This is a **non imatrix** quant as llama.cpp doesn't support imatrix creation for T5 models at the time of writing. It's therefore recommended to use **Q5_K_M or larger** for the best results, although smaller models may also still provide decent results in resource constrained scenarios.
t5-v1_1-xxl-encoder-Q3_K_L.gguf
gguf · 2,29 GB · SHA-256 8f5ab8792343…f64b · Hugging Face
t5-v1_1-xxl-encoder-Q3_K_M.gguf
gguf · 2,14 GB · SHA-256 f28631189911…00d0 · Hugging Face
Herunterladent5-v1_1-xxl-encoder-Q3_K_S.gguf
gguf · 1,96 GB · SHA-256 31ebe18e901b…9f5c · Hugging Face
Herunterladent5-v1_1-xxl-encoder-Q4_K_M.gguf
gguf · 2,70 GB · SHA-256 6be2b0b7e2de…1af4 · Hugging Face
Herunterladent5-v1_1-xxl-encoder-Q4_K_S.gguf
gguf · 2,55 GB · SHA-256 88b696cfae09…558c · Hugging Face
Herunterladent5-v1_1-xxl-encoder-Q5_K_M.gguf
gguf · 3,15 GB · SHA-256 b51cbb10b1a7…1dae · Hugging Face
Herunterladent5-v1_1-xxl-encoder-Q5_K_S.gguf
gguf · 3,07 GB · SHA-256 86427a1f4dba…628e · Hugging Face
HerunterladenSource context: 50114 downloads · 532 likes · Library gguf · Repo city96/t5-v1_1-xxl-encoder-gguf