Saltar al contenido
ModelPublicadoExterno
Browse files

Hulu Med 30A3 GGUF

For a convenient overview and download list, visit our model page for this model.

Fuentehuggingface.co/mradermacher/Hulu-Med-30A3-GGUF/tree/342bde845cfd1577f8f5c82604dae4158f094083
TipoOtherModelo baseZJU-AI4H/Hulu-Med-30A3VersiónRevision 342bde8Bcalidad

Fuente del modelo

Tipo
Other
Tamaño del archivo
679 MB–30,3 GB
Modelo base
ZJU-AI4H/Hulu-Med-30A3
Versión
vRevision 342bde8
Actualizado
18 sept 2026
Descargas
172
Fuente
Hugging Face

Descripción de la fuente

About

static quants of https://huggingface.co/ZJU-AI4H/Hulu-Med-30A3

For a convenient overview and download list, visit our model page for this model.

weighted/imatrix quants are available at https://huggingface.co/mradermacher/Hulu-Med-30A3-i1-GGUF

Usage

If you are unsure how to use GGUF files, refer to one of TheBloke's READMEs for more details, including on how to concatenate multi-part files.

Provided Quants

(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)

LinkTypeSize/GBNotes
GGUFmmproj-Q8_00.8multi-modal supplement
GGUFmmproj-f161.2multi-modal supplement
GGUFQ2_K11.4
GGUFQ3_K_S13.4
GGUFQ3_K_M14.8lower quality
GGUFQ3_K_L16.0
GGUFIQ4_XS16.7
GGUFQ4_K_S17.6fast, recommended
GGUFQ4_K_M18.7fast, recommended
GGUFQ5_K_S21.2
GGUFQ5_K_M21.8
GGUFQ6_K25.2very good quality
GGUFQ8_032.6fast, best quality

Here is a handy graph by ikawrakow comparing some lower-quality quant types (lower is better):

image.png

And here are Artefact2's thoughts on the matter: https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9

FAQ / Model Request

See https://huggingface.co/mradermacher/model_requests for some answers to questions you might have and/or if you want some other model quantized.

Thanks

I thank my company, nethype GmbH, for letting me use its servers and providing upgrades to my workstation to enable this work in my free time.

Fuentes

1 fuente
Hugging FacePrincipalVersión 342bde845cfd1577f8f5c82604dae4158f094083
huggingface.co/mradermacher/Hulu-Med-30A3-GGUF/tree/342bde845cfd1577f8f5c82604dae4158f094083

Verificado 3 sept

Download files

Artefactos del modelo

13 artefactos

Hulu-Med-30A3.IQ4_XS.gguf

gguf · 15,4 GB · SHA-256 a06e822508c8…acb8 · Hugging Face

Download file

Hulu-Med-30A3.mmproj-f16.gguf

gguf · 1,01 GB · SHA-256 f834c39fdef0…bbbd · Hugging Face

Download file

Hulu-Med-30A3.mmproj-Q8_0.gguf

gguf · 679 MB · SHA-256 73b7d81251d8…aa7a · Hugging Face

Download file

Hulu-Med-30A3.Q2_K.gguf

gguf · 10,5 GB · SHA-256 b126c4ca3681…b023 · Hugging Face

Download file

Hulu-Med-30A3.Q3_K_L.gguf

gguf · 14,8 GB · SHA-256 606beab7761e…e746 · Hugging Face

Download file

Hulu-Med-30A3.Q3_K_M.gguf

gguf · 13,7 GB · SHA-256 6c450aaee78e…3cce · Hugging Face

Download file

Hulu-Med-30A3.Q3_K_S.gguf

gguf · 12,4 GB · SHA-256 db16711fb956…9e2f · Hugging Face

Download file

Hulu-Med-30A3.Q4_K_M.gguf

gguf · 17,3 GB · SHA-256 7b43da9335b9…97ef · Hugging Face

Download file

Hulu-Med-30A3.Q4_K_S.gguf

gguf · 16,3 GB · SHA-256 f586a64f6048…ee2f · Hugging Face

Download file

Hulu-Med-30A3.Q5_K_M.gguf

gguf · 20,2 GB · SHA-256 cfd679d0572f…21c7 · Hugging Face

Download file

Hulu-Med-30A3.Q5_K_S.gguf

gguf · 19,6 GB · SHA-256 104ca7883e6b…7b87 · Hugging Face

Download file

Hulu-Med-30A3.Q6_K.gguf

gguf · 23,4 GB · SHA-256 80a165d3ab08…0ea2 · Hugging Face

Download file

Hulu-Med-30A3.Q8_0.gguf

gguf · 30,3 GB · SHA-256 995b6342f907…bbcd · Hugging Face

Download file

Extractos de fuentes

2 extractos
Readme3 septhuggingface.co/mradermacher/Hulu-Med-30A3-GGUF

--- base_model: ZJU-AI4H/Hulu-Med-30A3 language: - en library_name: transformers license: apache-2.0 mradermacher: readme_rev: 1 quantized_by: mradermacher tags: - medical - multimodal - vision-language-model - image-to-text - video-understanding - 3d-understanding - qwen - pytorch --- ## About <!-- ### quantize_version: 2 --> <!-- ### output_tensor_quantised: 1 --> <!-- ### convert_type: hf --> <!-- ### vocab_type: --> <!-- ### tags: --> <!-- ### quants: x-f16 Q4_K_S Q2_K Q8_0 Q6_K Q3_K_M Q3_K_S Q3_K_L Q4_K_M Q5_K_S Q5_K_M IQ4_XS --> <!-- ### quants_skip: --> <!-- ### skip_mmproj: --> static quants of https://huggingface.co/ZJU-AI4H/Hulu-Med-30A3 <!-- provided-files --> ***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Hulu-Med-30A3-GGUF).*** weighted/imatrix quants are available at https://huggingface.co/mradermacher/Hulu-Med-30A3-i1-GGUF ## Usage If you are unsure how to use GGUF files, refer to one of [TheBloke's READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for more details, including on how to concatenate multi-part files. ## Provided Quants (sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) | Link | Type | Size/GB | Notes | |:-----|:-----|--------:|:------| | [GGUF](https://huggingface.co/mradermacher/Hulu-Med-30A3-GGUF/resolve/main/Hulu-Med-30A3.mmproj-Q8_0.gguf) | mmproj-Q8_0 | 0.8 | multi-modal supplement | | [GGUF](https://huggingface.co/mradermacher/Hulu-Med-30A3-GGUF/resolve/main/Hulu-Med-30A3.mmproj-f16.gguf) | mmproj-f16 | 1.2 | multi-modal supplement | | [GGUF](https://huggingface.co/mradermacher/Hulu-Med-30A3-GGUF/resolve/main/Hulu-Med-30A3.Q2_K.gguf) | Q2_K | 11.4 | | | [GGUF](https://huggingface.co/mradermacher/Hulu-Med-30A3-GGUF/resolve/main/Hulu-Med-30A3.Q3_K_S.gguf) | Q3_K_S | 13.4 | | | [GGUF](https://huggingface.co/mradermacher/Hulu-Med-30A3-GGUF/resolve/main/Hulu-Med-30A3.Q3_K_M.gguf) | Q3_K_M | 14.8 | lower quality | | [GGUF](https://huggingface.co/mradermacher/Hulu-Med-30A3-GGUF/resolve/main/Hulu-Med-30A3.Q3_K_L.gguf) | Q3_K_L | 16.0 | | | [GGUF](https://huggingface.co/mradermacher/Hulu-Med-30A3-GGUF/resolve/main/Hulu-Med-30A3.IQ4_XS.gguf) | IQ4_XS | 16.7 | | | [GGUF](https://huggingface.co/mradermacher/Hulu-Med-30A3-GGUF/resolve/main/Hulu-Med-30A3.Q4_K_S.gguf) | Q4_K_S | 17.6 | fa...

Note3 septhuggingface.co/mradermacher/Hulu-Med-30A3-GGUF

Source context: 172 downloads · 0 likes · Pipeline image-to-text · Library transformers · Repo mradermacher/Hulu-Med-30A3-GGUF