This are the quantizations of the model LightOnOCR-2-1B-bbox-soup
Fuente del modelo
Descripción de la fuente
This are the quantizations of the model LightOnOCR-2-1B-bbox-soup
Try to use the best quality you can run.
Quality order: BF16 > F16 > Q8_0 > Q6_K > Q5_K_M > IQ4_NL > IQ4_XS > Q4_K_M
For the mmproj, try to use the F32 version as it will produce the best results.
Quality order: F32 > BF16 > F16
Fuentes
1 fuenteVerificado 10 sept
Artefactos del modelo
12 artefactosExtractos de fuentes
2 extractos--- pipeline_tag: image-to-text base_model: lightonai/LightOnOCR-2-1B-bbox-soup --- This are the quantizations of the model [LightOnOCR-2-1B-bbox-soup](https://huggingface.co/lightonai/LightOnOCR-2-1B-bbox-soup) Try to use the best quality you can run. Quality order: BF16 > F16 > Q8_0 > Q6_K > Q5_K_M > IQ4_NL > IQ4_XS > Q4_K_M For the mmproj, try to use the F32 version as it will produce the best results. Quality order: F32 > BF16 > F16
LightOnOCR-2-1B-bbox-soup-F16.gguf
gguf · 1,12 GB · SHA-256 f19a660298ed…eea0 · Hugging Face
LightOnOCR-2-1B-bbox-soup-IQ4_NL.gguf
gguf · 364 MB · SHA-256 0c727f8ddab7…f5b9 · Hugging Face
DescargarLightOnOCR-2-1B-bbox-soup-IQ4_XS.gguf
gguf · 351 MB · SHA-256 dcbe8878e01e…dba5 · Hugging Face
DescargarLightOnOCR-2-1B-bbox-soup-Q4_K_M.gguf
gguf · 378 MB · SHA-256 366f769999a5…456f · Hugging Face
DescargarLightOnOCR-2-1B-bbox-soup-Q5_K_M.gguf
gguf · 424 MB · SHA-256 2ef08199a002…8ad3 · Hugging Face
DescargarLightOnOCR-2-1B-bbox-soup-Q6_K.gguf
gguf · 472 MB · SHA-256 ce38f1b5f071…afc8 · Hugging Face
DescargarLightOnOCR-2-1B-bbox-soup-Q8_0.gguf
gguf · 610 MB · SHA-256 232d287ed22e…7e07 · Hugging Face
DescargarSource context: 682 downloads · 2 likes · Pipeline image-to-text · Repo noctrex/LightOnOCR-2-1B-bbox-soup-GGUF