This are the quantizations of the model LightOnOCR-2-1B
Modellquelle
Quellenbeschreibung
This are the quantizations of the model LightOnOCR-2-1B
Try to use the best quality you can run.
Quality order: BF16 > F16 > Q8_0 > Q6_K > Q5_K_M > IQ4_NL > IQ4_XS > Q4_K_M
For the mmproj, try to use the F32 version as it will produce the best results.
Quality order: F32 > BF16 > F16
Quellen
1 QuelleVerifiziert 10. Sept.
Modellartefakte
12 ArtefakteQuellenauszüge
2 Auszüge--- pipeline_tag: image-to-text base_model: lightonai/LightOnOCR-2-1B --- This are the quantizations of the model [LightOnOCR-2-1B](https://huggingface.co/lightonai/LightOnOCR-2-1B) Try to use the best quality you can run. Quality order: BF16 > F16 > Q8_0 > Q6_K > Q5_K_M > IQ4_NL > IQ4_XS > Q4_K_M For the mmproj, try to use the F32 version as it will produce the best results. Quality order: F32 > BF16 > F16
LightOnOCR-2-1B-F16.gguf
gguf · 1,12 GB · SHA-256 0cbee6bce16a…c5e7 · Hugging Face
Source context: 29 downloads · 0 likes · Pipeline image-to-text · Repo phungo156/LightOnOCR-2-1B-GGUF